-- Logs begin at Wed 2022-07-27 22:01:22 UTC, end at Wed 2022-07-27 23:14:12 UTC. -- Jul 27 22:34:46.407360 dv-cinder-851249-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 27 22:34:46.414520 dv-cinder-851249-4-smb devstack@keystone.service[86582]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 27 22:34:46.416562 dv-cinder-851249-4-smb devstack@keystone.service[86582]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 22:34:46 2022] *** Jul 27 22:34:46.416562 dv-cinder-851249-4-smb devstack@keystone.service[86582]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 22:34:46.416562 dv-cinder-851249-4-smb devstack@keystone.service[86582]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 22:34:46.416562 dv-cinder-851249-4-smb devstack@keystone.service[86582]: nodename: dv-cinder-851249-4-smb Jul 27 22:34:46.416562 dv-cinder-851249-4-smb devstack@keystone.service[86582]: machine: x86_64 Jul 27 22:34:46.416562 dv-cinder-851249-4-smb devstack@keystone.service[86582]: clock source: unix Jul 27 22:34:46.416562 dv-cinder-851249-4-smb devstack@keystone.service[86582]: pcre jit disabled Jul 27 22:34:46.416562 dv-cinder-851249-4-smb devstack@keystone.service[86582]: detected number of CPU cores: 4 Jul 27 22:34:46.416996 dv-cinder-851249-4-smb devstack@keystone.service[86582]: current working directory: / Jul 27 22:34:46.416996 dv-cinder-851249-4-smb devstack@keystone.service[86582]: detected binary path: /usr/bin/uwsgi-core Jul 27 22:34:46.416996 dv-cinder-851249-4-smb devstack@keystone.service[86582]: your processes number limit is 47680 Jul 27 22:34:46.416996 dv-cinder-851249-4-smb devstack@keystone.service[86582]: your memory page size is 4096 bytes Jul 27 22:34:46.416996 dv-cinder-851249-4-smb devstack@keystone.service[86582]: detected max file descriptor number: 2048 Jul 27 22:34:46.416996 dv-cinder-851249-4-smb devstack@keystone.service[86582]: lock engine: pthread robust mutexes Jul 27 22:34:46.416996 dv-cinder-851249-4-smb devstack@keystone.service[86582]: thunder lock: enabled Jul 27 22:34:46.416996 dv-cinder-851249-4-smb devstack@keystone.service[86582]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 27 22:34:46.416996 dv-cinder-851249-4-smb devstack@keystone.service[86582]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 22:34:46.458270 dv-cinder-851249-4-smb devstack@keystone.service[86582]: Python main interpreter initialized at 0x55d03726d9c0 Jul 27 22:34:46.458270 dv-cinder-851249-4-smb devstack@keystone.service[86582]: python threads support enabled Jul 27 22:34:46.458270 dv-cinder-851249-4-smb devstack@keystone.service[86582]: your server socket listen backlog is limited to 100 connections Jul 27 22:34:46.458270 dv-cinder-851249-4-smb devstack@keystone.service[86582]: your mercy for graceful operations on workers is 90 seconds Jul 27 22:34:46.458666 dv-cinder-851249-4-smb devstack@keystone.service[86582]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 22:34:46.458741 dv-cinder-851249-4-smb devstack@keystone.service[86582]: *** Operational MODE: preforking *** Jul 27 22:34:46.459018 dv-cinder-851249-4-smb devstack@keystone.service[86582]: *** uWSGI is running in multiple interpreter mode *** Jul 27 22:34:46.459018 dv-cinder-851249-4-smb devstack@keystone.service[86582]: spawned uWSGI master process (pid: 86582) Jul 27 22:34:46.459221 dv-cinder-851249-4-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 27 22:34:46.460050 dv-cinder-851249-4-smb devstack@keystone.service[86582]: spawned uWSGI worker 1 (pid: 86594, cores: 1) Jul 27 22:34:46.460139 dv-cinder-851249-4-smb devstack@keystone.service[86582]: spawned uWSGI worker 2 (pid: 86595, cores: 1) Jul 27 22:34:46.460276 dv-cinder-851249-4-smb devstack@keystone.service[86582]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 22:34:51.925745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 22:34:51.925745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: from cryptography.utils import int_from_bytes Jul 27 22:34:51.926546 dv-cinder-851249-4-smb devstack@keystone.service[86594]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 22:34:51.926546 dv-cinder-851249-4-smb devstack@keystone.service[86594]: from cryptography.utils import int_from_bytes Jul 27 22:34:51.926652 dv-cinder-851249-4-smb devstack@keystone.service[86595]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 22:34:51.926652 dv-cinder-851249-4-smb devstack@keystone.service[86595]: from cryptography.utils import int_from_bytes Jul 27 22:34:51.926652 dv-cinder-851249-4-smb devstack@keystone.service[86595]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 22:34:51.926652 dv-cinder-851249-4-smb devstack@keystone.service[86595]: from cryptography.utils import int_from_bytes Jul 27 22:34:51.976317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 22:34:51.976500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 22:34:51.976582 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 22:34:51.976697 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 22:34:51.976784 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] command line args: [] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 22:34:51.976896 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] command line args: [] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 22:34:51.976980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 22:34:51.977138 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ================================================================================ {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 22:34:51.977223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 22:34:51.977367 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ================================================================================ {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 22:34:51.977449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] admin_token = **** {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.977625 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] admin_token = **** {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.977703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] config_dir = [] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.977827 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.977904 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] config_dir = [] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.978013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] config_source = [] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.978109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.978191 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] debug = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.978262 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] config_source = [] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.978407 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.978704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] debug = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.978704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.978974 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.979094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.979214 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.979325 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.979446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.979564 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.979675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.979785 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.979900 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] list_limit = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.980017 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] list_limit = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.980135 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] log_config_append = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.980247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] log_config_append = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.980357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.980466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.980575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] log_dir = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.980683 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] log_dir = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.980800 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] log_file = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.980916 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] log_file = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.981027 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.981142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.981254 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.981369 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.981478 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.981571 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.981686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.981796 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.981899 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.982021 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.982144 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.982269 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.982361 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.982486 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.982568 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.982701 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.982821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.982902 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.983015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.983088 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.983197 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.983281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.983352 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.983464 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.983546 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.983623 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.983733 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.983817 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.983893 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.984007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.984146 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.984229 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.984312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] publish_errors = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.984432 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] publish_errors = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.984549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.984637 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.984782 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.984898 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.984972 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.985088 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.985195 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.985289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.985432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.985550 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.985660 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] standard_threads = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.985768 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] standard_threads = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.985927 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.986037 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.986148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.986260 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.986400 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.986525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.986525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] use_journal = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.986747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] use_journal = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.986863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] use_json = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.986974 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] use_json = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.987084 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] use_stderr = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.987198 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] use_stderr = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.987316 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] use_syslog = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.987428 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] use_syslog = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.987539 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.987648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 22:34:51.987757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.987867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.987984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.988101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.988218 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.988335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.988445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.988567 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.988685 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.988803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.988914 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.989024 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.989140 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.989259 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.989371 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.989480 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.989595 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.989707 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.989823 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.989941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.990053 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.990163 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.990272 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.990406 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.990528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.990652 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.990773 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.990887 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.990997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.991107 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.991223 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.991414 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.991529 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.991645 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.991758 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.991868 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.991978 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.992105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.992223 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.992335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.992444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.992554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.992669 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.992793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.993387 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.993497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.993613 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.993724 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.993835 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.993953 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.994065 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.994182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.994293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.994429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.994539 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.994662 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.994774 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.994892 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.995003 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.995113 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.995222 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.995343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.995461 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.995573 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.995682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.995792 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.995910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.996028 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.996145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.996260 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.996370 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.996485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.996608 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.996726 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.996838 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.996948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.997063 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.997174 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.997359 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.997472 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.997582 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.997691 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.997801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.997910 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.998031 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.998143 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.998252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.998385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.998499 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.998609 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.998727 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.998839 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.998948 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.999058 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.999167 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.999282 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.999401 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.999513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.999628 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.999738 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.999738 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:51.999942 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.000059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.000177 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.000272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.000369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.000466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.000604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.000710 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.000818 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.000917 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.001009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.001108 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.001209 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.001316 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.001415 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.001524 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.001635 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.001744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.001856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.001977 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.002097 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.002217 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.002359 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.002485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.002611 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.002733 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.002848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.002970 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.003083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.003194 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.003305 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.003415 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.003516 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.003634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.003747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.003747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.003932 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.004042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.004152 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.004276 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.004391 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.004508 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.004609 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.004718 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.004828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.004948 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.005061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.005172 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.005283 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.005395 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.005513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.005627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.005744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.005856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.005967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.006077 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.006199 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.006320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.006486 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.006598 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.006719 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.006833 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.006953 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.007067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.007178 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.007278 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.007387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.007387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.007607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.007720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.007831 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.007942 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.008053 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.008164 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.008349 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.008464 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.009167 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.009282 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.009393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.009504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.009625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.009752 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.009876 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.009990 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.010101 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.010212 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.010330 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.010467 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.010592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.010706 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.010823 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.010927 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.011037 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.011148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.011270 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.011384 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.011495 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.011606 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.011723 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.011836 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.011959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.012073 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.012195 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.012309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.012420 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.012531 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.012653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.012767 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] auth.external = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.012879 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] auth.external = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.012989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.013106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.013219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.013365 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.013491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.013606 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.013717 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] auth.password = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.013830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] auth.password = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.013942 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] auth.token = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.014054 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] auth.token = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.014173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.014287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.014458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.014572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.014683 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.014796 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.014920 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.015035 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.015147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.015259 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.015371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.015491 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.015614 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.015728 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.015842 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] credential.caching = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.015953 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] credential.caching = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.016065 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.016177 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.016300 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.016415 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.016528 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.016639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.016751 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.016870 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.016992 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.017106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.017218 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.017329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.017441 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.017552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.017672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.017786 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.017898 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.018010 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.018122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.018234 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.018366 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.018482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.018595 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.018706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.018818 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.018930 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.019054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.019169 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.019281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.019393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.019505 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] federation.caching = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.019617 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] federation.caching = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.019737 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.019851 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.019972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.020087 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.020199 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.020310 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.020430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.020544 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.020655 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.020776 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.020890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.021002 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.021124 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.021238 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.021350 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.021462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.021581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.021700 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.021822 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.021936 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.022048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.022168 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.022282 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] identity.caching = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.022420 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] identity.caching = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.022615 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.022732 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.022845 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.022957 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.023069 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.023183 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.023303 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.023417 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.023519 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.023629 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.023741 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.023861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.023975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.024087 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.024282 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.024397 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.024509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.024630 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.024630 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.024843 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.024955 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.025066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.025178 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.025299 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.025414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.025526 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.025638 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.025749 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.025861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.025980 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.026094 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.026206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.026319 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.026455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.026568 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.026682 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.026796 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.026907 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.027019 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.027130 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.027242 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.027362 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.027476 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.027587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.027699 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.027810 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.027922 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.028042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.028156 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.028268 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.028379 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.028492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.028603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.028723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.028844 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.028957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.029068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.029180 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.029291 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.029412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.029526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.029638 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.029749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.029867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.029981 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.030101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.030214 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.030326 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.030484 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.030597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.030709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.030832 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.030947 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.031059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.031170 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.031282 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.031399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.031524 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.031639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.031751 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.031864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.031975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.032087 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.032207 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.032321 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.032433 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.032545 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.032657 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.032769 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.032889 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.033003 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.033115 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.033226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.033344 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.033458 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.033578 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.033693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.033805 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.033917 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.034028 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.034140 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.user = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.034259 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.user = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.034389 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.034504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.034616 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.034729 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.034841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.034964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.035078 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.035190 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.035301 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.035418 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.035540 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.035653 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.035766 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.035877 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.035989 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.036100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.036224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.036339 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.036454 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.036566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.036678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.036789 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.036910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.037024 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.037136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.037247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.037359 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.037470 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.037590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.037704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.037816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.037929 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.038040 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.038151 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.038271 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.038433 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.038547 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.038659 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.038771 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.038893 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.039017 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.039131 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.039243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.039355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.039467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.039579 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.040213 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.040336 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.040449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.040560 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.040678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.040792 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.040912 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.041028 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.041140 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.041252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.041364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.041475 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.041595 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.041709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.041821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.041933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.042045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.042157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.042277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.042465 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.042580 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.042692 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.042803 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.042915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.043038 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.043154 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.043267 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] resource.caching = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.043379 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] resource.caching = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.043490 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.043601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.043721 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.043836 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.043948 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.044060 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.044173 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.044291 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.044413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.044527 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.044640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.044752 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.044864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.044976 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.045160 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.045277 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.045389 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.045501 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.045614 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] role.caching = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.045726 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] role.caching = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.045846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] role.driver = sql {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.045960 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] role.driver = sql {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.046073 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.046185 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.046298 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.046428 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.046554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.046911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.047025 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.047138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.047138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.047351 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.047473 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.047588 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.047700 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.047812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.047924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.048045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.048160 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.048272 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.048385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.048497 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.048609 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.048729 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.048843 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.048955 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.049067 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.049179 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.049291 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.049413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.049527 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.049639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.049757 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.049871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.049989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.050111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.050226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.050367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.050484 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.050597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.050708 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.050833 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.050948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.051061 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.051172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.051285 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.051397 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.051519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.051639 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.051753 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.051753 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.051963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.052075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.052195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.052309 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.052421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.052534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.052653 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.052774 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.052888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.053000 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.053112 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.053224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.053336 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.053456 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.053570 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.053682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.053794 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.053913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] token.caching = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.054026 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] token.caching = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.054146 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.054260 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.054386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.054501 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.054612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.054725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.054848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.054963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.055075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.055187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.055299 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.056036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.056163 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.056278 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.056391 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.056506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.056619 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.056733 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.056853 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.056967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.057079 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.057191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.057303 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.057415 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.057535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.057649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.057762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.057874 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.057986 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.058097 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.058218 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.058332 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.058466 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.058579 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.058691 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] database.connection = **** {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.058816 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] database.connection = **** {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.058944 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.059067 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.059181 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.059302 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.059416 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.059529 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.059641 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.059753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.059867 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.059987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.060101 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.060214 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.060326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.060439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.060552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.060672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.060787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.060899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.061013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.061125 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.061237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.061365 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.061485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.061599 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.061712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.061824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.061936 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.062061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.062176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.062288 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.062453 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.062566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.062678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.062803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.062918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.063032 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 22:34:52.063144 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86594) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 22:34:52.063257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86595) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 22:34:52.091517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.091672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.091753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.091826 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.091965 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.092051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.100294 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.100382 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.130760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.130993 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.131084 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.131258 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.183665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.183822 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.233949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.234083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.234177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.234323 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.298797 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.299026 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.299113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.299252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.299356 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.299474 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.299558 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.299694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.299777 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.299913 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.299999 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.300152 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.323386 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.323663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.323797 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.323880 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.323993 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.324104 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.324187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.324325 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.324410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.324539 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.324622 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.324752 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.324835 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.324965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.336088 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.337360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.348753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.348989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.349097 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.349213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.349299 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.349437 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.349521 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.349866 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.349953 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.350030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.350104 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.350177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86595) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.350251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.350335 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86594) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 22:34:52.367494 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.367709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 22:34:52.368510 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.368669 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.368768 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 22:34:52.368874 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 22:34:52.369047 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.369130 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.369250 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 22:34:52.369392 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.369520 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.369650 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.369780 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.369904 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.370038 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.370295 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.379577 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.379858 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.380098 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.380181 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.380379 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.380475 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.380651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.380934 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.387317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.387903 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.392007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.392290 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.392566 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.392650 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.392845 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.392941 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.393126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.393208 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.393381 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.393463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.393648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.393775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.393925 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.394008 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.394190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.394271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.394488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.394571 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.394757 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.394839 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.395029 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.395298 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.418763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.419258 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.420249 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.420533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.420746 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.421025 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.425127 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.425408 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.425631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.425713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.425914 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.426200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.432249 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.432534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.432809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.433094 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.436667 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.436916 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.437219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.437342 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.437506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.437633 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.437785 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.437927 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.438080 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.438209 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.438361 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.438508 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.438650 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.438791 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.439073 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.439355 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.454850 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.455133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.455503 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.455784 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.459069 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.459726 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.462736 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.463035 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.463406 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.463715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.467399 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.468122 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.470617 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.471394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.473749 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.474049 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.474354 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.474550 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.474633 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.474854 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.474949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.475143 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.475227 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.475448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.475730 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.476020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.491681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.491969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.492241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.492472 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.492567 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.492758 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.493062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.493328 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.499396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.500194 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.500945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.501233 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.501744 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.502023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.504062 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.504346 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.504641 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.504865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.504947 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.505150 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.505240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.505434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.505725 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.506020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.516733 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.517020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.517307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.517534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.517618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.517819 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.517911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.518106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.518190 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.518417 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.518503 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.518704 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.518981 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.519258 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.534449 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.535340 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.537388 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.538309 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.540962 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.541800 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.543455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.544315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.545042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.545327 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.545611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.545941 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.546237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.546552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.552063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.553004 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.553656 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.554639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.556607 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.556901 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.557183 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.557470 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.557585 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.557877 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.558165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.558465 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.565471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.565762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.566044 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.566527 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.566818 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.567102 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.572903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86595) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.573185 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.573467 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.573791 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.573956 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86594) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 22:34:52.574068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.574242 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.574373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.574547 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.574666 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.574831 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.575016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.575180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.575361 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.575514 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.575936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.576136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.576382 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.576563 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.576747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.576926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.577100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.577289 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.577467 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86595) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.577657 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.577657 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.577657 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.578118 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86594) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 22:34:52.610913 dv-cinder-851249-4-smb devstack@keystone.service[86595]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d03726d9c0 pid: 86595 (default app) Jul 27 22:34:52.612707 dv-cinder-851249-4-smb devstack@keystone.service[86594]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d03726d9c0 pid: 86594 (default app) Jul 27 22:34:52.614276 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2ec92-9d98-40f3-9fb9-765137518048 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:34:52.614593 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2ec92-9d98-40f3-9fb9-765137518048 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:34:52.614871 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e2ec92-9d98-40f3-9fb9-765137518048 None None] PATH_INFO: `/v3` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:34:52.619260 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Wed Jul 27 22:34:52 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:00.207602 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b472d81-c2fd-4f05-b078-8ead6f557075 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:00.208175 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b472d81-c2fd-4f05-b078-8ead6f557075 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:00.208175 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b472d81-c2fd-4f05-b078-8ead6f557075 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:00.213232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:00.218355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4520c79-f7c2-49cb-a3b3-04576a6549b8 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:00.218757 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4520c79-f7c2-49cb-a3b3-04576a6549b8 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:00.218912 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4520c79-f7c2-49cb-a3b3-04576a6549b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:00.288705 dv-cinder-851249-4-smb devstack@keystone.service[86595]: INFO dbcounter [None req-d4520c79-f7c2-49cb-a3b3-04576a6549b8 None None] Registered counter for database keystone Jul 27 22:35:00.309172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG oslo_db.sqlalchemy.engines [None req-d4520c79-f7c2-49cb-a3b3-04576a6549b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86595) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 22:35:00.315688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writer thread running {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 22:35:00.493850 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG passlib.handlers.bcrypt [None req-d4520c79-f7c2-49cb-a3b3-04576a6549b8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86595) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 22:35:00.494214 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG passlib.handlers.bcrypt [None req-d4520c79-f7c2-49cb-a3b3-04576a6549b8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86595) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 22:35:00.548288 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-d4520c79-f7c2-49cb-a3b3-04576a6549b8 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:00.549925 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d4520c79-f7c2-49cb-a3b3-04576a6549b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:00.673621 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 22:35:00.809197 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b472d81-c2fd-4f05-b078-8ead6f557075 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:00.878433 dv-cinder-851249-4-smb devstack@keystone.service[86594]: INFO dbcounter [None req-8b472d81-c2fd-4f05-b078-8ead6f557075 None None] Registered counter for database keystone Jul 27 22:35:00.897561 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG oslo_db.sqlalchemy.engines [None req-8b472d81-c2fd-4f05-b078-8ead6f557075 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86594) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 22:35:00.903696 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writer thread running {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 22:35:01.024043 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b472d81-c2fd-4f05-b078-8ead6f557075 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:01.028454 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e3fca-d3ec-4abf-9990-00a5620d24f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:01.029098 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e3fca-d3ec-4abf-9990-00a5620d24f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:01.029388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e3fca-d3ec-4abf-9990-00a5620d24f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:01.029670 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e3fca-d3ec-4abf-9990-00a5620d24f4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:01.037659 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e3fca-d3ec-4abf-9990-00a5620d24f4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:01.092940 dv-cinder-851249-4-smb devstack@keystone.service[86594]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c61e3fca-d3ec-4abf-9990-00a5620d24f4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 22:35:01.093223 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e3fca-d3ec-4abf-9990-00a5620d24f4 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:01.103116 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Wed Jul 27 22:35:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 22:35:01.109525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4520c79-f7c2-49cb-a3b3-04576a6549b8 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:01.124471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4520c79-f7c2-49cb-a3b3-04576a6549b8 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:01.128852 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb79989-f9e0-4d42-ba18-9588283003ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:01.129959 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb79989-f9e0-4d42-ba18-9588283003ac admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:01.130249 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb79989-f9e0-4d42-ba18-9588283003ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:01.130561 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb79989-f9e0-4d42-ba18-9588283003ac admin admin] PATH_INFO: `/v3/projects/a383910370a74720956232cbcc0a7762` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:01.132040 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb79989-f9e0-4d42-ba18-9588283003ac admin admin] RBAC: Authorizing `identity:get_project(project_id=a383910370a74720956232cbcc0a7762)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:01.181250 dv-cinder-851249-4-smb devstack@keystone.service[86595]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3eb79989-f9e0-4d42-ba18-9588283003ac admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 22:35:01.182180 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb79989-f9e0-4d42-ba18-9588283003ac admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:01.186766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Wed Jul 27 22:35:01 2022] GET /identity/v3/projects/a383910370a74720956232cbcc0a7762 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:03.141052 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca72b1-5939-4ac5-9605-31f3b2e0b36d None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:03.141599 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca72b1-5939-4ac5-9605-31f3b2e0b36d None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:03.141599 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca72b1-5939-4ac5-9605-31f3b2e0b36d None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:03.145736 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:35:03.151912 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df7eb7-9201-4c3c-b5bc-bdc60d862569 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:03.152297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df7eb7-9201-4c3c-b5bc-bdc60d862569 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:03.152478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0df7eb7-9201-4c3c-b5bc-bdc60d862569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:03.173171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-f0df7eb7-9201-4c3c-b5bc-bdc60d862569 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:03.174742 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-f0df7eb7-9201-4c3c-b5bc-bdc60d862569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:03.182619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 27 22:35:03.204110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca72b1-5939-4ac5-9605-31f3b2e0b36d None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:03.216654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca72b1-5939-4ac5-9605-31f3b2e0b36d None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:03.220886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6231f9-db84-49d1-b5a8-c0e00c669c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:03.221498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6231f9-db84-49d1-b5a8-c0e00c669c13 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:03.221789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6231f9-db84-49d1-b5a8-c0e00c669c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:03.222071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6231f9-db84-49d1-b5a8-c0e00c669c13 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:03.230427 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6231f9-db84-49d1-b5a8-c0e00c669c13 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:03.232205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6231f9-db84-49d1-b5a8-c0e00c669c13 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:03.240886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Wed Jul 27 22:35:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 22:35:03.246002 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df7eb7-9201-4c3c-b5bc-bdc60d862569 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:03.254867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0df7eb7-9201-4c3c-b5bc-bdc60d862569 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:03.259211 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ca3b2-7ee7-4b1e-b476-f20333d544ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:03.259838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ca3b2-7ee7-4b1e-b476-f20333d544ce admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:03.260126 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ca3b2-7ee7-4b1e-b476-f20333d544ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:03.260408 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ca3b2-7ee7-4b1e-b476-f20333d544ce admin admin] PATH_INFO: `/v3/users/823fd54d00af495593a275a61c2223da` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:03.262252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ca3b2-7ee7-4b1e-b476-f20333d544ce admin admin] RBAC: Authorizing `identity:get_user(user_id=823fd54d00af495593a275a61c2223da)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:03.264090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ca3b2-7ee7-4b1e-b476-f20333d544ce admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:03.265610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Wed Jul 27 22:35:03 2022] GET /identity/v3/users/823fd54d00af495593a275a61c2223da => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:05.303289 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f03016-8176-409e-82f2-cd0c799c2c1a None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:05.303795 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f03016-8176-409e-82f2-cd0c799c2c1a None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:05.303876 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f03016-8176-409e-82f2-cd0c799c2c1a None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:05.305255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:05.306461 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4323e-9874-4ebd-b5ca-0f4744bb7375 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:05.306875 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4323e-9874-4ebd-b5ca-0f4744bb7375 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:05.307037 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f4323e-9874-4ebd-b5ca-0f4744bb7375 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:05.308855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:35:05.310625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df6a49-ceb3-494b-b86e-245c71c0bb40 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:05.310914 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df6a49-ceb3-494b-b86e-245c71c0bb40 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:05.311193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df6a49-ceb3-494b-b86e-245c71c0bb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:05.313846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13780bf3-2e64-44af-baaf-36496c7aa082 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:05.314137 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13780bf3-2e64-44af-baaf-36496c7aa082 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:05.314477 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13780bf3-2e64-44af-baaf-36496c7aa082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:05.334012 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-13780bf3-2e64-44af-baaf-36496c7aa082 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:05.335224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-13780bf3-2e64-44af-baaf-36496c7aa082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:05.354032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG passlib.handlers.bcrypt [None req-f3df6a49-ceb3-494b-b86e-245c71c0bb40 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86594) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 22:35:05.354504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG passlib.handlers.bcrypt [None req-f3df6a49-ceb3-494b-b86e-245c71c0bb40 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86594) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 22:35:05.400311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-f3df6a49-ceb3-494b-b86e-245c71c0bb40 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:05.401910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-f3df6a49-ceb3-494b-b86e-245c71c0bb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:05.413212 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 7/12] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:05.435815 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13780bf3-2e64-44af-baaf-36496c7aa082 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:05.459822 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:05.502311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 6/13] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:05.523116 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df6a49-ceb3-494b-b86e-245c71c0bb40 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:05.539646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13780bf3-2e64-44af-baaf-36496c7aa082 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:05.573052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64b0c8-1715-4051-b9cb-83b7facc1d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:05.573645 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64b0c8-1715-4051-b9cb-83b7facc1d0e None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:05.573932 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64b0c8-1715-4051-b9cb-83b7facc1d0e None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:05.574214 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b64b0c8-1715-4051-b9cb-83b7facc1d0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:05.585868 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b64b0c8-1715-4051-b9cb-83b7facc1d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:05.595133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-3b64b0c8-1715-4051-b9cb-83b7facc1d0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:35:05.595133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:05.595133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:05.595133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:05.595133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:05.595133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:05.595133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:05.595133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:05.595133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:05.595133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:05.595133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:05.595133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:05.595133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:05.595133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:05.595133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:05.595133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:05.596186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:05.596186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:05.596186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:05.596186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:05.596186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:05.596186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:05.596186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:05.596186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:05.596186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:05.596186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:05.596186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:05.596186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:05.596186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:05.596186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:05.596186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:05.596186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:05.597054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:05.597054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:05.597054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:05.597054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:05.597054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:05.597054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:05.597054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:05.597054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:05.597054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:05.597054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:05.597054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:35:05.597054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:05.597054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 8/14] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:35:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:35:05.602246 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64b0c8-1715-4051-b9cb-83b7facc1d0e None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:05.622651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df6a49-ceb3-494b-b86e-245c71c0bb40 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:05.624940 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:05.659848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f44615-171e-4185-946e-1c39d593e591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:05.660717 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f44615-171e-4185-946e-1c39d593e591 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:05.661014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f44615-171e-4185-946e-1c39d593e591 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:05.661294 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f44615-171e-4185-946e-1c39d593e591 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:05.681581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:05.700600 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b64b0c8-1715-4051-b9cb-83b7facc1d0e None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:05.727750 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f44615-171e-4185-946e-1c39d593e591 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:05.729795 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f44615-171e-4185-946e-1c39d593e591 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:05.733939 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1f4e5-b980-44ac-a94f-557227556578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:05.734595 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1f4e5-b980-44ac-a94f-557227556578 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:05.734883 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1f4e5-b980-44ac-a94f-557227556578 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:05.735162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1f4e5-b980-44ac-a94f-557227556578 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:05.735883 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b1f4e5-b980-44ac-a94f-557227556578 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:05.736189 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b1f4e5-b980-44ac-a94f-557227556578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:05.737568 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b1f4e5-b980-44ac-a94f-557227556578 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:05.749880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 9/15] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:05.755170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1f4e5-b980-44ac-a94f-557227556578 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:05.826367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 7/16] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 22:35:05.831754 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f44615-171e-4185-946e-1c39d593e591 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:05.834444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:05.856925 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1f4e5-b980-44ac-a94f-557227556578 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:05.938324 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f44615-171e-4185-946e-1c39d593e591 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:05.980255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b70d24-d86b-405c-82de-754187516b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:05.981116 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b70d24-d86b-405c-82de-754187516b7a None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:05.981401 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b70d24-d86b-405c-82de-754187516b7a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:05.981677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b70d24-d86b-405c-82de-754187516b7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:05.996285 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216aba38-a284-476e-a88e-063466729b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:05.996919 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216aba38-a284-476e-a88e-063466729b2f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:05.997203 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216aba38-a284-476e-a88e-063466729b2f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:05.997487 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216aba38-a284-476e-a88e-063466729b2f None admin] PATH_INFO: `/v3/users/823fd54d00af495593a275a61c2223da` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:05.998679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216aba38-a284-476e-a88e-063466729b2f None admin] RBAC: Authorizing `identity:get_user(user_id=823fd54d00af495593a275a61c2223da)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:05.999739 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b70d24-d86b-405c-82de-754187516b7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:06.000109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216aba38-a284-476e-a88e-063466729b2f None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:06.001181 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b70d24-d86b-405c-82de-754187516b7a None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:06.001685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 10/17] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:05 2022] GET /identity/v3/users/823fd54d00af495593a275a61c2223da => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:06.007111 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216aba38-a284-476e-a88e-063466729b2f None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:06.019552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-e1b70d24-d86b-405c-82de-754187516b7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:35:06.019552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:06.019552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:06.019552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:06.019552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:06.019552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:06.019552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:06.019552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:06.019552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:06.019552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:06.019552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:06.019552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:06.019552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:35:06.019552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:35:06.019552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:35:06.020419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:35:06.020419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:06.020419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:06.020419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:06.020419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:06.020419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:06.020419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:06.020419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:06.020419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:06.020419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:06.020419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:06.020419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:06.020419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:06.020419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:06.020419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:06.020419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:06.020419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:06.021234 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:35:06.021234 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:35:06.021234 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:35:06.021234 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:06.021234 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 8/18] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:35:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:35:06.021504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:06.027340 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b70d24-d86b-405c-82de-754187516b7a None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:06.082546 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:06.107368 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216aba38-a284-476e-a88e-063466729b2f None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:06.126438 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b70d24-d86b-405c-82de-754187516b7a None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:06.141693 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534557ce-4f08-445f-ab87-72abb014d2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:06.142372 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534557ce-4f08-445f-ab87-72abb014d2a7 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:06.142656 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534557ce-4f08-445f-ab87-72abb014d2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:06.142931 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534557ce-4f08-445f-ab87-72abb014d2a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:06.144423 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534557ce-4f08-445f-ab87-72abb014d2a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:06.145865 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534557ce-4f08-445f-ab87-72abb014d2a7 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:06.147553 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 11/19] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:35:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:06.156879 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534557ce-4f08-445f-ab87-72abb014d2a7 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:06.166585 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdef4850-abb6-4613-9735-bcc7bdfb5384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:06.167834 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef4850-abb6-4613-9735-bcc7bdfb5384 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:06.168118 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef4850-abb6-4613-9735-bcc7bdfb5384 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:06.168398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdef4850-abb6-4613-9735-bcc7bdfb5384 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:06.169102 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef4850-abb6-4613-9735-bcc7bdfb5384 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:06.169413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef4850-abb6-4613-9735-bcc7bdfb5384 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:06.170855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdef4850-abb6-4613-9735-bcc7bdfb5384 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:06.188469 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 9/20] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:06.254632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:06.275915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534557ce-4f08-445f-ab87-72abb014d2a7 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:06.310650 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb83dcd-33d1-4f7b-9c76-5777e476d58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:06.311308 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb83dcd-33d1-4f7b-9c76-5777e476d58d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:06.311551 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb83dcd-33d1-4f7b-9c76-5777e476d58d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:06.311829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb83dcd-33d1-4f7b-9c76-5777e476d58d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:06.312626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb83dcd-33d1-4f7b-9c76-5777e476d58d None admin] RBAC: Adding query filter params (role.id=49e0ba8d8c9f4824892b61f05d0036e8, scope.domain.id=default, user.id=823fd54d00af495593a275a61c2223da) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:06.312939 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb83dcd-33d1-4f7b-9c76-5777e476d58d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:06.314421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb83dcd-33d1-4f7b-9c76-5777e476d58d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:06.321723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 12/21] 10.222.0.48 () {56 vars in 1322 bytes} [Wed Jul 27 22:35:06 2022] GET /identity/v3/role_assignments?user.id=823fd54d00af495593a275a61c2223da&scope.domain.id=default&role.id=49e0ba8d8c9f4824892b61f05d0036e8 => generated 233 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:08.583544 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d269c-a710-4ba6-bf8a-61c580ae3bd7 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:08.584557 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d269c-a710-4ba6-bf8a-61c580ae3bd7 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:08.585057 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d269c-a710-4ba6-bf8a-61c580ae3bd7 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:08.586682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 10/22] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:08.592628 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b0047-21e2-4b08-8a61-cc8416e5e2d3 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:08.593448 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b0047-21e2-4b08-8a61-cc8416e5e2d3 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:08.593929 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b0047-21e2-4b08-8a61-cc8416e5e2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:08.614405 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-b79b0047-21e2-4b08-8a61-cc8416e5e2d3 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:08.615907 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-b79b0047-21e2-4b08-8a61-cc8416e5e2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:08.640498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125d89c-d784-44c1-94f3-6b30be0bd541 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:08.641123 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125d89c-d784-44c1-94f3-6b30be0bd541 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:08.641601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c125d89c-d784-44c1-94f3-6b30be0bd541 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:08.643253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 11/23] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:35:08.648968 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a32f3-5154-44ac-a34c-5215dc8a70af None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:08.649555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a32f3-5154-44ac-a34c-5215dc8a70af None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:08.650033 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a32f3-5154-44ac-a34c-5215dc8a70af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:08.678725 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-bf0a32f3-5154-44ac-a34c-5215dc8a70af None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:08.680621 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-bf0a32f3-5154-44ac-a34c-5215dc8a70af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:08.737378 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 13/24] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:08.739010 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92c883-05cd-46d0-9977-196635be9646 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:08.739504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92c883-05cd-46d0-9977-196635be9646 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:08.740002 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af92c883-05cd-46d0-9977-196635be9646 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:08.746710 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 14/25] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:08.759334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c433c-b409-403e-be51-57085929fd71 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:08.759894 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c433c-b409-403e-be51-57085929fd71 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:08.760900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c433c-b409-403e-be51-57085929fd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:08.785143 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-b31c433c-b409-403e-be51-57085929fd71 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:08.786861 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-b31c433c-b409-403e-be51-57085929fd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:08.788711 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 12/26] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:08.789735 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a32f3-5154-44ac-a34c-5215dc8a70af None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:08.856533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 15/27] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:08.871314 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c433c-b409-403e-be51-57085929fd71 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:08.882671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:08.910714 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:08.988318 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a32f3-5154-44ac-a34c-5215dc8a70af None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:09.053809 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31c433c-b409-403e-be51-57085929fd71 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:09.058359 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d8aff-cca4-4e8a-a1af-cd0ad38265b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:09.059023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d8aff-cca4-4e8a-a1af-cd0ad38265b2 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:09.059310 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d8aff-cca4-4e8a-a1af-cd0ad38265b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:09.059589 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573d8aff-cca4-4e8a-a1af-cd0ad38265b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:09.086040 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573d8aff-cca4-4e8a-a1af-cd0ad38265b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:09.092452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-573d8aff-cca4-4e8a-a1af-cd0ad38265b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:35:09.092452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:09.092452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:09.092452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:09.092452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:09.092452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:09.092452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:09.092452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:09.092452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:09.092452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:09.092452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:09.092452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:09.092452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:09.092452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:09.092452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:09.092452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:09.093315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:09.093315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:09.093315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:09.093315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:09.093315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:09.093315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:09.093315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:09.093315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:09.093315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:09.093315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:09.093315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:09.093315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:09.093315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:09.093315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:09.093315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:09.093315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:09.094067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:09.094067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:09.094067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:09.094067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:09.094067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:09.094067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:09.094067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:09.094067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:09.094067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:09.094067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:09.094067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:35:09.094067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:09.094067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 13/28] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:35:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:09.094753 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d8aff-cca4-4e8a-a1af-cd0ad38265b2 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:09.129509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d67c19-ab24-46d5-baaa-b5fe0b035ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:09.130133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d67c19-ab24-46d5-baaa-b5fe0b035ba1 None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:09.130452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d67c19-ab24-46d5-baaa-b5fe0b035ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:09.130736 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d67c19-ab24-46d5-baaa-b5fe0b035ba1 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:09.131483 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d67c19-ab24-46d5-baaa-b5fe0b035ba1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:09.132940 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d67c19-ab24-46d5-baaa-b5fe0b035ba1 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:09.292353 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 16/29] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Jul 27 22:35:08 2022] POST /identity/v3/roles => generated 219 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:35:09.293349 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d67c19-ab24-46d5-baaa-b5fe0b035ba1 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:09.345296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573d8aff-cca4-4e8a-a1af-cd0ad38265b2 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:09.370947 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:09.413687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d67c19-ab24-46d5-baaa-b5fe0b035ba1 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:09.455857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c40ff9-29cd-474e-b1e5-60631ab74167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:09.456508 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40ff9-29cd-474e-b1e5-60631ab74167 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:09.456806 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40ff9-29cd-474e-b1e5-60631ab74167 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:09.457094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40ff9-29cd-474e-b1e5-60631ab74167 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:09.457843 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c40ff9-29cd-474e-b1e5-60631ab74167 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:09.458159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c40ff9-29cd-474e-b1e5-60631ab74167 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:09.459995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c40ff9-29cd-474e-b1e5-60631ab74167 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:09.470184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 17/30] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:09.471899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d300d-8327-4d23-be12-11a8a2d57e0c None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:09.472405 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d300d-8327-4d23-be12-11a8a2d57e0c None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:09.472879 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67d300d-8327-4d23-be12-11a8a2d57e0c None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:09.474944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 18/31] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:09.475680 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d300d-8327-4d23-be12-11a8a2d57e0c None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:09.487423 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:09.548379 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd90517-1325-48cc-9657-1e8d69828a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:09.549450 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd90517-1325-48cc-9657-1e8d69828a3c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:09.551096 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd90517-1325-48cc-9657-1e8d69828a3c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:09.551609 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd90517-1325-48cc-9657-1e8d69828a3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:09.572547 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd90517-1325-48cc-9657-1e8d69828a3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:09.574400 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd90517-1325-48cc-9657-1e8d69828a3c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:09.594627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-3dd90517-1325-48cc-9657-1e8d69828a3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:35:09.594627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:09.594627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:09.594627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:09.594627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:09.594627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:09.594627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:09.594627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:09.594627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:09.594627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:09.594627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:09.594627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:09.594627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:35:09.594627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:35:09.594627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:35:09.595975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:35:09.595975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:09.595975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:09.595975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:09.595975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:09.595975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:09.595975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:09.595975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:09.595975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:09.595975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:09.595975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:09.595975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:09.595975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:09.595975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:09.595975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:09.595975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:09.595975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:09.596772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:35:09.596772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:35:09.596772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:35:09.596772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:09.596772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 14/32] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:35:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 502 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:09.597715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7aa8b-c159-40e5-a30f-0e8c697c361d None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:09.598873 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7aa8b-c159-40e5-a30f-0e8c697c361d None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:09.598873 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7aa8b-c159-40e5-a30f-0e8c697c361d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:09.624118 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-88e7aa8b-c159-40e5-a30f-0e8c697c361d None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:09.626488 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-88e7aa8b-c159-40e5-a30f-0e8c697c361d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:09.663389 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67d300d-8327-4d23-be12-11a8a2d57e0c None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:09.697172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:09.709090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718184c-b683-4277-b8bd-ef13d1da6631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:09.709752 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718184c-b683-4277-b8bd-ef13d1da6631 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:09.710091 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718184c-b683-4277-b8bd-ef13d1da6631 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:09.710436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718184c-b683-4277-b8bd-ef13d1da6631 None admin] PATH_INFO: `/v3/users/823fd54d00af495593a275a61c2223da` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:09.711786 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718184c-b683-4277-b8bd-ef13d1da6631 None admin] RBAC: Authorizing `identity:get_user(user_id=823fd54d00af495593a275a61c2223da)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:09.713362 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718184c-b683-4277-b8bd-ef13d1da6631 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:09.716374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 19/33] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:09 2022] GET /identity/v3/users/823fd54d00af495593a275a61c2223da => generated 247 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:09.717155 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718184c-b683-4277-b8bd-ef13d1da6631 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:09.717984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 15/34] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:09.722830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7aa8b-c159-40e5-a30f-0e8c697c361d None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:09.835232 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718184c-b683-4277-b8bd-ef13d1da6631 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:09.836204 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:09.851147 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7aa8b-c159-40e5-a30f-0e8c697c361d None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:09.873371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad2f61-0627-49b4-97e6-5ae9b47009a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:09.873999 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad2f61-0627-49b4-97e6-5ae9b47009a6 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:09.874289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad2f61-0627-49b4-97e6-5ae9b47009a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:09.874596 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ad2f61-0627-49b4-97e6-5ae9b47009a6 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:09.875295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad2f61-0627-49b4-97e6-5ae9b47009a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:09.875610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad2f61-0627-49b4-97e6-5ae9b47009a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:09.877004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ad2f61-0627-49b4-97e6-5ae9b47009a6 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:09.890950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7c886-d765-4214-8fbc-169d394df20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:09.891709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7c886-d765-4214-8fbc-169d394df20b None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:09.892002 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7c886-d765-4214-8fbc-169d394df20b None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:09.892278 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7c886-d765-4214-8fbc-169d394df20b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:09.893728 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7c886-d765-4214-8fbc-169d394df20b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:09.899402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 20/35] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:09.899551 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7c886-d765-4214-8fbc-169d394df20b None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:09.899635 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad2f61-0627-49b4-97e6-5ae9b47009a6 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:09.899704 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 16/36] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:35:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:09.899704 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273d792-7f39-4730-acb4-80f73ef5c5ae None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:09.899704 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273d792-7f39-4730-acb4-80f73ef5c5ae None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:09.899704 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a273d792-7f39-4730-acb4-80f73ef5c5ae None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:09.899704 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 17/37] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:09.905829 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273d792-7f39-4730-acb4-80f73ef5c5ae None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:09.959134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:10.011772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ad2f61-0627-49b4-97e6-5ae9b47009a6 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:10.028146 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a273d792-7f39-4730-acb4-80f73ef5c5ae None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:10.047215 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab253173-46db-4e5b-9387-b71ed5f51d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:10.047844 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab253173-46db-4e5b-9387-b71ed5f51d3c None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:10.048134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab253173-46db-4e5b-9387-b71ed5f51d3c None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:10.048414 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab253173-46db-4e5b-9387-b71ed5f51d3c None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:10.049128 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab253173-46db-4e5b-9387-b71ed5f51d3c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:10.050554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab253173-46db-4e5b-9387-b71ed5f51d3c None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:10.066137 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 21/38] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Jul 27 22:35:09 2022] POST /identity/v3/roles => generated 225 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:35:10.066566 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6462e080-abb3-4d2b-b6f4-47da044da129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:10.067203 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462e080-abb3-4d2b-b6f4-47da044da129 None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:10.067492 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462e080-abb3-4d2b-b6f4-47da044da129 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:10.067771 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6462e080-abb3-4d2b-b6f4-47da044da129 None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:10.068127 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab253173-46db-4e5b-9387-b71ed5f51d3c None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:10.068513 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462e080-abb3-4d2b-b6f4-47da044da129 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:10.070001 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6462e080-abb3-4d2b-b6f4-47da044da129 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:10.189234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab253173-46db-4e5b-9387-b71ed5f51d3c None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:10.210284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:10.226696 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 18/39] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 22:35:09 2022] POST /identity/v3/projects => generated 301 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:35:10.229103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd8a8c-046d-424d-b7d2-9caa51ec45d9 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:10.229408 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd8a8c-046d-424d-b7d2-9caa51ec45d9 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:10.229865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cd8a8c-046d-424d-b7d2-9caa51ec45d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:10.240929 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ef1c5-4893-48f5-a5b6-9c45832e6e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:10.240929 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ef1c5-4893-48f5-a5b6-9c45832e6e9a None admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:10.241198 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ef1c5-4893-48f5-a5b6-9c45832e6e9a None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:10.241448 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ef1c5-4893-48f5-a5b6-9c45832e6e9a None admin] PATH_INFO: `/v3/domains/default/users/823fd54d00af495593a275a61c2223da/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:10.243781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ef1c5-4893-48f5-a5b6-9c45832e6e9a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=823fd54d00af495593a275a61c2223da, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:10.246254 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ef1c5-4893-48f5-a5b6-9c45832e6e9a None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:10.253051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-44cd8a8c-046d-424d-b7d2-9caa51ec45d9 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:10.255020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-44cd8a8c-046d-424d-b7d2-9caa51ec45d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:10.257974 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:10.270783 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 22/40] 10.222.0.48 () {58 vars in 1361 bytes} [Wed Jul 27 22:35:10 2022] PUT /identity/v3/domains/default/users/823fd54d00af495593a275a61c2223da/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:35:10.272811 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426062f-b988-4675-9bd3-9685ecb4ea5d None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:10.273304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426062f-b988-4675-9bd3-9685ecb4ea5d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:10.274079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426062f-b988-4675-9bd3-9685ecb4ea5d None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:10.276776 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 23/41] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:10.283685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e1b6d-8073-4107-8129-f74a6c0de683 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:10.284562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e1b6d-8073-4107-8129-f74a6c0de683 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:10.285041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e1b6d-8073-4107-8129-f74a6c0de683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:10.316000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-729e1b6d-8073-4107-8129-f74a6c0de683 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:10.318010 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-729e1b6d-8073-4107-8129-f74a6c0de683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:10.379989 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 19/42] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:10.405457 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd8a8c-046d-424d-b7d2-9caa51ec45d9 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:10.435733 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 24/43] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:10.460548 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e1b6d-8073-4107-8129-f74a6c0de683 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:10.542047 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cd8a8c-046d-424d-b7d2-9caa51ec45d9 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:10.577319 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7737e-8355-422d-8a74-0f540df29065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:10.577642 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e1b6d-8073-4107-8129-f74a6c0de683 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:10.577956 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7737e-8355-422d-8a74-0f540df29065 None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:10.578244 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7737e-8355-422d-8a74-0f540df29065 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:10.578546 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7737e-8355-422d-8a74-0f540df29065 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:10.579280 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7737e-8355-422d-8a74-0f540df29065 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:10.580677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:10.580974 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7737e-8355-422d-8a74-0f540df29065 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:10.592306 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:10.606541 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 20/44] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Jul 27 22:35:10 2022] POST /identity/v3/roles => generated 223 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:35:10.619541 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116778b-0bb4-409a-ad29-b69159f816b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:10.620704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116778b-0bb4-409a-ad29-b69159f816b3 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:10.620988 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116778b-0bb4-409a-ad29-b69159f816b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:10.621265 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116778b-0bb4-409a-ad29-b69159f816b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:10.622546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116778b-0bb4-409a-ad29-b69159f816b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:10.624043 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116778b-0bb4-409a-ad29-b69159f816b3 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:10.625945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 25/45] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:35:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:10.631538 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7737e-8355-422d-8a74-0f540df29065 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:10.742392 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7737e-8355-422d-8a74-0f540df29065 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:10.779911 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1771a4e5-1a7c-4548-94cf-4af031e4ab29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:10.780552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771a4e5-1a7c-4548-94cf-4af031e4ab29 None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:10.780846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771a4e5-1a7c-4548-94cf-4af031e4ab29 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:10.781130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1771a4e5-1a7c-4548-94cf-4af031e4ab29 None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:10.781833 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771a4e5-1a7c-4548-94cf-4af031e4ab29 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:10.783359 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1771a4e5-1a7c-4548-94cf-4af031e4ab29 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:10.813945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 21/46] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 22:35:10 2022] POST /identity/v3/projects => generated 312 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:35:12.299745 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a445d-e72f-4d81-89f7-ccc03560e969 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:12.300281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a445d-e72f-4d81-89f7-ccc03560e969 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:12.300281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a445d-e72f-4d81-89f7-ccc03560e969 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:12.301644 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 26/47] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:12.306916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c60b08-f9e5-4114-8a7a-05bb24541ce8 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:12.307285 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c60b08-f9e5-4114-8a7a-05bb24541ce8 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:12.307638 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c60b08-f9e5-4114-8a7a-05bb24541ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:12.328528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-d4c60b08-f9e5-4114-8a7a-05bb24541ce8 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:12.329722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d4c60b08-f9e5-4114-8a7a-05bb24541ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:12.375468 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:12.397193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 22/48] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:12.420369 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a445d-e72f-4d81-89f7-ccc03560e969 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:12.524505 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a445d-e72f-4d81-89f7-ccc03560e969 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:12.558930 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41b318-73ab-4364-bafd-c2cb832b4f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:12.559501 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41b318-73ab-4364-bafd-c2cb832b4f6a None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:12.559788 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41b318-73ab-4364-bafd-c2cb832b4f6a None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:12.560067 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41b318-73ab-4364-bafd-c2cb832b4f6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:12.569913 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41b318-73ab-4364-bafd-c2cb832b4f6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:12.575493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-cd41b318-73ab-4364-bafd-c2cb832b4f6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:35:12.575493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:12.575493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:12.575493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:12.575493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:12.575493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:12.575493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:12.575493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:12.575493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:12.575493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:12.575493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:12.575493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:12.575493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:12.575493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:12.575493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:12.575493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:12.576646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:12.576646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:12.576646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:12.576646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:12.576646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:12.576646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:12.576646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:12.576646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:12.576646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:12.576646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:12.576646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:12.576646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:12.576646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:12.576646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:12.576646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:12.576646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:12.577616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:12.577616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:12.577616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:12.577616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:12.577616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:12.577616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:12.577616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:12.577616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:12.577616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:12.577616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:12.577616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:35:12.577616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:12.577616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 27/49] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:35:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:12.582732 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c60b08-f9e5-4114-8a7a-05bb24541ce8 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:12.679050 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c60b08-f9e5-4114-8a7a-05bb24541ce8 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:12.713754 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7511bd-05d0-445d-95ab-fe7cd84c6ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:12.714408 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7511bd-05d0-445d-95ab-fe7cd84c6ed4 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:12.714700 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7511bd-05d0-445d-95ab-fe7cd84c6ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:12.714981 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7511bd-05d0-445d-95ab-fe7cd84c6ed4 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:12.715692 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7511bd-05d0-445d-95ab-fe7cd84c6ed4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:12.716000 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7511bd-05d0-445d-95ab-fe7cd84c6ed4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:12.717380 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7511bd-05d0-445d-95ab-fe7cd84c6ed4 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:12.728462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 23/50] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:12.734057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41b318-73ab-4364-bafd-c2cb832b4f6a None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:12.765359 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:12.833665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41b318-73ab-4364-bafd-c2cb832b4f6a None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:12.835067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b39a8-e198-49c9-867d-4d99ee539b7c None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:12.835368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b39a8-e198-49c9-867d-4d99ee539b7c None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:12.835655 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b39a8-e198-49c9-867d-4d99ee539b7c None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:12.837190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 24/51] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:12.842180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc2689-5130-4710-b144-94a72393df4c None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:12.842523 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc2689-5130-4710-b144-94a72393df4c None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:12.842810 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcc2689-5130-4710-b144-94a72393df4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:12.861541 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-5dcc2689-5130-4710-b144-94a72393df4c None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:12.862798 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-5dcc2689-5130-4710-b144-94a72393df4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:12.875374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba88318-de40-4db1-b1ee-cdd5a00e3666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:12.876030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba88318-de40-4db1-b1ee-cdd5a00e3666 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:12.876322 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba88318-de40-4db1-b1ee-cdd5a00e3666 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:12.876610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba88318-de40-4db1-b1ee-cdd5a00e3666 None admin] PATH_INFO: `/v3/users/823fd54d00af495593a275a61c2223da` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:12.877803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba88318-de40-4db1-b1ee-cdd5a00e3666 None admin] RBAC: Authorizing `identity:get_user(user_id=823fd54d00af495593a275a61c2223da)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:12.879286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba88318-de40-4db1-b1ee-cdd5a00e3666 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:12.880890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 28/52] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:12 2022] GET /identity/v3/users/823fd54d00af495593a275a61c2223da => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:12.887178 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba88318-de40-4db1-b1ee-cdd5a00e3666 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:12.899063 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:12.930628 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 25/53] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:12.953989 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc2689-5130-4710-b144-94a72393df4c None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:12.981468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:12.984625 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba88318-de40-4db1-b1ee-cdd5a00e3666 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:13.018680 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331ab5a-b830-434e-a10d-a0ef8797d8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:13.019497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331ab5a-b830-434e-a10d-a0ef8797d8c1 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:13.019934 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331ab5a-b830-434e-a10d-a0ef8797d8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:13.020218 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331ab5a-b830-434e-a10d-a0ef8797d8c1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:13.021376 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331ab5a-b830-434e-a10d-a0ef8797d8c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:13.022854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6331ab5a-b830-434e-a10d-a0ef8797d8c1 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:13.024425 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 29/54] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:35:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:13.029986 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331ab5a-b830-434e-a10d-a0ef8797d8c1 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:13.052622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcc2689-5130-4710-b144-94a72393df4c None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:13.086267 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc22a9-18b6-44af-8786-af4c243a1d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:13.086880 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc22a9-18b6-44af-8786-af4c243a1d50 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:13.087168 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc22a9-18b6-44af-8786-af4c243a1d50 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:13.087449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc22a9-18b6-44af-8786-af4c243a1d50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:13.088602 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc22a9-18b6-44af-8786-af4c243a1d50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:13.090031 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc22a9-18b6-44af-8786-af4c243a1d50 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:13.091642 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 26/55] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:35:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:13.097012 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc22a9-18b6-44af-8786-af4c243a1d50 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:13.126962 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331ab5a-b830-434e-a10d-a0ef8797d8c1 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:13.137935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:13.160422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181e0fa-2842-422e-ab92-62305a572408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:13.161054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181e0fa-2842-422e-ab92-62305a572408 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:13.161342 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181e0fa-2842-422e-ab92-62305a572408 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:13.161620 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181e0fa-2842-422e-ab92-62305a572408 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:13.162451 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181e0fa-2842-422e-ab92-62305a572408 None admin] RBAC: Adding query filter params (role.id=49e0ba8d8c9f4824892b61f05d0036e8, scope.domain.id=default, user.id=823fd54d00af495593a275a61c2223da) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:13.162769 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181e0fa-2842-422e-ab92-62305a572408 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:13.164210 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181e0fa-2842-422e-ab92-62305a572408 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:13.170469 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 30/56] 10.222.0.48 () {56 vars in 1322 bytes} [Wed Jul 27 22:35:13 2022] GET /identity/v3/role_assignments?user.id=823fd54d00af495593a275a61c2223da&scope.domain.id=default&role.id=49e0ba8d8c9f4824892b61f05d0036e8 => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:13.202404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc22a9-18b6-44af-8786-af4c243a1d50 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:13.240574 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57111298-4560-43a3-ad05-94d248707b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:13.241228 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57111298-4560-43a3-ad05-94d248707b79 None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:13.241520 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57111298-4560-43a3-ad05-94d248707b79 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:13.241806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57111298-4560-43a3-ad05-94d248707b79 None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:13.242551 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57111298-4560-43a3-ad05-94d248707b79 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:13.244061 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57111298-4560-43a3-ad05-94d248707b79 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:13.273390 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 27/57] 10.222.0.48 () {60 vars in 1140 bytes} [Wed Jul 27 22:35:13 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:35:15.309233 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507c613-e8d6-4877-8539-33ceab31c46b None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:15.309762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507c613-e8d6-4877-8539-33ceab31c46b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:15.309762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507c613-e8d6-4877-8539-33ceab31c46b None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:15.311170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 31/58] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:15.316191 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385d575-913c-4cf1-a93e-3f5e385342d2 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:15.316610 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385d575-913c-4cf1-a93e-3f5e385342d2 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:15.316762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385d575-913c-4cf1-a93e-3f5e385342d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:15.335265 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-f385d575-913c-4cf1-a93e-3f5e385342d2 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:15.336443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-f385d575-913c-4cf1-a93e-3f5e385342d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:15.399977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 28/59] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:15.424060 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507c613-e8d6-4877-8539-33ceab31c46b None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:15.454655 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:15.522057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507c613-e8d6-4877-8539-33ceab31c46b None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:15.554046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88988d-1b5c-4c3a-96b6-bd189fc9eaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:15.554700 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88988d-1b5c-4c3a-96b6-bd189fc9eaa5 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:15.554987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88988d-1b5c-4c3a-96b6-bd189fc9eaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:15.555264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88988d-1b5c-4c3a-96b6-bd189fc9eaa5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:15.556400 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88988d-1b5c-4c3a-96b6-bd189fc9eaa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:15.557855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88988d-1b5c-4c3a-96b6-bd189fc9eaa5 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:15.559499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 32/60] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:35:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:15.564911 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385d575-913c-4cf1-a93e-3f5e385342d2 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:15.589313 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:15.662785 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385d575-913c-4cf1-a93e-3f5e385342d2 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:15.695110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740fba8c-db7b-4e75-a886-83a1d42299e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:15.695737 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fba8c-db7b-4e75-a886-83a1d42299e5 None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:15.696015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fba8c-db7b-4e75-a886-83a1d42299e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:15.696288 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740fba8c-db7b-4e75-a886-83a1d42299e5 None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:15.696974 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fba8c-db7b-4e75-a886-83a1d42299e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:15.699045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740fba8c-db7b-4e75-a886-83a1d42299e5 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:15.724125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 29/61] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 22:35:15 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:35:18.675051 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e6c9e-5ea5-4584-9a78-9ea2bd969b98 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:18.676036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e6c9e-5ea5-4584-9a78-9ea2bd969b98 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:18.676539 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e6c9e-5ea5-4584-9a78-9ea2bd969b98 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:18.678103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 33/62] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:18.683777 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535cccd-e554-4e55-9c83-ef5bf73c6201 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:18.684573 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535cccd-e554-4e55-9c83-ef5bf73c6201 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:18.685074 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0535cccd-e554-4e55-9c83-ef5bf73c6201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:18.711678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-0535cccd-e554-4e55-9c83-ef5bf73c6201 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:18.713317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-0535cccd-e554-4e55-9c83-ef5bf73c6201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:18.795998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 30/63] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:18.840843 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e6c9e-5ea5-4584-9a78-9ea2bd969b98 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:18.880604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc899-099f-49cc-982f-d69815827054 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:18.881211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc899-099f-49cc-982f-d69815827054 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:18.881710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc899-099f-49cc-982f-d69815827054 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:18.883293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 31/64] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:35:18.890199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b1460-8b6b-40c7-ad1c-8d0d88345634 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:18.890741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b1460-8b6b-40c7-ad1c-8d0d88345634 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:18.891241 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b1460-8b6b-40c7-ad1c-8d0d88345634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:18.919754 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-4a1b1460-8b6b-40c7-ad1c-8d0d88345634 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:18.921189 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-4a1b1460-8b6b-40c7-ad1c-8d0d88345634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:18.930364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:18.971167 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:18.976594 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e6c9e-5ea5-4584-9a78-9ea2bd969b98 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:19.045106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf0ea7-7189-4546-a6a3-eae96bba7b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:19.045779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf0ea7-7189-4546-a6a3-eae96bba7b44 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:19.046069 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf0ea7-7189-4546-a6a3-eae96bba7b44 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:19.046368 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf0ea7-7189-4546-a6a3-eae96bba7b44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:19.071073 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 32/65] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:19.071459 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf0ea7-7189-4546-a6a3-eae96bba7b44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:19.081396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-7baf0ea7-7189-4546-a6a3-eae96bba7b44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:19.081396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:19.081396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:19.081396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:19.081396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:19.081396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:19.081396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:19.081396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:19.081396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:19.081396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:19.081396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:19.081396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:19.081396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:19.081396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:19.081396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:19.081396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:19.082267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:19.082267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:19.082267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:19.082267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:19.082267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:19.082267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:19.082267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:19.082267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:19.082267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:19.082267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:19.082267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:19.082267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:19.082267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:19.082267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:19.082267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:19.082267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:19.083148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:19.083148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:19.083148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:19.083148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:19.083148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:19.083148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:19.083148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:19.083148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:19.083148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:19.083148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:19.083148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:19.083148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:19.083148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 34/66] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:19.088376 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b1460-8b6b-40c7-ad1c-8d0d88345634 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:19.136590 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf0ea7-7189-4546-a6a3-eae96bba7b44 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:19.225789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b1460-8b6b-40c7-ad1c-8d0d88345634 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:19.264858 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c3cd5-f0c6-46a6-8993-975d54bde4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:19.265865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c3cd5-f0c6-46a6-8993-975d54bde4d8 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:19.266424 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c3cd5-f0c6-46a6-8993-975d54bde4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:19.266897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c3cd5-f0c6-46a6-8993-975d54bde4d8 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:19.267774 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c3cd5-f0c6-46a6-8993-975d54bde4d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:19.268224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c3cd5-f0c6-46a6-8993-975d54bde4d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:19.270017 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059c3cd5-f0c6-46a6-8993-975d54bde4d8 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:19.276200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:19.276952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf0ea7-7189-4546-a6a3-eae96bba7b44 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:19.280242 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 33/67] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:19.281653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0d507-fd90-4056-8745-6865c6a7c6e3 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:19.282097 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0d507-fd90-4056-8745-6865c6a7c6e3 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:19.282843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0d507-fd90-4056-8745-6865c6a7c6e3 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:19.288481 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 34/68] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:19.289479 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0d507-fd90-4056-8745-6865c6a7c6e3 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:19.314226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb467c7-de78-4266-baac-c59d14df9bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:19.315232 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb467c7-de78-4266-baac-c59d14df9bd0 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:19.315717 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb467c7-de78-4266-baac-c59d14df9bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:19.316173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb467c7-de78-4266-baac-c59d14df9bd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:19.328786 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb467c7-de78-4266-baac-c59d14df9bd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:19.334100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-7bb467c7-de78-4266-baac-c59d14df9bd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:35:19.334100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:19.334100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:19.334100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:19.334100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:19.334100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:19.334100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:19.334100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:19.334100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:19.334100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:19.334100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:19.334100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:19.334100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:19.334100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:19.334100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:19.334100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:19.335191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:19.335191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:19.335191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:19.335191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:19.335191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:19.335191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:19.335191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:19.335191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:19.335191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:19.335191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:19.335191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:19.335191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:19.335191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:19.335191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:19.335191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:19.335191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:19.335963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:19.335963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:19.335963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:19.335963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:19.335963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:19.335963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:19.335963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:19.335963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:19.335963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:19.335963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:19.335963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:35:19.335963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:19.338682 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 35/69] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:35:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:35:19.340010 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f93747-39f6-4d83-bd12-081f826d50cf None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:19.340437 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f93747-39f6-4d83-bd12-081f826d50cf None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:19.340866 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f93747-39f6-4d83-bd12-081f826d50cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:19.359797 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-d6f93747-39f6-4d83-bd12-081f826d50cf None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:19.361211 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d6f93747-39f6-4d83-bd12-081f826d50cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:19.376306 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:19.411445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0d507-fd90-4056-8745-6865c6a7c6e3 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:19.436040 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 36/70] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:19.436898 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f93747-39f6-4d83-bd12-081f826d50cf None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:19.453633 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b92589e-c748-4fb1-a4cf-edf2906358f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:19.454718 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92589e-c748-4fb1-a4cf-edf2906358f9 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:19.455205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92589e-c748-4fb1-a4cf-edf2906358f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:19.455708 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92589e-c748-4fb1-a4cf-edf2906358f9 None admin] PATH_INFO: `/v3/users/427c46ab26884620ba19e763d2a97b83` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:19.473386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92589e-c748-4fb1-a4cf-edf2906358f9 None admin] RBAC: Authorizing `identity:get_user(user_id=427c46ab26884620ba19e763d2a97b83)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:19.474940 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b92589e-c748-4fb1-a4cf-edf2906358f9 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:19.476648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:19 2022] GET /identity/v3/users/427c46ab26884620ba19e763d2a97b83 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:19.481360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bc95a-c941-4b9b-8539-1d011d298a1a None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:19.481360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bc95a-c941-4b9b-8539-1d011d298a1a None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:19.481360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719bc95a-c941-4b9b-8539-1d011d298a1a None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:19.481360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 36/72] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:19.481360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719bc95a-c941-4b9b-8539-1d011d298a1a None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:19.540862 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:19.554448 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f93747-39f6-4d83-bd12-081f826d50cf None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:19.584699 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719bc95a-c941-4b9b-8539-1d011d298a1a None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:19.589446 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c7f84-792c-4df9-9921-54415e628a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:19.590076 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c7f84-792c-4df9-9921-54415e628a3d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:19.590777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c7f84-792c-4df9-9921-54415e628a3d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:19.590777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c7f84-792c-4df9-9921-54415e628a3d None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:19.592056 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c7f84-792c-4df9-9921-54415e628a3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:19.592056 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c7f84-792c-4df9-9921-54415e628a3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:19.593497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c7f84-792c-4df9-9921-54415e628a3d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:19.603613 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 37/73] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:19.605079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c7f84-792c-4df9-9921-54415e628a3d None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:19.619792 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:19.621154 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f4abf-6b22-4c2a-b3d9-0454de6c11c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:19.621956 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f4abf-6b22-4c2a-b3d9-0454de6c11c5 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:19.622260 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f4abf-6b22-4c2a-b3d9-0454de6c11c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:19.622592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f4abf-6b22-4c2a-b3d9-0454de6c11c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:19.632967 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f4abf-6b22-4c2a-b3d9-0454de6c11c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:19.637998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-631f4abf-6b22-4c2a-b3d9-0454de6c11c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:35:19.637998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:19.637998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:19.637998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:19.637998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:19.637998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:19.637998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:19.637998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:19.637998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:19.637998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:19.637998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:19.637998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:19.637998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:19.637998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:19.637998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:19.637998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:19.638924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:19.638924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:19.638924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:19.638924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:19.638924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:19.638924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:19.638924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:19.638924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:19.638924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:19.638924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:19.638924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:19.638924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:19.638924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:19.638924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:19.638924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:19.638924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:19.639680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:19.639680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:19.639680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:19.639680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:19.639680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:19.639680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:19.639680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:19.639680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:19.639680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:19.639680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:19.639680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:35:19.639680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:19.639680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 37/74] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:35:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:19.640316 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979336b3-3d84-428a-a337-049e78b730a4 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:19.640612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979336b3-3d84-428a-a337-049e78b730a4 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:19.640874 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979336b3-3d84-428a-a337-049e78b730a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:19.659762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-979336b3-3d84-428a-a337-049e78b730a4 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:19.660947 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-979336b3-3d84-428a-a337-049e78b730a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:19.708938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c7f84-792c-4df9-9921-54415e628a3d None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:19.725554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 38/75] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:19.726965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389aa9ea-6bee-49e9-b702-66564011fb4c None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:19.727255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389aa9ea-6bee-49e9-b702-66564011fb4c None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:19.727531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389aa9ea-6bee-49e9-b702-66564011fb4c None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:19.733355 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 39/76] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:19.733355 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389aa9ea-6bee-49e9-b702-66564011fb4c None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:19.752840 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f25d08-9dcd-40a0-845c-40f37d5eeccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:19.753472 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f25d08-9dcd-40a0-845c-40f37d5eeccf None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:19.753763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f25d08-9dcd-40a0-845c-40f37d5eeccf None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:19.754044 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f25d08-9dcd-40a0-845c-40f37d5eeccf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:19.779464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:19.825629 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f25d08-9dcd-40a0-845c-40f37d5eeccf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:19.827382 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f25d08-9dcd-40a0-845c-40f37d5eeccf None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:19.836313 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389aa9ea-6bee-49e9-b702-66564011fb4c None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:19.841504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:19.870588 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17f1c3-9517-4dc4-8d37-65da2ea67ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:19.871231 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17f1c3-9517-4dc4-8d37-65da2ea67ff1 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:19.871528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17f1c3-9517-4dc4-8d37-65da2ea67ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:19.871807 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17f1c3-9517-4dc4-8d37-65da2ea67ff1 None admin] PATH_INFO: `/v3/users/823fd54d00af495593a275a61c2223da` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:19.872974 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17f1c3-9517-4dc4-8d37-65da2ea67ff1 None admin] RBAC: Authorizing `identity:get_user(user_id=823fd54d00af495593a275a61c2223da)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:19.874439 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17f1c3-9517-4dc4-8d37-65da2ea67ff1 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:19.876032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 40/77] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:19 2022] GET /identity/v3/users/823fd54d00af495593a275a61c2223da => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:19.876795 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17f1c3-9517-4dc4-8d37-65da2ea67ff1 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:19.928547 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 38/78] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:35:19.929829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37e5f2-cd56-4fd9-9b73-ab5737eb044a None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:19.930123 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37e5f2-cd56-4fd9-9b73-ab5737eb044a None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:19.930436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c37e5f2-cd56-4fd9-9b73-ab5737eb044a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:19.948504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-9c37e5f2-cd56-4fd9-9b73-ab5737eb044a None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:19.949707 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-9c37e5f2-cd56-4fd9-9b73-ab5737eb044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:19.984104 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17f1c3-9517-4dc4-8d37-65da2ea67ff1 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:20.001982 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:20.016514 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 39/79] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:20.017360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37e5f2-cd56-4fd9-9b73-ab5737eb044a None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:20.020795 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aba00-c974-4b1c-8002-e9229f0e67df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:20.021429 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aba00-c974-4b1c-8002-e9229f0e67df None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:20.021721 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aba00-c974-4b1c-8002-e9229f0e67df None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:20.022005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330aba00-c974-4b1c-8002-e9229f0e67df None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:20.022756 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330aba00-c974-4b1c-8002-e9229f0e67df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:20.023072 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330aba00-c974-4b1c-8002-e9229f0e67df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:20.024538 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330aba00-c974-4b1c-8002-e9229f0e67df None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:20.033240 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 41/80] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:35:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:20.033857 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aba00-c974-4b1c-8002-e9229f0e67df None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:20.065516 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:20.121348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c37e5f2-cd56-4fd9-9b73-ab5737eb044a None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:20.140139 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330aba00-c974-4b1c-8002-e9229f0e67df None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:20.154281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68a657-0ade-4911-bb16-b243f03839b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:20.154962 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68a657-0ade-4911-bb16-b243f03839b5 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:20.155251 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68a657-0ade-4911-bb16-b243f03839b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:20.155546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b68a657-0ade-4911-bb16-b243f03839b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:20.165321 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b68a657-0ade-4911-bb16-b243f03839b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:20.170320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-8b68a657-0ade-4911-bb16-b243f03839b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:20.170320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:20.170320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:20.170320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:20.170320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:20.170320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:20.170320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:20.170320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:20.170320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:20.170320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:20.170320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:20.170320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:20.170320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:20.170320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:20.170320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:20.170320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:20.171162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:20.171162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:20.171162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:20.171162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:20.171162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:20.171162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:20.171162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:20.171162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:20.171162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:20.171162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:20.171162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:20.171162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:20.171162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:20.171162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:20.171162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:20.171162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:20.171926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:20.171926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:20.171926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:20.171926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:20.171926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:20.171926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:20.171926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:20.171926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:20.171926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:20.171926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:20.171926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:20.171926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:20.171926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 40/81] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:20.172558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68a657-0ade-4911-bb16-b243f03839b5 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:20.176994 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cd5c0-cbbc-480a-a40e-a3d79a678a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:20.177622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cd5c0-cbbc-480a-a40e-a3d79a678a7c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:20.177908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cd5c0-cbbc-480a-a40e-a3d79a678a7c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:20.178186 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cd5c0-cbbc-480a-a40e-a3d79a678a7c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:20.223355 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:20.245166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cd5c0-cbbc-480a-a40e-a3d79a678a7c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:20.246630 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cd5c0-cbbc-480a-a40e-a3d79a678a7c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:20.272986 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b68a657-0ade-4911-bb16-b243f03839b5 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:20.274522 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:20.307710 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6de5dd-2ef6-4d4e-bcc1-828555d8f7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:20.308350 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6de5dd-2ef6-4d4e-bcc1-828555d8f7d8 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:20.308639 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6de5dd-2ef6-4d4e-bcc1-828555d8f7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:20.308917 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6de5dd-2ef6-4d4e-bcc1-828555d8f7d8 None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:20.310112 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6de5dd-2ef6-4d4e-bcc1-828555d8f7d8 None admin] RBAC: Authorizing `identity:get_project(project_id=bed1abbcdf7b4207893b683a5d6c0eb0)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:20.311608 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6de5dd-2ef6-4d4e-bcc1-828555d8f7d8 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:20.313279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 41/82] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:20 2022] GET /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:20.314046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6de5dd-2ef6-4d4e-bcc1-828555d8f7d8 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:20.344650 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 42/83] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:35:20.345503 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cd5c0-cbbc-480a-a40e-a3d79a678a7c None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:20.410560 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6de5dd-2ef6-4d4e-bcc1-828555d8f7d8 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:20.422759 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:20.445246 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cd5c0-cbbc-480a-a40e-a3d79a678a7c None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:20.446103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90125e1-5201-4dd1-9654-a44255a19b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:20.446779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90125e1-5201-4dd1-9654-a44255a19b18 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:20.447063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90125e1-5201-4dd1-9654-a44255a19b18 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:20.448563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90125e1-5201-4dd1-9654-a44255a19b18 None admin] PATH_INFO: `/v3/users/427c46ab26884620ba19e763d2a97b83` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:20.449141 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90125e1-5201-4dd1-9654-a44255a19b18 None admin] RBAC: Authorizing `identity:get_user(user_id=427c46ab26884620ba19e763d2a97b83)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:20.450618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90125e1-5201-4dd1-9654-a44255a19b18 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:20.452482 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 42/84] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:20 2022] GET /identity/v3/users/427c46ab26884620ba19e763d2a97b83 => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:20.453550 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90125e1-5201-4dd1-9654-a44255a19b18 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:20.483461 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9ef48-581c-42f6-a686-854eda63b330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:20.484110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9ef48-581c-42f6-a686-854eda63b330 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:20.484399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9ef48-581c-42f6-a686-854eda63b330 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:20.484681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9ef48-581c-42f6-a686-854eda63b330 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:20.485828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9ef48-581c-42f6-a686-854eda63b330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:20.487375 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f9ef48-581c-42f6-a686-854eda63b330 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:20.488954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 43/85] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:35:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:20.489706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9ef48-581c-42f6-a686-854eda63b330 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:20.491568 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:20.553809 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90125e1-5201-4dd1-9654-a44255a19b18 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:20.587984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894564f-4d50-4aa1-a35a-73176bae6a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:20.588617 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894564f-4d50-4aa1-a35a-73176bae6a64 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:20.588933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894564f-4d50-4aa1-a35a-73176bae6a64 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:20.589210 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894564f-4d50-4aa1-a35a-73176bae6a64 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:20.589933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894564f-4d50-4aa1-a35a-73176bae6a64 None admin] RBAC: Adding query filter params (name=member) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:20.590242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894564f-4d50-4aa1-a35a-73176bae6a64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:20.591665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894564f-4d50-4aa1-a35a-73176bae6a64 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:20.592394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f9ef48-581c-42f6-a686-854eda63b330 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:20.599837 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 43/86] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:20.600468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894564f-4d50-4aa1-a35a-73176bae6a64 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:20.630083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ede8d3-9c5d-46d3-ab15-dda36ae3356c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:20.630855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ede8d3-9c5d-46d3-ab15-dda36ae3356c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:20.631146 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ede8d3-9c5d-46d3-ab15-dda36ae3356c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:20.631428 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ede8d3-9c5d-46d3-ab15-dda36ae3356c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:20.632223 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ede8d3-9c5d-46d3-ab15-dda36ae3356c None admin] RBAC: Adding query filter params (role.id=267b3ef4524c42bb90a7002ee1639b74, scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0, user.id=427c46ab26884620ba19e763d2a97b83) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:20.632542 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ede8d3-9c5d-46d3-ab15-dda36ae3356c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:20.633988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ede8d3-9c5d-46d3-ab15-dda36ae3356c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:20.642041 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 44/87] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:35:20 2022] GET /identity/v3/role_assignments?user.id=427c46ab26884620ba19e763d2a97b83&scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0&role.id=267b3ef4524c42bb90a7002ee1639b74 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:20.642858 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ede8d3-9c5d-46d3-ab15-dda36ae3356c None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:20.665023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:20.704132 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:20.708695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894564f-4d50-4aa1-a35a-73176bae6a64 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:20.747880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005209e9-37bb-401f-8ea6-70c2686a18b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:20.749348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005209e9-37bb-401f-8ea6-70c2686a18b7 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:20.749855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005209e9-37bb-401f-8ea6-70c2686a18b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:20.750167 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005209e9-37bb-401f-8ea6-70c2686a18b7 None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:20.751540 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005209e9-37bb-401f-8ea6-70c2686a18b7 None admin] RBAC: Authorizing `identity:get_project(project_id=bed1abbcdf7b4207893b683a5d6c0eb0)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:20.753051 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005209e9-37bb-401f-8ea6-70c2686a18b7 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:20.759919 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 44/88] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:20 2022] GET /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:20.759919 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005209e9-37bb-401f-8ea6-70c2686a18b7 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:20.774856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ede8d3-9c5d-46d3-ab15-dda36ae3356c None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:20.817105 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a724a-6df0-4ae6-aeb2-5e540b05d2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:20.817771 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a724a-6df0-4ae6-aeb2-5e540b05d2d1 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:20.818063 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a724a-6df0-4ae6-aeb2-5e540b05d2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:20.818369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a724a-6df0-4ae6-aeb2-5e540b05d2d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:20.868399 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005209e9-37bb-401f-8ea6-70c2686a18b7 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:20.888221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a724a-6df0-4ae6-aeb2-5e540b05d2d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:20.889715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a724a-6df0-4ae6-aeb2-5e540b05d2d1 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:20.902084 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:20.904632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c4325-a532-4b82-b1e6-9a10a26be892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:20.905282 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c4325-a532-4b82-b1e6-9a10a26be892 None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:20.905643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c4325-a532-4b82-b1e6-9a10a26be892 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:20.906123 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c4325-a532-4b82-b1e6-9a10a26be892 None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:20.906721 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c4325-a532-4b82-b1e6-9a10a26be892 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:20.908182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c4325-a532-4b82-b1e6-9a10a26be892 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:20.946375 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 45/89] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 22:35:20 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:35:20.946375 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c4325-a532-4b82-b1e6-9a10a26be892 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:20.978228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:21.017137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 45/90] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:35:21.017918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a724a-6df0-4ae6-aeb2-5e540b05d2d1 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:21.078290 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c4325-a532-4b82-b1e6-9a10a26be892 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:21.123941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f5333-de33-4422-be63-4c60ecb6cf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:21.124611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f5333-de33-4422-be63-4c60ecb6cf7c None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:21.124904 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f5333-de33-4422-be63-4c60ecb6cf7c None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:21.125179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f5333-de33-4422-be63-4c60ecb6cf7c None admin] PATH_INFO: `/v3/users/427c46ab26884620ba19e763d2a97b83` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:21.126550 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f5333-de33-4422-be63-4c60ecb6cf7c None admin] RBAC: Authorizing `identity:get_user(user_id=427c46ab26884620ba19e763d2a97b83)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:21.128341 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066f5333-de33-4422-be63-4c60ecb6cf7c None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:21.130314 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 46/91] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:20 2022] GET /identity/v3/users/427c46ab26884620ba19e763d2a97b83 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:21.131490 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f5333-de33-4422-be63-4c60ecb6cf7c None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:21.139704 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a724a-6df0-4ae6-aeb2-5e540b05d2d1 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:21.152566 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:21.179603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc671e2-4b44-4bcf-b93c-451b0c544140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:21.180233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc671e2-4b44-4bcf-b93c-451b0c544140 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:21.180517 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc671e2-4b44-4bcf-b93c-451b0c544140 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:21.180793 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc671e2-4b44-4bcf-b93c-451b0c544140 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:21.181593 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc671e2-4b44-4bcf-b93c-451b0c544140 None admin] RBAC: Adding query filter params (role.id=49e0ba8d8c9f4824892b61f05d0036e8, scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0, user.id=823fd54d00af495593a275a61c2223da) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:21.181950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc671e2-4b44-4bcf-b93c-451b0c544140 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:21.183444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc671e2-4b44-4bcf-b93c-451b0c544140 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:21.190208 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 46/92] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:35:21 2022] GET /identity/v3/role_assignments?user.id=823fd54d00af495593a275a61c2223da&scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0&role.id=49e0ba8d8c9f4824892b61f05d0036e8 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:21.190897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc671e2-4b44-4bcf-b93c-451b0c544140 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:21.254559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:21.267017 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066f5333-de33-4422-be63-4c60ecb6cf7c None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:21.310949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1287c0-4afc-4abc-ac3d-65da2b8b10cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:21.311778 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1287c0-4afc-4abc-ac3d-65da2b8b10cf None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:21.312160 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1287c0-4afc-4abc-ac3d-65da2b8b10cf None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:21.312540 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1287c0-4afc-4abc-ac3d-65da2b8b10cf None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:21.315129 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1287c0-4afc-4abc-ac3d-65da2b8b10cf None admin] RBAC: Authorizing `identity:get_project(project_id=bed1abbcdf7b4207893b683a5d6c0eb0)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:21.316800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1287c0-4afc-4abc-ac3d-65da2b8b10cf None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:21.318881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 47/93] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:21 2022] GET /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:21.326695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1287c0-4afc-4abc-ac3d-65da2b8b10cf None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:21.355985 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc671e2-4b44-4bcf-b93c-451b0c544140 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:21.399448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093b3d8-195b-4f8f-9310-7c3e431f63bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:21.400089 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093b3d8-195b-4f8f-9310-7c3e431f63bd None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:21.400363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093b3d8-195b-4f8f-9310-7c3e431f63bd None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:21.400707 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093b3d8-195b-4f8f-9310-7c3e431f63bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:21.464232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:21.469000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1287c0-4afc-4abc-ac3d-65da2b8b10cf None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:21.491518 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093b3d8-195b-4f8f-9310-7c3e431f63bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:21.492860 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093b3d8-195b-4f8f-9310-7c3e431f63bd None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:21.513540 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa68b1a-81e2-4cea-8304-d58291bfb947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:21.514586 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa68b1a-81e2-4cea-8304-d58291bfb947 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:21.515099 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa68b1a-81e2-4cea-8304-d58291bfb947 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:21.515576 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa68b1a-81e2-4cea-8304-d58291bfb947 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:21.516977 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa68b1a-81e2-4cea-8304-d58291bfb947 None admin] RBAC: Adding query filter params (role.id=d4ee54c077084dcea38d7476927b61df, scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0, user.id=427c46ab26884620ba19e763d2a97b83) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:21.517742 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa68b1a-81e2-4cea-8304-d58291bfb947 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:21.519943 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa68b1a-81e2-4cea-8304-d58291bfb947 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:21.528790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 48/94] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:35:21 2022] GET /identity/v3/role_assignments?user.id=427c46ab26884620ba19e763d2a97b83&scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0&role.id=d4ee54c077084dcea38d7476927b61df => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:21.658277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 47/95] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:35:21.663542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa68b1a-81e2-4cea-8304-d58291bfb947 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:21.710373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:21.815161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa68b1a-81e2-4cea-8304-d58291bfb947 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:21.860855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b9bc7-2625-441e-9b19-b1700903c359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:21.861519 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b9bc7-2625-441e-9b19-b1700903c359 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:21.861810 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b9bc7-2625-441e-9b19-b1700903c359 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:21.862095 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b9bc7-2625-441e-9b19-b1700903c359 None admin] PATH_INFO: `/v3/projects/16d8cbbdba6446f8bfe3c400861ae2f3` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:21.863401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b9bc7-2625-441e-9b19-b1700903c359 None admin] RBAC: Authorizing `identity:get_project(project_id=16d8cbbdba6446f8bfe3c400861ae2f3)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:21.864916 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633b9bc7-2625-441e-9b19-b1700903c359 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:21.867037 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 49/96] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:21 2022] GET /identity/v3/projects/16d8cbbdba6446f8bfe3c400861ae2f3 => generated 312 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:21.873823 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093b3d8-195b-4f8f-9310-7c3e431f63bd None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:21.981937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:22.018276 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093b3d8-195b-4f8f-9310-7c3e431f63bd None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:22.054317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfdcb9b-cba1-49ec-aa62-f02c1d6fc599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:22.054997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdcb9b-cba1-49ec-aa62-f02c1d6fc599 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:22.055285 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdcb9b-cba1-49ec-aa62-f02c1d6fc599 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:22.055567 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfdcb9b-cba1-49ec-aa62-f02c1d6fc599 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:22.056366 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdcb9b-cba1-49ec-aa62-f02c1d6fc599 None admin] RBAC: Adding query filter params (role.id=267b3ef4524c42bb90a7002ee1639b74, scope.project.id=16d8cbbdba6446f8bfe3c400861ae2f3, user.id=427c46ab26884620ba19e763d2a97b83) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:22.056680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdcb9b-cba1-49ec-aa62-f02c1d6fc599 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:22.058797 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfdcb9b-cba1-49ec-aa62-f02c1d6fc599 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:22.064312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 48/97] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:35:21 2022] GET /identity/v3/role_assignments?user.id=427c46ab26884620ba19e763d2a97b83&scope.project.id=16d8cbbdba6446f8bfe3c400861ae2f3&role.id=267b3ef4524c42bb90a7002ee1639b74 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:23.673246 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019e139-99b2-4ea2-b561-3ba8243e8322 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:23.673740 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019e139-99b2-4ea2-b561-3ba8243e8322 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:23.673812 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019e139-99b2-4ea2-b561-3ba8243e8322 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:23.675426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 50/98] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:23.687710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da198a-d3da-47e6-ba1b-2e6b98cdbaf7 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:23.688591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da198a-d3da-47e6-ba1b-2e6b98cdbaf7 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:23.689088 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da198a-d3da-47e6-ba1b-2e6b98cdbaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:23.715411 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-93da198a-d3da-47e6-ba1b-2e6b98cdbaf7 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:23.716703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-93da198a-d3da-47e6-ba1b-2e6b98cdbaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:23.806031 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 49/99] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:23.840440 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019e139-99b2-4ea2-b561-3ba8243e8322 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:23.977748 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:23.987931 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019e139-99b2-4ea2-b561-3ba8243e8322 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:24.037199 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52da6a86-8775-4aed-ae40-7a3ed25965db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:24.037861 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da6a86-8775-4aed-ae40-7a3ed25965db None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:24.038149 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da6a86-8775-4aed-ae40-7a3ed25965db None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:24.038454 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da6a86-8775-4aed-ae40-7a3ed25965db None admin] PATH_INFO: `/v3/roles/member` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:24.055214 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52da6a86-8775-4aed-ae40-7a3ed25965db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:24.060373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-52da6a86-8775-4aed-ae40-7a3ed25965db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:24.060373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:24.060373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:24.060373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:24.060373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:24.060373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:24.060373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:24.060373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:24.060373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:24.060373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:24.060373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:24.060373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:24.060373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:24.060373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:24.060373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:24.060373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:24.061228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:24.061228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:24.061228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:24.061228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:24.061228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:24.061228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:24.061228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:24.061228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:24.061228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:24.061228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:24.061228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:24.061228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:24.061228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:24.061228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:24.061228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:24.061228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:24.061998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:24.061998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:24.061998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:24.061998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:24.061998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:24.061998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:24.061998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:24.061998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:24.061998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:24.061998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:24.061998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:24.061998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:24.061998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 51/100] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:24.069424 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da198a-d3da-47e6-ba1b-2e6b98cdbaf7 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:24.141977 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bae2b9-e491-4307-8309-1535253dacea None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:24.141977 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bae2b9-e491-4307-8309-1535253dacea None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:24.142219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bae2b9-e491-4307-8309-1535253dacea None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:24.144147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 52/101] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:24.149198 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9952c85-20f9-482c-816e-d5edcd87526b None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:24.149765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9952c85-20f9-482c-816e-d5edcd87526b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:24.150240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9952c85-20f9-482c-816e-d5edcd87526b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:24.164555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:24.191351 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-a9952c85-20f9-482c-816e-d5edcd87526b None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:24.192649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a9952c85-20f9-482c-816e-d5edcd87526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:24.214235 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da198a-d3da-47e6-ba1b-2e6b98cdbaf7 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:24.266018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba4bac-2919-436c-a730-432366329d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:24.266604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba4bac-2919-436c-a730-432366329d1e None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:24.266896 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba4bac-2919-436c-a730-432366329d1e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:24.267179 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba4bac-2919-436c-a730-432366329d1e None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:24.267906 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba4bac-2919-436c-a730-432366329d1e None admin] RBAC: Adding query filter params (name=member) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:24.268217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba4bac-2919-436c-a730-432366329d1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:24.269602 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ba4bac-2919-436c-a730-432366329d1e None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:24.290670 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 50/102] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:24.291806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832d428-1bf8-4f1e-9dd2-134690e036dd None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:24.292098 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832d428-1bf8-4f1e-9dd2-134690e036dd None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:24.292383 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0832d428-1bf8-4f1e-9dd2-134690e036dd None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:24.293928 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 51/103] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:24.301310 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832d428-1bf8-4f1e-9dd2-134690e036dd None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:24.323117 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 53/104] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:24.324402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58519fc-b722-4144-bb59-1ca3b1e9ddce None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:24.324696 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58519fc-b722-4144-bb59-1ca3b1e9ddce None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:24.324980 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58519fc-b722-4144-bb59-1ca3b1e9ddce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:24.354118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-b58519fc-b722-4144-bb59-1ca3b1e9ddce None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:24.361410 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-b58519fc-b722-4144-bb59-1ca3b1e9ddce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:24.440136 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 54/105] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:24.441251 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31245c0b-9151-4990-99f0-1784dcdf1cca None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:24.442875 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31245c0b-9151-4990-99f0-1784dcdf1cca None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:24.443419 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31245c0b-9151-4990-99f0-1784dcdf1cca None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:24.449470 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 55/106] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:24.449470 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31245c0b-9151-4990-99f0-1784dcdf1cca None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:24.451971 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0832d428-1bf8-4f1e-9dd2-134690e036dd None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:24.478696 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:24.483686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:24.491071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd144c8-1c1a-42ca-bcac-7034ae925289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:24.491730 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd144c8-1c1a-42ca-bcac-7034ae925289 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:24.492129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd144c8-1c1a-42ca-bcac-7034ae925289 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:24.492404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd144c8-1c1a-42ca-bcac-7034ae925289 None admin] PATH_INFO: `/v3/users/427c46ab26884620ba19e763d2a97b83` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:24.493470 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd144c8-1c1a-42ca-bcac-7034ae925289 None admin] RBAC: Authorizing `identity:get_user(user_id=427c46ab26884620ba19e763d2a97b83)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:24.495015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd144c8-1c1a-42ca-bcac-7034ae925289 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:24.496653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 52/107] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:24 2022] GET /identity/v3/users/427c46ab26884620ba19e763d2a97b83 => generated 275 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:24.497748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68246354-9fc2-4d27-a3f6-8e87f4331ded None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:24.498038 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68246354-9fc2-4d27-a3f6-8e87f4331ded None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:24.498320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68246354-9fc2-4d27-a3f6-8e87f4331ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:24.516290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-68246354-9fc2-4d27-a3f6-8e87f4331ded None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:24.517396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-68246354-9fc2-4d27-a3f6-8e87f4331ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:24.579965 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31245c0b-9151-4990-99f0-1784dcdf1cca None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:24.598387 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 53/108] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:24.598387 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac44bdd-b88c-4f35-a807-cd28ea2f18b0 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:24.598387 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac44bdd-b88c-4f35-a807-cd28ea2f18b0 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:24.598387 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac44bdd-b88c-4f35-a807-cd28ea2f18b0 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:24.598387 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 54/109] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:24.598796 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac44bdd-b88c-4f35-a807-cd28ea2f18b0 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:24.636741 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990e24b-fa61-472a-944c-2152bd83e01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:24.637394 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990e24b-fa61-472a-944c-2152bd83e01e None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:24.637682 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990e24b-fa61-472a-944c-2152bd83e01e None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:24.637963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990e24b-fa61-472a-944c-2152bd83e01e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:24.648780 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990e24b-fa61-472a-944c-2152bd83e01e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:24.654046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-9990e24b-fa61-472a-944c-2152bd83e01e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:35:24.654046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:24.654046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:24.654046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:24.654046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:24.654046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:24.654046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:24.654046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:24.654046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:24.654046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:24.654046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:24.654046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:24.654046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:24.654046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:24.654046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:24.654046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:24.654978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:24.654978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:24.654978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:24.654978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:24.654978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:24.654978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:24.654978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:24.654978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:24.654978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:24.654978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:24.654978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:24.654978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:24.654978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:24.654978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:24.654978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:24.654978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:24.655762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:24.655762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:24.655762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:24.655762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:24.655762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:24.655762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:24.655762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:24.655762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:24.655762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:24.655762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:24.655762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:35:24.655762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:24.655762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 56/110] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:35:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:24.656998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990e24b-fa61-472a-944c-2152bd83e01e None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:24.719139 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac44bdd-b88c-4f35-a807-cd28ea2f18b0 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:24.733448 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:24.759524 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:24.769162 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb626c-a4cf-48d6-b896-3d819ab76f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:24.769759 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb626c-a4cf-48d6-b896-3d819ab76f1f None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:24.770053 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb626c-a4cf-48d6-b896-3d819ab76f1f None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:24.770326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb626c-a4cf-48d6-b896-3d819ab76f1f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:24.777562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990e24b-fa61-472a-944c-2152bd83e01e None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:24.786235 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb626c-a4cf-48d6-b896-3d819ab76f1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:24.791394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-4feb626c-a4cf-48d6-b896-3d819ab76f1f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 22:35:24.791394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:24.791394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:24.791394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:24.791394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:24.791394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:24.791394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:24.791394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:24.791394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:24.791394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:24.791394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:24.791394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:24.791394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:24.791394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:24.791394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:24.791394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:24.792253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:24.792253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:24.792253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:24.792253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:24.792253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:24.792253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:24.792253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:24.792253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:24.792253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:24.792253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:24.792253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:24.792253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:24.792253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:24.792253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:24.792253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:24.792253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:24.793051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:24.793051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:24.793051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:24.793051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:24.793051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:24.793051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:24.793051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:24.793051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:24.793051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:24.793051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:24.793051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 22:35:24.793051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:24.793051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 55/111] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:24.799103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c0d9b-3ab2-4587-8c88-8396b7862b2e None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:24.799103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c0d9b-3ab2-4587-8c88-8396b7862b2e None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:24.799103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c0d9b-3ab2-4587-8c88-8396b7862b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:24.813942 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-0a6c0d9b-3ab2-4587-8c88-8396b7862b2e None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:24.815168 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-0a6c0d9b-3ab2-4587-8c88-8396b7862b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:24.824535 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a841a1-f61d-41ac-ba77-5447b4e39e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:24.825259 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a841a1-f61d-41ac-ba77-5447b4e39e4e None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:24.825549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a841a1-f61d-41ac-ba77-5447b4e39e4e None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:24.825828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a841a1-f61d-41ac-ba77-5447b4e39e4e None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:24.827309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a841a1-f61d-41ac-ba77-5447b4e39e4e None admin] RBAC: Authorizing `identity:get_project(project_id=bed1abbcdf7b4207893b683a5d6c0eb0)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:24.828763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a841a1-f61d-41ac-ba77-5447b4e39e4e None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:24.835180 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 57/112] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:24 2022] GET /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:24.835180 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a841a1-f61d-41ac-ba77-5447b4e39e4e None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:24.898844 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 56/113] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:24.898844 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c0d9b-3ab2-4587-8c88-8396b7862b2e None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:24.940083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a841a1-f61d-41ac-ba77-5447b4e39e4e None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:24.974248 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425ac31-ccea-459e-b82c-a4822d7666a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:24.974927 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425ac31-ccea-459e-b82c-a4822d7666a5 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:24.975215 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425ac31-ccea-459e-b82c-a4822d7666a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:24.975500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425ac31-ccea-459e-b82c-a4822d7666a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:24.976645 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425ac31-ccea-459e-b82c-a4822d7666a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:24.978100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425ac31-ccea-459e-b82c-a4822d7666a5 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:24.980228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 58/114] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:35:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:24.980996 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425ac31-ccea-459e-b82c-a4822d7666a5 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:24.990849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:24.999697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c0d9b-3ab2-4587-8c88-8396b7862b2e None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:25.016305 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:25.033551 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b206639-c174-4ce6-b681-2182e8d47cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:25.034120 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b206639-c174-4ce6-b681-2182e8d47cca None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:25.034448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b206639-c174-4ce6-b681-2182e8d47cca None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:25.034734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b206639-c174-4ce6-b681-2182e8d47cca None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:25.035459 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b206639-c174-4ce6-b681-2182e8d47cca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:25.035774 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b206639-c174-4ce6-b681-2182e8d47cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:25.037169 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b206639-c174-4ce6-b681-2182e8d47cca None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:25.045647 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 57/115] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:35:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:25.046439 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b206639-c174-4ce6-b681-2182e8d47cca None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:25.083389 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425ac31-ccea-459e-b82c-a4822d7666a5 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:25.116063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39062419-f96d-4531-8b7d-210153e0fcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:25.116683 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39062419-f96d-4531-8b7d-210153e0fcce None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:25.116971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39062419-f96d-4531-8b7d-210153e0fcce None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:25.117312 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39062419-f96d-4531-8b7d-210153e0fcce None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:25.118040 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39062419-f96d-4531-8b7d-210153e0fcce None admin] RBAC: Adding query filter params (name=reader) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:25.118382 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39062419-f96d-4531-8b7d-210153e0fcce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:25.120320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39062419-f96d-4531-8b7d-210153e0fcce None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:25.128307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 59/116] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:25.129480 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c80dd1-11f9-4f96-ba4a-2c488be4fc6e None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:25.129773 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c80dd1-11f9-4f96-ba4a-2c488be4fc6e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:25.130056 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c80dd1-11f9-4f96-ba4a-2c488be4fc6e None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:25.131498 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 60/117] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:25.132005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c80dd1-11f9-4f96-ba4a-2c488be4fc6e None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:25.146626 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b206639-c174-4ce6-b681-2182e8d47cca None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:25.179176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca0af3-118e-41d1-9c2e-136eafee1a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:25.179834 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca0af3-118e-41d1-9c2e-136eafee1a8a None admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:25.180118 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca0af3-118e-41d1-9c2e-136eafee1a8a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:25.180397 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ca0af3-118e-41d1-9c2e-136eafee1a8a None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0/users/427c46ab26884620ba19e763d2a97b83/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:25.182931 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca0af3-118e-41d1-9c2e-136eafee1a8a None admin] RBAC: Authorizing `identity:create_grant(project_id=bed1abbcdf7b4207893b683a5d6c0eb0, user_id=427c46ab26884620ba19e763d2a97b83, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:25.184364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ca0af3-118e-41d1-9c2e-136eafee1a8a None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:25.197797 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 58/118] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:35:25 2022] PUT /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0/users/427c46ab26884620ba19e763d2a97b83/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:35:25.198603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca0af3-118e-41d1-9c2e-136eafee1a8a None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:25.212532 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:25.240945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c80dd1-11f9-4f96-ba4a-2c488be4fc6e None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:25.259848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:25.279926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b6080-0625-4b9a-9d8c-2919bfbc13c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:25.280709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b6080-0625-4b9a-9d8c-2919bfbc13c9 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:25.281122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b6080-0625-4b9a-9d8c-2919bfbc13c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:25.281292 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b6080-0625-4b9a-9d8c-2919bfbc13c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:25.293578 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b6080-0625-4b9a-9d8c-2919bfbc13c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:25.299147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-197b6080-0625-4b9a-9d8c-2919bfbc13c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:35:25.299147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:25.299147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:25.299147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:25.299147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:25.299147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:25.299147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:25.299147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:25.299147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:25.299147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:25.299147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:25.299147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:25.299147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:25.299147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:25.299147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:25.299147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:25.300052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:25.300052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:25.300052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:25.300052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:25.300052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:25.300052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:25.300052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:25.300052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:25.300052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:25.300052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:25.300052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:25.300052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:25.300052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:25.300052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:25.300052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:25.300052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:25.306072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:25.306072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:25.306072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:25.306072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:25.306072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:25.306072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:25.306072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:25.306072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:25.306072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:25.306072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:25.306072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:35:25.306072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:25.306072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 61/119] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:35:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:25.306072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b6080-0625-4b9a-9d8c-2919bfbc13c9 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:25.337152 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ca0af3-118e-41d1-9c2e-136eafee1a8a None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:25.378773 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768d8cb-880b-4b6e-a8e4-9dc7c971be0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:25.379398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768d8cb-880b-4b6e-a8e4-9dc7c971be0d None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:25.379686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768d8cb-880b-4b6e-a8e4-9dc7c971be0d None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:25.379967 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768d8cb-880b-4b6e-a8e4-9dc7c971be0d None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:25.380660 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768d8cb-880b-4b6e-a8e4-9dc7c971be0d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:25.382110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768d8cb-880b-4b6e-a8e4-9dc7c971be0d None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:25.410328 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 59/120] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 22:35:25 2022] POST /identity/v3/projects => generated 302 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:35:25.411115 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768d8cb-880b-4b6e-a8e4-9dc7c971be0d None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:25.426944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b6080-0625-4b9a-9d8c-2919bfbc13c9 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:25.468660 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:25.477657 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e666176-1315-4596-a729-07004e3ed75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:25.478465 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e666176-1315-4596-a729-07004e3ed75c None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:25.479404 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e666176-1315-4596-a729-07004e3ed75c None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:25.480208 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e666176-1315-4596-a729-07004e3ed75c None admin] PATH_INFO: `/v3/users/427c46ab26884620ba19e763d2a97b83` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:25.481860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e666176-1315-4596-a729-07004e3ed75c None admin] RBAC: Authorizing `identity:get_user(user_id=427c46ab26884620ba19e763d2a97b83)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:25.483629 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e666176-1315-4596-a729-07004e3ed75c None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:25.485747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 62/121] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:25 2022] GET /identity/v3/users/427c46ab26884620ba19e763d2a97b83 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:25.486991 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad2252-0e10-4797-8f93-3a9c63071fc3 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:25.487285 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad2252-0e10-4797-8f93-3a9c63071fc3 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:25.487566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad2252-0e10-4797-8f93-3a9c63071fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:25.507354 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-13ad2252-0e10-4797-8f93-3a9c63071fc3 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:25.508580 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-13ad2252-0e10-4797-8f93-3a9c63071fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:25.536115 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:25.547287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768d8cb-880b-4b6e-a8e4-9dc7c971be0d None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:25.583929 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 63/122] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:25.584597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad2252-0e10-4797-8f93-3a9c63071fc3 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:25.592794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8105bf-0ff2-46f2-8282-64fd34fec959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:25.593732 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8105bf-0ff2-46f2-8282-64fd34fec959 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:25.594288 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8105bf-0ff2-46f2-8282-64fd34fec959 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:25.594829 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8105bf-0ff2-46f2-8282-64fd34fec959 None admin] PATH_INFO: `/v3/users/0c3c47d36ee64327bc553ab61276989c` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:25.615228 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8105bf-0ff2-46f2-8282-64fd34fec959 None admin] RBAC: Authorizing `identity:get_user(user_id=0c3c47d36ee64327bc553ab61276989c)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:25.617131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8105bf-0ff2-46f2-8282-64fd34fec959 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:25.619142 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 60/123] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:25 2022] GET /identity/v3/users/0c3c47d36ee64327bc553ab61276989c => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:25.620233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8105bf-0ff2-46f2-8282-64fd34fec959 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:25.725619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ad2252-0e10-4797-8f93-3a9c63071fc3 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:25.737794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8105bf-0ff2-46f2-8282-64fd34fec959 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:25.765106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:25.777304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33620b0-a492-46b6-83c7-0ef6c7bd8bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:25.778330 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33620b0-a492-46b6-83c7-0ef6c7bd8bd0 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:25.778654 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33620b0-a492-46b6-83c7-0ef6c7bd8bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:25.778944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33620b0-a492-46b6-83c7-0ef6c7bd8bd0 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:25.779951 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33620b0-a492-46b6-83c7-0ef6c7bd8bd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:25.780275 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33620b0-a492-46b6-83c7-0ef6c7bd8bd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:25.781982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33620b0-a492-46b6-83c7-0ef6c7bd8bd0 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:25.784395 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6aebd-5995-4c9b-935e-ff1b03e7ab10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:25.785378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6aebd-5995-4c9b-935e-ff1b03e7ab10 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:25.785866 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6aebd-5995-4c9b-935e-ff1b03e7ab10 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:25.786373 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6aebd-5995-4c9b-935e-ff1b03e7ab10 None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:25.787867 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6aebd-5995-4c9b-935e-ff1b03e7ab10 None admin] RBAC: Authorizing `identity:get_project(project_id=bed1abbcdf7b4207893b683a5d6c0eb0)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:25.789614 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6aebd-5995-4c9b-935e-ff1b03e7ab10 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:25.791174 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 64/124] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:25.792848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 61/125] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:25 2022] GET /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:25.792958 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33620b0-a492-46b6-83c7-0ef6c7bd8bd0 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:25.794097 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6aebd-5995-4c9b-935e-ff1b03e7ab10 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:25.822212 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:25.919002 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33620b0-a492-46b6-83c7-0ef6c7bd8bd0 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:25.922758 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6aebd-5995-4c9b-935e-ff1b03e7ab10 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:25.962166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5c735-a131-4630-bb99-b4c106ea6d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:25.963657 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5c735-a131-4630-bb99-b4c106ea6d2d None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:25.964090 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5c735-a131-4630-bb99-b4c106ea6d2d None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:25.964561 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5c735-a131-4630-bb99-b4c106ea6d2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:25.964955 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84250858-45db-4015-bf4f-7fa0a00047e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:25.965689 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84250858-45db-4015-bf4f-7fa0a00047e2 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:25.965976 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84250858-45db-4015-bf4f-7fa0a00047e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:25.966266 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84250858-45db-4015-bf4f-7fa0a00047e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:25.977255 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84250858-45db-4015-bf4f-7fa0a00047e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:25.983119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-84250858-45db-4015-bf4f-7fa0a00047e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:25.983119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:25.983119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:25.983119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:25.983119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:25.983119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:25.983119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:25.983119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:25.983119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:25.983119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:25.983119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:25.983119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:25.983119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:25.983119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:25.983119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:25.983119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:25.984171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:25.984171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:25.984171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:25.984171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:25.984171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:25.984171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:25.984171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:25.984171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:25.984171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:25.984171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:25.984171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:25.984171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:25.984171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:25.984171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:25.984171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:25.984171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:25.985094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:25.985094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:25.985094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:25.985094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:25.985094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:25.985094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:25.985094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:25.985094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:25.985094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:25.985094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:25.985094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:25.985094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:25.989132 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 65/126] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:25.989960 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84250858-45db-4015-bf4f-7fa0a00047e2 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:26.043196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5c735-a131-4630-bb99-b4c106ea6d2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:26.044825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5c735-a131-4630-bb99-b4c106ea6d2d None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:26.067368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:26.071767 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:26.117137 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84250858-45db-4015-bf4f-7fa0a00047e2 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:26.163665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 62/127] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:35:26.163942 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf499c1-8f72-4654-bae0-5f5c94369f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:26.164555 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf499c1-8f72-4654-bae0-5f5c94369f08 None admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:26.164911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf499c1-8f72-4654-bae0-5f5c94369f08 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:26.165204 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf499c1-8f72-4654-bae0-5f5c94369f08 None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0/users/427c46ab26884620ba19e763d2a97b83/roles/d4ee54c077084dcea38d7476927b61df` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:26.165636 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5c735-a131-4630-bb99-b4c106ea6d2d None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:26.167584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf499c1-8f72-4654-bae0-5f5c94369f08 None admin] RBAC: Authorizing `identity:create_grant(project_id=bed1abbcdf7b4207893b683a5d6c0eb0, user_id=427c46ab26884620ba19e763d2a97b83, role_id=d4ee54c077084dcea38d7476927b61df)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:26.170334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf499c1-8f72-4654-bae0-5f5c94369f08 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:26.194370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 66/128] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:35:25 2022] PUT /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0/users/427c46ab26884620ba19e763d2a97b83/roles/d4ee54c077084dcea38d7476927b61df => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:35:26.194370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf499c1-8f72-4654-bae0-5f5c94369f08 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:26.378541 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5c735-a131-4630-bb99-b4c106ea6d2d None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:26.380976 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf499c1-8f72-4654-bae0-5f5c94369f08 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:26.398511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:26.400238 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:26.421526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a75013-b9b4-418d-a201-c9ea920cb650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:26.422713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a75013-b9b4-418d-a201-c9ea920cb650 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:26.423202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a75013-b9b4-418d-a201-c9ea920cb650 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:26.423812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a75013-b9b4-418d-a201-c9ea920cb650 None admin] PATH_INFO: `/v3/users/823fd54d00af495593a275a61c2223da` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:26.425383 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a75013-b9b4-418d-a201-c9ea920cb650 None admin] RBAC: Authorizing `identity:get_user(user_id=823fd54d00af495593a275a61c2223da)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:26.427165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a75013-b9b4-418d-a201-c9ea920cb650 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:26.429983 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e259e8d-db7f-48e4-ac21-75cb51c4a27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:26.430583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 63/129] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:26 2022] GET /identity/v3/users/823fd54d00af495593a275a61c2223da => generated 247 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:26.430686 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e259e8d-db7f-48e4-ac21-75cb51c4a27b None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:26.430910 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e259e8d-db7f-48e4-ac21-75cb51c4a27b None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:26.431198 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e259e8d-db7f-48e4-ac21-75cb51c4a27b None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:26.432535 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e259e8d-db7f-48e4-ac21-75cb51c4a27b None admin] RBAC: Adding query filter params (name=member) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:26.432758 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a75013-b9b4-418d-a201-c9ea920cb650 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:26.432853 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e259e8d-db7f-48e4-ac21-75cb51c4a27b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:26.434372 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e259e8d-db7f-48e4-ac21-75cb51c4a27b None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:26.445558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 67/130] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:26.446247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e259e8d-db7f-48e4-ac21-75cb51c4a27b None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:26.557923 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e259e8d-db7f-48e4-ac21-75cb51c4a27b None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:26.564994 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a75013-b9b4-418d-a201-c9ea920cb650 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:26.593713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a2158-e2bd-4b1d-aea2-a6717271402f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:26.594756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a2158-e2bd-4b1d-aea2-a6717271402f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:26.595243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a2158-e2bd-4b1d-aea2-a6717271402f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:26.595718 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a2158-e2bd-4b1d-aea2-a6717271402f None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:26.597176 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a2158-e2bd-4b1d-aea2-a6717271402f None admin] RBAC: Authorizing `identity:get_project(project_id=bed1abbcdf7b4207893b683a5d6c0eb0)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:26.599957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a2158-e2bd-4b1d-aea2-a6717271402f None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:26.601936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 68/131] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:26 2022] GET /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:26.602951 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a2158-e2bd-4b1d-aea2-a6717271402f None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:26.624093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d393ad-915d-4045-8f00-a749d2c82cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:26.624762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d393ad-915d-4045-8f00-a749d2c82cdf None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:26.625055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d393ad-915d-4045-8f00-a749d2c82cdf None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:26.625344 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d393ad-915d-4045-8f00-a749d2c82cdf None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:26.626559 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d393ad-915d-4045-8f00-a749d2c82cdf None admin] RBAC: Authorizing `identity:get_project(project_id=bed1abbcdf7b4207893b683a5d6c0eb0)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:26.628033 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d393ad-915d-4045-8f00-a749d2c82cdf None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:26.629898 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 64/132] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:26 2022] GET /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:26.638565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d393ad-915d-4045-8f00-a749d2c82cdf None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:26.655471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:26.719338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a2158-e2bd-4b1d-aea2-a6717271402f None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:26.757815 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0dfd6-a59d-4892-855e-b266a104a9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:26.758851 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0dfd6-a59d-4892-855e-b266a104a9cf None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:26.759354 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0dfd6-a59d-4892-855e-b266a104a9cf None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:26.759859 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e0dfd6-a59d-4892-855e-b266a104a9cf None admin] PATH_INFO: `/v3/users/427c46ab26884620ba19e763d2a97b83` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:26.761255 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0dfd6-a59d-4892-855e-b266a104a9cf None admin] RBAC: Authorizing `identity:get_user(user_id=427c46ab26884620ba19e763d2a97b83)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:26.762953 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e0dfd6-a59d-4892-855e-b266a104a9cf None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:26.764765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 69/133] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:26 2022] GET /identity/v3/users/427c46ab26884620ba19e763d2a97b83 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:26.765735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0dfd6-a59d-4892-855e-b266a104a9cf None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:26.778725 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:26.850730 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d393ad-915d-4045-8f00-a749d2c82cdf None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:26.888607 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e0dfd6-a59d-4892-855e-b266a104a9cf None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:26.893648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d9005-d795-409f-871c-cbe30cbfdbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:26.894368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d9005-d795-409f-871c-cbe30cbfdbc2 None admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:26.894662 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d9005-d795-409f-871c-cbe30cbfdbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:26.894943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d9005-d795-409f-871c-cbe30cbfdbc2 None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0/users/823fd54d00af495593a275a61c2223da/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:26.903169 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d9005-d795-409f-871c-cbe30cbfdbc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=bed1abbcdf7b4207893b683a5d6c0eb0, user_id=823fd54d00af495593a275a61c2223da, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:26.904631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d9005-d795-409f-871c-cbe30cbfdbc2 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:26.910073 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:26.930306 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 65/134] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:35:26 2022] PUT /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0/users/823fd54d00af495593a275a61c2223da/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:35:26.931177 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d9005-d795-409f-871c-cbe30cbfdbc2 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:26.962044 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe84419-d9f8-4b87-84de-4a6bc9e2dd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:26.962723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe84419-d9f8-4b87-84de-4a6bc9e2dd75 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:26.963557 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe84419-d9f8-4b87-84de-4a6bc9e2dd75 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:26.963839 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe84419-d9f8-4b87-84de-4a6bc9e2dd75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:26.964646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe84419-d9f8-4b87-84de-4a6bc9e2dd75 None admin] RBAC: Adding query filter params (role.id=6408c231c0fe422fa2f095c2c8fd7a9e, scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0, user.id=0c3c47d36ee64327bc553ab61276989c) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:26.964962 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe84419-d9f8-4b87-84de-4a6bc9e2dd75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:26.967989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe84419-d9f8-4b87-84de-4a6bc9e2dd75 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:26.975247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 70/135] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:35:26 2022] GET /identity/v3/role_assignments?user.id=0c3c47d36ee64327bc553ab61276989c&scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0&role.id=6408c231c0fe422fa2f095c2c8fd7a9e => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:27.094054 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d9005-d795-409f-871c-cbe30cbfdbc2 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:27.114864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:27.143178 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21c5f5-46b3-40d9-8415-474b83416374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:27.143760 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21c5f5-46b3-40d9-8415-474b83416374 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:27.144045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21c5f5-46b3-40d9-8415-474b83416374 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:27.144326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21c5f5-46b3-40d9-8415-474b83416374 None admin] PATH_INFO: `/v3/projects/16d8cbbdba6446f8bfe3c400861ae2f3` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:27.148301 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21c5f5-46b3-40d9-8415-474b83416374 None admin] RBAC: Authorizing `identity:get_project(project_id=16d8cbbdba6446f8bfe3c400861ae2f3)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:27.149836 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21c5f5-46b3-40d9-8415-474b83416374 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:27.152628 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 66/136] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:26 2022] GET /identity/v3/projects/16d8cbbdba6446f8bfe3c400861ae2f3 => generated 312 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:27.158486 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe84419-d9f8-4b87-84de-4a6bc9e2dd75 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:27.287060 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe84419-d9f8-4b87-84de-4a6bc9e2dd75 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:27.323030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bab3c4-06d1-466c-af90-02473e56a89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:27.323833 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bab3c4-06d1-466c-af90-02473e56a89d None admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:27.324110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bab3c4-06d1-466c-af90-02473e56a89d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:27.324398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bab3c4-06d1-466c-af90-02473e56a89d None admin] PATH_INFO: `/v3/projects/16d8cbbdba6446f8bfe3c400861ae2f3/users/427c46ab26884620ba19e763d2a97b83/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:27.326698 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bab3c4-06d1-466c-af90-02473e56a89d None admin] RBAC: Authorizing `identity:create_grant(project_id=16d8cbbdba6446f8bfe3c400861ae2f3, user_id=427c46ab26884620ba19e763d2a97b83, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:27.328294 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bab3c4-06d1-466c-af90-02473e56a89d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:27.346008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 71/137] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:35:27 2022] PUT /identity/v3/projects/16d8cbbdba6446f8bfe3c400861ae2f3/users/427c46ab26884620ba19e763d2a97b83/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:35:27.557752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c8240-129e-4143-9287-70e067d3e099 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:27.558007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c8240-129e-4143-9287-70e067d3e099 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:27.558287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c8240-129e-4143-9287-70e067d3e099 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:27.559752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 67/138] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:27.566372 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7de48-40c2-4bc9-9baf-cebde5fefa0f None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:27.566372 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7de48-40c2-4bc9-9baf-cebde5fefa0f None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:27.566372 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7de48-40c2-4bc9-9baf-cebde5fefa0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:27.586075 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-2cd7de48-40c2-4bc9-9baf-cebde5fefa0f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:27.587610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-2cd7de48-40c2-4bc9-9baf-cebde5fefa0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:27.617140 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:27.663353 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 72/139] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:27.701647 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c8240-129e-4143-9287-70e067d3e099 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:27.845563 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c8240-129e-4143-9287-70e067d3e099 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:27.899879 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9014d09a-e924-499b-8435-fd68d788f598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:27.901076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014d09a-e924-499b-8435-fd68d788f598 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:27.901369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014d09a-e924-499b-8435-fd68d788f598 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:27.901652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9014d09a-e924-499b-8435-fd68d788f598 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:27.919232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9014d09a-e924-499b-8435-fd68d788f598 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:27.924554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-9014d09a-e924-499b-8435-fd68d788f598 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:27.924554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:27.924554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:27.924554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:27.924554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:27.924554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:27.924554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:27.924554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:27.924554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:27.924554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:27.924554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:27.924554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:27.924554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:27.924554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:27.924554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:27.924554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:27.925451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:27.925451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:27.925451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:27.925451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:27.925451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:27.925451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:27.925451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:27.925451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:27.925451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:27.925451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:27.925451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:27.925451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:27.925451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:27.925451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:27.925451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:27.925451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:27.926236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:27.926236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:27.926236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:27.926236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:27.926236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:27.926236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:27.926236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:27.926236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:27.926236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:27.926236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:27.926236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:27.926236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:27.926236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 68/140] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:27.931851 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7de48-40c2-4bc9-9baf-cebde5fefa0f None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:27.935814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3eaaff-a809-4cc2-83a4-02557a3b9c17 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:27.936111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3eaaff-a809-4cc2-83a4-02557a3b9c17 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:27.937494 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3eaaff-a809-4cc2-83a4-02557a3b9c17 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:27.938892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 69/141] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:35:27.944230 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4435fd-11ac-4d48-afd4-7fe976af3f5f None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:27.944527 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4435fd-11ac-4d48-afd4-7fe976af3f5f None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:27.944821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4435fd-11ac-4d48-afd4-7fe976af3f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:27.976488 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-3e4435fd-11ac-4d48-afd4-7fe976af3f5f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:27.977883 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-3e4435fd-11ac-4d48-afd4-7fe976af3f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:28.027817 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:28.097249 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 70/142] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:28.122361 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7de48-40c2-4bc9-9baf-cebde5fefa0f None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:28.139170 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4435fd-11ac-4d48-afd4-7fe976af3f5f None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:28.233625 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed907265-d6fd-466e-9e36-dfd52924064e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:28.234265 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed907265-d6fd-466e-9e36-dfd52924064e None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:28.234577 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed907265-d6fd-466e-9e36-dfd52924064e None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:28.234857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed907265-d6fd-466e-9e36-dfd52924064e None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:28.235587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed907265-d6fd-466e-9e36-dfd52924064e None admin] RBAC: Adding query filter params (name=member) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:28.235897 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed907265-d6fd-466e-9e36-dfd52924064e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:28.237286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed907265-d6fd-466e-9e36-dfd52924064e None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:28.253557 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 73/143] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:28.260708 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed907265-d6fd-466e-9e36-dfd52924064e None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:28.312277 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:28.326402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4435fd-11ac-4d48-afd4-7fe976af3f5f None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:28.391134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d676f-2a7d-4460-b823-c88fd85f4dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:28.391988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d676f-2a7d-4460-b823-c88fd85f4dbf None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:28.392284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d676f-2a7d-4460-b823-c88fd85f4dbf None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:28.392570 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d676f-2a7d-4460-b823-c88fd85f4dbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:28.393731 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d676f-2a7d-4460-b823-c88fd85f4dbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:28.395370 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768d676f-2a7d-4460-b823-c88fd85f4dbf None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:28.397151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 71/144] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:35:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:28.403513 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d676f-2a7d-4460-b823-c88fd85f4dbf None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:28.458911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed907265-d6fd-466e-9e36-dfd52924064e None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:28.472677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:28.551077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad7d66-83a2-4f3e-8ece-c54782a3e79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:28.551752 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad7d66-83a2-4f3e-8ece-c54782a3e79c None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:28.552045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad7d66-83a2-4f3e-8ece-c54782a3e79c None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:28.552329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad7d66-83a2-4f3e-8ece-c54782a3e79c None admin] PATH_INFO: `/v3/users/427c46ab26884620ba19e763d2a97b83` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:28.553576 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad7d66-83a2-4f3e-8ece-c54782a3e79c None admin] RBAC: Authorizing `identity:get_user(user_id=427c46ab26884620ba19e763d2a97b83)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:28.558364 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ad7d66-83a2-4f3e-8ece-c54782a3e79c None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:28.558364 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 74/145] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:28 2022] GET /identity/v3/users/427c46ab26884620ba19e763d2a97b83 => generated 275 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:28.560671 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d676f-2a7d-4460-b823-c88fd85f4dbf None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:28.565265 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad7d66-83a2-4f3e-8ece-c54782a3e79c None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:28.630174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874d009-f8f2-4a37-a5c9-dde60726100a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:28.630838 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874d009-f8f2-4a37-a5c9-dde60726100a None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:28.631128 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874d009-f8f2-4a37-a5c9-dde60726100a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:28.631412 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d874d009-f8f2-4a37-a5c9-dde60726100a None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:28.632117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874d009-f8f2-4a37-a5c9-dde60726100a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:28.633573 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d874d009-f8f2-4a37-a5c9-dde60726100a None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:28.673309 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 72/146] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 22:35:28 2022] POST /identity/v3/users => generated 283 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:35:28.722582 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:28.733555 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad7d66-83a2-4f3e-8ece-c54782a3e79c None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:28.779497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd30923-4894-42a6-9227-343a9ec9cae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:28.780133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd30923-4894-42a6-9227-343a9ec9cae8 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:28.780430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd30923-4894-42a6-9227-343a9ec9cae8 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:28.780712 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd30923-4894-42a6-9227-343a9ec9cae8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:28.871143 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd30923-4894-42a6-9227-343a9ec9cae8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:28.872674 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd30923-4894-42a6-9227-343a9ec9cae8 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:29.000963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:29.012094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 75/147] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 22:35:29.016960 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874d009-f8f2-4a37-a5c9-dde60726100a None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:29.131697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d874d009-f8f2-4a37-a5c9-dde60726100a None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:29.134722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:29.168878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3529dfac-7e91-442b-8cf6-ed9375c9b656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:29.169549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529dfac-7e91-442b-8cf6-ed9375c9b656 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:29.170199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529dfac-7e91-442b-8cf6-ed9375c9b656 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:29.174717 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3529dfac-7e91-442b-8cf6-ed9375c9b656 None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:29.175969 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529dfac-7e91-442b-8cf6-ed9375c9b656 None admin] RBAC: Authorizing `identity:get_project(project_id=bed1abbcdf7b4207893b683a5d6c0eb0)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:29.177436 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3529dfac-7e91-442b-8cf6-ed9375c9b656 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:29.179450 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 73/148] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:29 2022] GET /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:29.185862 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd30923-4894-42a6-9227-343a9ec9cae8 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:29.237396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502d290-7137-46eb-a8f4-ce8ccae3e2e2 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:29.237674 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502d290-7137-46eb-a8f4-ce8ccae3e2e2 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:29.238004 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502d290-7137-46eb-a8f4-ce8ccae3e2e2 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:29.239384 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 74/149] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:35:29.250207 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01666942-b8d4-406b-9282-802e45b84cba None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:29.250532 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01666942-b8d4-406b-9282-802e45b84cba None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:29.250816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01666942-b8d4-406b-9282-802e45b84cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:29.287458 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-01666942-b8d4-406b-9282-802e45b84cba None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:29.288596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-01666942-b8d4-406b-9282-802e45b84cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:29.327687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd30923-4894-42a6-9227-343a9ec9cae8 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:29.368437 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234dc1c6-0937-44ff-80ae-a8dd77701115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:29.369101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dc1c6-0937-44ff-80ae-a8dd77701115 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:29.369395 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dc1c6-0937-44ff-80ae-a8dd77701115 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:29.369675 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dc1c6-0937-44ff-80ae-a8dd77701115 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:29.370576 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234dc1c6-0937-44ff-80ae-a8dd77701115 None admin] RBAC: Adding query filter params (role.id=267b3ef4524c42bb90a7002ee1639b74, scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0, user.id=427c46ab26884620ba19e763d2a97b83) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:29.370895 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234dc1c6-0937-44ff-80ae-a8dd77701115 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:29.372788 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234dc1c6-0937-44ff-80ae-a8dd77701115 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:29.382163 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 76/150] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:35:29 2022] GET /identity/v3/role_assignments?user.id=427c46ab26884620ba19e763d2a97b83&scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0&role.id=267b3ef4524c42bb90a7002ee1639b74 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:29.422796 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 75/151] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:29.445059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234dc1c6-0937-44ff-80ae-a8dd77701115 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:29.507283 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:29.562384 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234dc1c6-0937-44ff-80ae-a8dd77701115 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:29.615581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156caba6-5269-4ef2-b74f-3c40eacc427e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:29.616315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156caba6-5269-4ef2-b74f-3c40eacc427e None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:29.616605 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156caba6-5269-4ef2-b74f-3c40eacc427e None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:29.616888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156caba6-5269-4ef2-b74f-3c40eacc427e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:29.633249 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156caba6-5269-4ef2-b74f-3c40eacc427e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:29.639673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-156caba6-5269-4ef2-b74f-3c40eacc427e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:35:29.639673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:29.639673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:29.639673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:29.639673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:29.639673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:29.639673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:29.639673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:29.639673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:29.639673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:29.639673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:29.639673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:29.639673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:29.639673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:29.639673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:29.639673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:29.640610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:29.640610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:29.640610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:29.640610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:29.640610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:29.640610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:29.640610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:29.640610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:29.640610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:29.640610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:29.640610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:29.640610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:29.640610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:29.640610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:29.640610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:29.640610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:29.641383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:29.641383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:29.641383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:29.641383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:29.641383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:29.641383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:29.641383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:29.641383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:29.641383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:29.641383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:29.641383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:35:29.641383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:29.641383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 77/152] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:35:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:29.647176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01666942-b8d4-406b-9282-802e45b84cba None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:29.748335 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:29.754893 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01666942-b8d4-406b-9282-802e45b84cba None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:29.791964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745f83b-c63e-4622-adbb-c5d652982b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:29.792612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745f83b-c63e-4622-adbb-c5d652982b94 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:29.792899 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745f83b-c63e-4622-adbb-c5d652982b94 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:29.793181 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745f83b-c63e-4622-adbb-c5d652982b94 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:29.793911 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745f83b-c63e-4622-adbb-c5d652982b94 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:29.794220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745f83b-c63e-4622-adbb-c5d652982b94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:29.795650 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745f83b-c63e-4622-adbb-c5d652982b94 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:29.805711 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 76/153] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:35:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:29.810516 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156caba6-5269-4ef2-b74f-3c40eacc427e None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:29.928696 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156caba6-5269-4ef2-b74f-3c40eacc427e None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:29.947020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:29.967322 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03771e-f8de-46f0-b67b-8a336e8f7d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:29.967982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03771e-f8de-46f0-b67b-8a336e8f7d4e None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:29.968271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03771e-f8de-46f0-b67b-8a336e8f7d4e None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:29.968553 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03771e-f8de-46f0-b67b-8a336e8f7d4e None admin] PATH_INFO: `/v3/users/427c46ab26884620ba19e763d2a97b83` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:29.969751 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03771e-f8de-46f0-b67b-8a336e8f7d4e None admin] RBAC: Authorizing `identity:get_user(user_id=427c46ab26884620ba19e763d2a97b83)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:29.971239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03771e-f8de-46f0-b67b-8a336e8f7d4e None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:29.973039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 78/154] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:29 2022] GET /identity/v3/users/427c46ab26884620ba19e763d2a97b83 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:29.978750 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745f83b-c63e-4622-adbb-c5d652982b94 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:30.011783 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17b2b6-1c7c-4361-a5a5-e6df4e41830b None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:30.012385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17b2b6-1c7c-4361-a5a5-e6df4e41830b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:30.012385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17b2b6-1c7c-4361-a5a5-e6df4e41830b None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:30.016128 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 79/155] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:30.031889 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932b8b7-769c-479b-9287-8122ba5ae13c None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:30.032399 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932b8b7-769c-479b-9287-8122ba5ae13c None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:30.032891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2932b8b7-769c-479b-9287-8122ba5ae13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:30.065301 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-2932b8b7-769c-479b-9287-8122ba5ae13c None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:30.066542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-2932b8b7-769c-479b-9287-8122ba5ae13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:30.122114 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745f83b-c63e-4622-adbb-c5d652982b94 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:30.166278 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9cb96-0bea-4515-b8a3-b6f725cd7620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:30.167986 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9cb96-0bea-4515-b8a3-b6f725cd7620 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:30.168465 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9cb96-0bea-4515-b8a3-b6f725cd7620 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:30.168925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9cb96-0bea-4515-b8a3-b6f725cd7620 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:30.171786 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 80/156] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:30.173144 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9952f8-0316-48df-8599-46ee4fcc9d08 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:30.173505 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9952f8-0316-48df-8599-46ee4fcc9d08 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:30.173862 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9952f8-0316-48df-8599-46ee4fcc9d08 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:30.175291 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 81/157] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:30.180715 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88da3b-6c9a-44b3-8929-28ee3e0ff3ab None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:30.181004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88da3b-6c9a-44b3-8929-28ee3e0ff3ab None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:30.181358 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88da3b-6c9a-44b3-8929-28ee3e0ff3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:30.203409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-fd88da3b-6c9a-44b3-8929-28ee3e0ff3ab None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:30.204720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-fd88da3b-6c9a-44b3-8929-28ee3e0ff3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:30.210734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:30.265392 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9cb96-0bea-4515-b8a3-b6f725cd7620 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:30.266933 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9cb96-0bea-4515-b8a3-b6f725cd7620 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:30.311744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 82/158] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:30.314015 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88da3b-6c9a-44b3-8929-28ee3e0ff3ab None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:30.390127 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:30.414525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 77/159] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:35:30.419190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9cb96-0bea-4515-b8a3-b6f725cd7620 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:30.481375 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:30.520538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88da3b-6c9a-44b3-8929-28ee3e0ff3ab None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:30.527353 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9cb96-0bea-4515-b8a3-b6f725cd7620 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:30.563267 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2f963-7770-495d-9446-9ee8b7c7f60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:30.563927 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2f963-7770-495d-9446-9ee8b7c7f60f None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:30.564214 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2f963-7770-495d-9446-9ee8b7c7f60f None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:30.564494 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2f963-7770-495d-9446-9ee8b7c7f60f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:30.575451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2f963-7770-495d-9446-9ee8b7c7f60f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:30.580789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-91d2f963-7770-495d-9446-9ee8b7c7f60f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:35:30.580789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:30.580789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:30.580789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:30.580789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:30.580789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:30.580789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:30.580789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:30.580789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:30.580789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:30.580789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:30.580789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:30.580789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:30.580789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:30.580789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:30.580789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:30.581640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:30.581640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:30.581640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:30.581640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:30.581640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:30.581640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:30.581640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:30.581640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:30.581640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:30.581640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:30.581640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:30.581640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:30.581640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:30.581640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:30.581640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:30.581640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:30.582452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:30.582452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:30.582452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:30.582452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:30.582452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:30.582452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:30.582452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:30.582452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:30.582452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:30.582452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:30.582452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:35:30.582452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:30.582452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 78/160] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:35:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:30.583098 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2f963-7770-495d-9446-9ee8b7c7f60f None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:30.618729 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08ab40-7e72-4b8f-92de-179f32f372ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:30.619488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08ab40-7e72-4b8f-92de-179f32f372ee None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:30.619778 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08ab40-7e72-4b8f-92de-179f32f372ee None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:30.620060 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08ab40-7e72-4b8f-92de-179f32f372ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:30.652294 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08ab40-7e72-4b8f-92de-179f32f372ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:30.657507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-2d08ab40-7e72-4b8f-92de-179f32f372ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 22:35:30.657507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:30.657507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:30.657507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:30.657507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:30.657507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:30.657507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:30.657507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:30.657507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:30.657507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:30.657507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:30.657507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:30.657507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:30.657507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:30.657507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:30.657507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:30.658497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:30.658497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:30.658497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:30.658497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:30.658497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:30.658497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:30.658497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:30.658497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:30.658497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:30.658497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:30.658497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:30.658497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:30.658497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:30.658497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:30.658497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:30.658497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:30.659280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:30.659280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:30.659280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:30.659280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:30.659280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:30.659280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:30.659280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:30.659280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:30.659280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:30.659280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:30.659280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 22:35:30.659280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:30.665116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 83/161] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:30.665630 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08ab40-7e72-4b8f-92de-179f32f372ee None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:30.693794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2f963-7770-495d-9446-9ee8b7c7f60f None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:30.721455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:30.738847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c89f1-ce5b-432b-a534-8bb2ccf505c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:30.739531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c89f1-ce5b-432b-a534-8bb2ccf505c7 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:30.739828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c89f1-ce5b-432b-a534-8bb2ccf505c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:30.740113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c89f1-ce5b-432b-a534-8bb2ccf505c7 None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:30.742631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c89f1-ce5b-432b-a534-8bb2ccf505c7 None admin] RBAC: Authorizing `identity:get_project(project_id=bed1abbcdf7b4207893b683a5d6c0eb0)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:30.744662 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c89f1-ce5b-432b-a534-8bb2ccf505c7 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:30.746422 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 79/162] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:30 2022] GET /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:30.751251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c89f1-ce5b-432b-a534-8bb2ccf505c7 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:30.859657 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c89f1-ce5b-432b-a534-8bb2ccf505c7 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:30.897152 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa772038-6e76-4247-9595-3913db9cf5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:30.897795 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa772038-6e76-4247-9595-3913db9cf5a3 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:30.898203 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa772038-6e76-4247-9595-3913db9cf5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:30.898524 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa772038-6e76-4247-9595-3913db9cf5a3 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:30.899384 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa772038-6e76-4247-9595-3913db9cf5a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:30.899744 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa772038-6e76-4247-9595-3913db9cf5a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:30.901359 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa772038-6e76-4247-9595-3913db9cf5a3 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:30.910280 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 80/163] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:30.915331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa772038-6e76-4247-9595-3913db9cf5a3 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:30.917440 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08ab40-7e72-4b8f-92de-179f32f372ee None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:30.920185 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:30.977124 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544275b-e24b-4923-abf6-eae51eae42b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:30.977755 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544275b-e24b-4923-abf6-eae51eae42b7 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:30.978045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544275b-e24b-4923-abf6-eae51eae42b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:30.978324 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544275b-e24b-4923-abf6-eae51eae42b7 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:30.986780 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:30.987171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544275b-e24b-4923-abf6-eae51eae42b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:30.987498 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544275b-e24b-4923-abf6-eae51eae42b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:30.988959 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544275b-e24b-4923-abf6-eae51eae42b7 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:30.998111 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 84/164] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:31.007247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544275b-e24b-4923-abf6-eae51eae42b7 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:31.029571 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa772038-6e76-4247-9595-3913db9cf5a3 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:31.066691 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c55ed9-4586-4f21-a551-edc798b1b5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:31.067689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c55ed9-4586-4f21-a551-edc798b1b5f6 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:31.068193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c55ed9-4586-4f21-a551-edc798b1b5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:31.068687 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c55ed9-4586-4f21-a551-edc798b1b5f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:31.069698 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c55ed9-4586-4f21-a551-edc798b1b5f6 None admin] RBAC: Adding query filter params (role.id=d4ee54c077084dcea38d7476927b61df, scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0, user.id=427c46ab26884620ba19e763d2a97b83) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:31.070232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c55ed9-4586-4f21-a551-edc798b1b5f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:31.072186 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c55ed9-4586-4f21-a551-edc798b1b5f6 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:31.078924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 81/165] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:35:30 2022] GET /identity/v3/role_assignments?user.id=427c46ab26884620ba19e763d2a97b83&scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0&role.id=d4ee54c077084dcea38d7476927b61df => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:31.080667 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd501354-a7ac-41b2-b10c-a569b3fe8d19 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:31.081160 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd501354-a7ac-41b2-b10c-a569b3fe8d19 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:31.081640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd501354-a7ac-41b2-b10c-a569b3fe8d19 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:31.083305 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 82/166] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:31.084462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd501354-a7ac-41b2-b10c-a569b3fe8d19 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:31.192605 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544275b-e24b-4923-abf6-eae51eae42b7 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:31.211753 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd501354-a7ac-41b2-b10c-a569b3fe8d19 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:31.229079 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:31.280423 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b932cc-2a62-4e78-aaba-92454674aca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:31.281448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b932cc-2a62-4e78-aaba-92454674aca4 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:31.282551 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b932cc-2a62-4e78-aaba-92454674aca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:31.283055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b932cc-2a62-4e78-aaba-92454674aca4 None admin] PATH_INFO: `/v3/users/823fd54d00af495593a275a61c2223da` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:31.287121 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b932cc-2a62-4e78-aaba-92454674aca4 None admin] RBAC: Authorizing `identity:get_user(user_id=823fd54d00af495593a275a61c2223da)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:31.289043 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b932cc-2a62-4e78-aaba-92454674aca4 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:31.291823 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 83/167] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:31 2022] GET /identity/v3/users/823fd54d00af495593a275a61c2223da => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:31.293524 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb19d4-3471-438f-b016-c690eb1e3d02 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:31.294014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb19d4-3471-438f-b016-c690eb1e3d02 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:31.294536 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb19d4-3471-438f-b016-c690eb1e3d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:31.318201 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77484c40-07f6-40d0-8846-92ba4f787b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:31.318909 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77484c40-07f6-40d0-8846-92ba4f787b1f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:31.319196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77484c40-07f6-40d0-8846-92ba4f787b1f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:31.319478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77484c40-07f6-40d0-8846-92ba4f787b1f None admin] PATH_INFO: `/v3/users/0c3c47d36ee64327bc553ab61276989c` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:31.325652 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77484c40-07f6-40d0-8846-92ba4f787b1f None admin] RBAC: Authorizing `identity:get_user(user_id=0c3c47d36ee64327bc553ab61276989c)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:31.325652 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77484c40-07f6-40d0-8846-92ba4f787b1f None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:31.325652 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 85/168] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:30 2022] GET /identity/v3/users/0c3c47d36ee64327bc553ab61276989c => generated 289 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:31.326638 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77484c40-07f6-40d0-8846-92ba4f787b1f None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:31.330108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-17fb19d4-3471-438f-b016-c690eb1e3d02 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:31.331670 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-17fb19d4-3471-438f-b016-c690eb1e3d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:31.392309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:31.463393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 84/169] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:31.464267 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb19d4-3471-438f-b016-c690eb1e3d02 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:31.558215 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77484c40-07f6-40d0-8846-92ba4f787b1f None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:31.607472 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb19d4-3471-438f-b016-c690eb1e3d02 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:31.617230 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:31.643613 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80b8d6-bcd1-4818-8718-d1dbbd26b2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:31.644265 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80b8d6-bcd1-4818-8718-d1dbbd26b2b9 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:31.644550 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80b8d6-bcd1-4818-8718-d1dbbd26b2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:31.644827 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80b8d6-bcd1-4818-8718-d1dbbd26b2b9 None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:31.646003 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80b8d6-bcd1-4818-8718-d1dbbd26b2b9 None admin] RBAC: Authorizing `identity:get_project(project_id=bed1abbcdf7b4207893b683a5d6c0eb0)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:31.647491 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80b8d6-bcd1-4818-8718-d1dbbd26b2b9 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:31.649167 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 85/170] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:31 2022] GET /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:31.650031 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80b8d6-bcd1-4818-8718-d1dbbd26b2b9 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:31.659036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9ff26-5efb-4da9-b3b9-0e5649a59c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:31.659676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9ff26-5efb-4da9-b3b9-0e5649a59c61 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:31.659960 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9ff26-5efb-4da9-b3b9-0e5649a59c61 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:31.660241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9ff26-5efb-4da9-b3b9-0e5649a59c61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:31.760341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80b8d6-bcd1-4818-8718-d1dbbd26b2b9 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:31.796717 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4545770-5464-41de-bd47-fe80d94c356f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:31.797374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4545770-5464-41de-bd47-fe80d94c356f None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:31.797663 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4545770-5464-41de-bd47-fe80d94c356f None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:31.798046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4545770-5464-41de-bd47-fe80d94c356f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:31.810143 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4545770-5464-41de-bd47-fe80d94c356f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:31.815103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-f4545770-5464-41de-bd47-fe80d94c356f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:31.815103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:31.815103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:31.815103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:31.815103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:31.815103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:31.815103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:31.815103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:31.815103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:31.815103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:31.815103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:31.815103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:31.815103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:31.815103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:31.815103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:31.815103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:31.816007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:31.816007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:31.816007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:31.816007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:31.816007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:31.816007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:31.816007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:31.816007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:31.816007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:31.816007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:31.816007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:31.816007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:31.816007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:31.816007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:31.816007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:31.816007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:31.816885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:31.816885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:31.816885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:31.816885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:31.816885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:31.816885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:31.816885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:31.816885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:31.816885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:31.816885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:31.816885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:31.816885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:31.816885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 86/171] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:31.817555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4545770-5464-41de-bd47-fe80d94c356f None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:31.849367 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9ff26-5efb-4da9-b3b9-0e5649a59c61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:31.851085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9ff26-5efb-4da9-b3b9-0e5649a59c61 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:31.892446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:31.912804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:32.003286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4545770-5464-41de-bd47-fe80d94c356f None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:32.024479 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 86/172] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 698 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:35:32.026289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9ff26-5efb-4da9-b3b9-0e5649a59c61 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:32.061068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3205e-c4f8-4e27-a2db-465b3a4f8f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:32.061674 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3205e-c4f8-4e27-a2db-465b3a4f8f3e None admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:32.061961 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3205e-c4f8-4e27-a2db-465b3a4f8f3e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:32.062240 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3205e-c4f8-4e27-a2db-465b3a4f8f3e None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0/users/0c3c47d36ee64327bc553ab61276989c/roles/6408c231c0fe422fa2f095c2c8fd7a9e` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:32.064396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3205e-c4f8-4e27-a2db-465b3a4f8f3e None admin] RBAC: Authorizing `identity:create_grant(project_id=bed1abbcdf7b4207893b683a5d6c0eb0, user_id=0c3c47d36ee64327bc553ab61276989c, role_id=6408c231c0fe422fa2f095c2c8fd7a9e)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:32.066169 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3205e-c4f8-4e27-a2db-465b3a4f8f3e None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:32.083343 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 87/173] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:35:31 2022] PUT /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0/users/0c3c47d36ee64327bc553ab61276989c/roles/6408c231c0fe422fa2f095c2c8fd7a9e => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:35:32.084934 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3205e-c4f8-4e27-a2db-465b3a4f8f3e None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:32.212488 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:32.221098 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3205e-c4f8-4e27-a2db-465b3a4f8f3e None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:32.257850 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9ff26-5efb-4da9-b3b9-0e5649a59c61 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:32.266177 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ed8d9-2700-4cfe-882b-d02ce499d07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:32.267087 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ed8d9-2700-4cfe-882b-d02ce499d07f None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:32.267549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ed8d9-2700-4cfe-882b-d02ce499d07f None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:32.267972 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ed8d9-2700-4cfe-882b-d02ce499d07f None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:32.269829 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ed8d9-2700-4cfe-882b-d02ce499d07f None admin] RBAC: Authorizing `identity:get_project(project_id=bed1abbcdf7b4207893b683a5d6c0eb0)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:32.271539 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ed8d9-2700-4cfe-882b-d02ce499d07f None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:32.273446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 88/174] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:32 2022] GET /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:32.279875 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ed8d9-2700-4cfe-882b-d02ce499d07f None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:32.357872 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b581d9a-453b-4808-993a-c7caaf350e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:32.358460 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581d9a-453b-4808-993a-c7caaf350e4b None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:32.358756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581d9a-453b-4808-993a-c7caaf350e4b None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:32.359038 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b581d9a-453b-4808-993a-c7caaf350e4b None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:32.359841 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b581d9a-453b-4808-993a-c7caaf350e4b None admin] RBAC: Adding query filter params (name=member) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:32.360087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b581d9a-453b-4808-993a-c7caaf350e4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:32.361548 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b581d9a-453b-4808-993a-c7caaf350e4b None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:32.363065 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:32.380648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 87/175] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:32.387408 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b581d9a-453b-4808-993a-c7caaf350e4b None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:32.418484 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ed8d9-2700-4cfe-882b-d02ce499d07f None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:32.455293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2a9a6-5c28-4094-a538-7cf90302ea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:32.455926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2a9a6-5c28-4094-a538-7cf90302ea12 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:32.456212 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2a9a6-5c28-4094-a538-7cf90302ea12 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:32.456494 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f2a9a6-5c28-4094-a538-7cf90302ea12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:32.457297 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2a9a6-5c28-4094-a538-7cf90302ea12 None admin] RBAC: Adding query filter params (role.id=49e0ba8d8c9f4824892b61f05d0036e8, scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0, user.id=823fd54d00af495593a275a61c2223da) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:32.457615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2a9a6-5c28-4094-a538-7cf90302ea12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:32.459104 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f2a9a6-5c28-4094-a538-7cf90302ea12 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:32.465354 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 89/176] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:35:32 2022] GET /identity/v3/role_assignments?user.id=823fd54d00af495593a275a61c2223da&scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0&role.id=49e0ba8d8c9f4824892b61f05d0036e8 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:32.538369 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b581d9a-453b-4808-993a-c7caaf350e4b None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:32.582317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfef9eb-b569-4ed4-a7e9-de6e0e397ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:32.583030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfef9eb-b569-4ed4-a7e9-de6e0e397ce4 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:32.583321 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfef9eb-b569-4ed4-a7e9-de6e0e397ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:32.583739 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfef9eb-b569-4ed4-a7e9-de6e0e397ce4 None admin] PATH_INFO: `/v3/users/427c46ab26884620ba19e763d2a97b83` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:32.584961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfef9eb-b569-4ed4-a7e9-de6e0e397ce4 None admin] RBAC: Authorizing `identity:get_user(user_id=427c46ab26884620ba19e763d2a97b83)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:32.586963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfef9eb-b569-4ed4-a7e9-de6e0e397ce4 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:32.588302 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 88/177] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:32 2022] GET /identity/v3/users/427c46ab26884620ba19e763d2a97b83 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:32.593904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2a9a6-5c28-4094-a538-7cf90302ea12 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:32.641842 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:32.702653 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b8bea-ff76-408b-b2d2-d9f5073f3e1f None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:32.702990 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b8bea-ff76-408b-b2d2-d9f5073f3e1f None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:32.703229 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b8bea-ff76-408b-b2d2-d9f5073f3e1f None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:32.704701 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 89/178] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:35:32.716206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc760ee-7828-4135-9bca-dba59936cb4b None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:32.716497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc760ee-7828-4135-9bca-dba59936cb4b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:32.716780 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc760ee-7828-4135-9bca-dba59936cb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:32.724946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f2a9a6-5c28-4094-a538-7cf90302ea12 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:32.763542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-dcc760ee-7828-4135-9bca-dba59936cb4b None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:32.764881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-dcc760ee-7828-4135-9bca-dba59936cb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:32.767345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39475809-8c24-4867-b9f8-eed96fc11ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:32.767988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39475809-8c24-4867-b9f8-eed96fc11ad1 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:32.768276 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39475809-8c24-4867-b9f8-eed96fc11ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:32.768553 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39475809-8c24-4867-b9f8-eed96fc11ad1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:32.843258 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39475809-8c24-4867-b9f8-eed96fc11ad1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:32.850373 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39475809-8c24-4867-b9f8-eed96fc11ad1 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:32.873934 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:32.884024 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:32.909097 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 90/179] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:32.946465 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206df5de-2a6a-4247-b2c6-ec0ac9050363 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:32.947157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206df5de-2a6a-4247-b2c6-ec0ac9050363 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:32.947636 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206df5de-2a6a-4247-b2c6-ec0ac9050363 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:32.949216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 91/180] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:32.950125 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206df5de-2a6a-4247-b2c6-ec0ac9050363 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:32.957599 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 90/181] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:35:32.959621 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f632af-7d29-4d47-8451-3a20f0b94af4 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:32.959916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f632af-7d29-4d47-8451-3a20f0b94af4 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:32.960199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f632af-7d29-4d47-8451-3a20f0b94af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:32.983515 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-87f632af-7d29-4d47-8451-3a20f0b94af4 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:32.985559 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-87f632af-7d29-4d47-8451-3a20f0b94af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:33.070488 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 91/182] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:33.071399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f632af-7d29-4d47-8451-3a20f0b94af4 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:33.088912 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206df5de-2a6a-4247-b2c6-ec0ac9050363 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:33.130778 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a27cef-7b71-4da5-9342-e873768b6e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:33.131440 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a27cef-7b71-4da5-9342-e873768b6e2a None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:33.132038 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a27cef-7b71-4da5-9342-e873768b6e2a None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:33.132332 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a27cef-7b71-4da5-9342-e873768b6e2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:33.146079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a27cef-7b71-4da5-9342-e873768b6e2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:33.147825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:33.153491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-e2a27cef-7b71-4da5-9342-e873768b6e2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:35:33.153491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:33.153491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:33.153491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:33.153491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:33.153491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:33.153491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:33.153491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:33.153491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:33.153491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:33.153491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:33.153491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:33.153491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:33.153491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:33.153491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:33.153491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:33.154393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:33.154393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:33.154393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:33.154393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:33.154393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:33.154393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:33.154393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:33.154393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:33.154393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:33.154393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:33.154393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:33.154393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:33.154393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:33.154393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:33.154393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:33.154393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:33.155820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:33.155820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:33.155820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:33.155820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:33.155820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:33.155820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:33.155820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:33.155820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:33.155820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:33.155820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:33.155820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:35:33.155820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:33.155820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 92/183] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:35:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:33.155820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a27cef-7b71-4da5-9342-e873768b6e2a None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:33.199641 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f632af-7d29-4d47-8451-3a20f0b94af4 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:33.223606 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:33.239056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107875a-2bb5-4116-acb1-63426594d424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:33.239717 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107875a-2bb5-4116-acb1-63426594d424 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:33.240006 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107875a-2bb5-4116-acb1-63426594d424 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:33.240290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107875a-2bb5-4116-acb1-63426594d424 None admin] PATH_INFO: `/v3/projects/16d8cbbdba6446f8bfe3c400861ae2f3` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:33.241848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107875a-2bb5-4116-acb1-63426594d424 None admin] RBAC: Authorizing `identity:get_project(project_id=16d8cbbdba6446f8bfe3c400861ae2f3)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:33.243224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107875a-2bb5-4116-acb1-63426594d424 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:33.244916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 92/184] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:33 2022] GET /identity/v3/projects/16d8cbbdba6446f8bfe3c400861ae2f3 => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:33.250415 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107875a-2bb5-4116-acb1-63426594d424 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:33.273876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a27cef-7b71-4da5-9342-e873768b6e2a None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:33.308903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db70cfc9-5129-455d-a98d-3ee052e2744c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:33.309546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70cfc9-5129-455d-a98d-3ee052e2744c None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:33.309834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70cfc9-5129-455d-a98d-3ee052e2744c None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:33.310110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70cfc9-5129-455d-a98d-3ee052e2744c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:33.311288 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70cfc9-5129-455d-a98d-3ee052e2744c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:33.312867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db70cfc9-5129-455d-a98d-3ee052e2744c None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:33.314461 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 93/185] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:35:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:33.320056 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29081d13-b67c-45d5-8fba-b50656497909 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:33.320935 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29081d13-b67c-45d5-8fba-b50656497909 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:33.321619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29081d13-b67c-45d5-8fba-b50656497909 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:33.323809 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 94/186] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:33.324919 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29081d13-b67c-45d5-8fba-b50656497909 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:33.360401 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107875a-2bb5-4116-acb1-63426594d424 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:33.387783 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:33.397733 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e62f7a-9ce9-4f4c-a799-d6e3ede6c6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:33.398626 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e62f7a-9ce9-4f4c-a799-d6e3ede6c6b3 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:33.398918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e62f7a-9ce9-4f4c-a799-d6e3ede6c6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:33.399196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e62f7a-9ce9-4f4c-a799-d6e3ede6c6b3 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:33.399915 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e62f7a-9ce9-4f4c-a799-d6e3ede6c6b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:33.401084 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e62f7a-9ce9-4f4c-a799-d6e3ede6c6b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:33.402505 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e62f7a-9ce9-4f4c-a799-d6e3ede6c6b3 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:33.411497 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 93/187] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:33.412276 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e62f7a-9ce9-4f4c-a799-d6e3ede6c6b3 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:33.438560 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29081d13-b67c-45d5-8fba-b50656497909 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:33.464454 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:33.477404 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddef3fc-d231-4ad4-a85c-ea8573e6a399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:33.478032 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddef3fc-d231-4ad4-a85c-ea8573e6a399 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:33.478335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddef3fc-d231-4ad4-a85c-ea8573e6a399 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:33.478643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddef3fc-d231-4ad4-a85c-ea8573e6a399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:33.479439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddef3fc-d231-4ad4-a85c-ea8573e6a399 None admin] RBAC: Adding query filter params (role.id=267b3ef4524c42bb90a7002ee1639b74, scope.project.id=16d8cbbdba6446f8bfe3c400861ae2f3, user.id=427c46ab26884620ba19e763d2a97b83) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:33.479751 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddef3fc-d231-4ad4-a85c-ea8573e6a399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:33.481186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddef3fc-d231-4ad4-a85c-ea8573e6a399 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:33.487504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 95/188] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:35:33 2022] GET /identity/v3/role_assignments?user.id=427c46ab26884620ba19e763d2a97b83&scope.project.id=16d8cbbdba6446f8bfe3c400861ae2f3&role.id=267b3ef4524c42bb90a7002ee1639b74 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:33.496074 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c31d94-f8c2-4d5e-a4f7-e62cf6ef0d88 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:33.497113 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c31d94-f8c2-4d5e-a4f7-e62cf6ef0d88 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:33.497582 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c31d94-f8c2-4d5e-a4f7-e62cf6ef0d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:33.519066 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e62f7a-9ce9-4f4c-a799-d6e3ede6c6b3 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:33.524101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-33c31d94-f8c2-4d5e-a4f7-e62cf6ef0d88 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:33.526215 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-33c31d94-f8c2-4d5e-a4f7-e62cf6ef0d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:33.560309 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d7727-1c6a-4581-a7bd-dd5f556c07ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:33.561170 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d7727-1c6a-4581-a7bd-dd5f556c07ee None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:33.561526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d7727-1c6a-4581-a7bd-dd5f556c07ee None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:33.561863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d7727-1c6a-4581-a7bd-dd5f556c07ee None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:33.563107 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d7727-1c6a-4581-a7bd-dd5f556c07ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:33.564688 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d7727-1c6a-4581-a7bd-dd5f556c07ee None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:33.606381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 94/189] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 22:35:33 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:35:33.606381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d7727-1c6a-4581-a7bd-dd5f556c07ee None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:33.646918 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 96/190] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:33.677106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c31d94-f8c2-4d5e-a4f7-e62cf6ef0d88 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:33.690133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:33.764832 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d7727-1c6a-4581-a7bd-dd5f556c07ee None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:33.811305 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74397696-950a-4ede-be04-5c4d40ec3d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:33.811526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74397696-950a-4ede-be04-5c4d40ec3d33 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:33.811771 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74397696-950a-4ede-be04-5c4d40ec3d33 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:33.812241 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74397696-950a-4ede-be04-5c4d40ec3d33 None admin] PATH_INFO: `/v3/users/e35e5b5f9a4349beb91c29f848414550` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:33.827055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c31d94-f8c2-4d5e-a4f7-e62cf6ef0d88 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:33.833847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74397696-950a-4ede-be04-5c4d40ec3d33 None admin] RBAC: Authorizing `identity:get_user(user_id=e35e5b5f9a4349beb91c29f848414550)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:33.835354 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74397696-950a-4ede-be04-5c4d40ec3d33 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:33.837244 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 95/191] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:33 2022] GET /identity/v3/users/e35e5b5f9a4349beb91c29f848414550 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:33.848938 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74397696-950a-4ede-be04-5c4d40ec3d33 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:33.850292 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:33.875243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c13fc-bf17-4b25-8321-6236dbed5f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:33.875900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c13fc-bf17-4b25-8321-6236dbed5f2a None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:33.876306 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c13fc-bf17-4b25-8321-6236dbed5f2a None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:33.876591 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c13fc-bf17-4b25-8321-6236dbed5f2a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:33.894966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6c13fc-bf17-4b25-8321-6236dbed5f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:33.900064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-8a6c13fc-bf17-4b25-8321-6236dbed5f2a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:35:33.900064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:33.900064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:33.900064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:33.900064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:33.900064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:33.900064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:33.900064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:33.900064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:33.900064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:33.900064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:33.900064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:33.900064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:33.900064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:33.900064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:33.900064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:33.900979 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:33.900979 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:33.900979 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:33.900979 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:33.900979 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:33.900979 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:33.900979 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:33.900979 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:33.900979 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:33.900979 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:33.900979 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:33.900979 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:33.900979 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:33.900979 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:33.900979 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:33.900979 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:33.901787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:33.901787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:33.901787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:33.901787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:33.901787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:33.901787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:33.901787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:33.901787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:33.901787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:33.901787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:33.901787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:35:33.901787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:33.901787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 97/192] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:35:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:35:33.907934 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c13fc-bf17-4b25-8321-6236dbed5f2a None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:33.985430 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74397696-950a-4ede-be04-5c4d40ec3d33 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:33.988338 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:34.034455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a679677-c465-48fd-9445-6bc24663e049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:34.035928 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a679677-c465-48fd-9445-6bc24663e049 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:34.035928 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a679677-c465-48fd-9445-6bc24663e049 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:34.035928 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a679677-c465-48fd-9445-6bc24663e049 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:34.064524 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c13fc-bf17-4b25-8321-6236dbed5f2a None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:34.108232 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586b776-73b0-40e9-8bec-6517dbf944e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:34.109081 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586b776-73b0-40e9-8bec-6517dbf944e8 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:34.109367 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586b776-73b0-40e9-8bec-6517dbf944e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:34.109645 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586b776-73b0-40e9-8bec-6517dbf944e8 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:34.110392 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586b776-73b0-40e9-8bec-6517dbf944e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:34.110701 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586b776-73b0-40e9-8bec-6517dbf944e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:34.112553 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586b776-73b0-40e9-8bec-6517dbf944e8 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:34.128022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 98/193] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:35:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:34.130232 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586b776-73b0-40e9-8bec-6517dbf944e8 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:34.135963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a679677-c465-48fd-9445-6bc24663e049 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:34.137447 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a679677-c465-48fd-9445-6bc24663e049 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:34.180117 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:34.265340 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 96/194] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 22:35:34.272161 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a679677-c465-48fd-9445-6bc24663e049 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:34.274394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:34.288463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586b776-73b0-40e9-8bec-6517dbf944e8 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:34.342351 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac90861-ec56-418c-b139-d84e071eb94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:34.343009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac90861-ec56-418c-b139-d84e071eb94d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:34.343336 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac90861-ec56-418c-b139-d84e071eb94d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:34.343619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac90861-ec56-418c-b139-d84e071eb94d None admin] PATH_INFO: `/v3/users/e35e5b5f9a4349beb91c29f848414550` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:34.344852 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac90861-ec56-418c-b139-d84e071eb94d None admin] RBAC: Authorizing `identity:get_user(user_id=e35e5b5f9a4349beb91c29f848414550)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:34.346303 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac90861-ec56-418c-b139-d84e071eb94d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:34.348125 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 99/195] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:34 2022] GET /identity/v3/users/e35e5b5f9a4349beb91c29f848414550 => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:34.353430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac90861-ec56-418c-b139-d84e071eb94d None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:34.401054 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a679677-c465-48fd-9445-6bc24663e049 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:34.441716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5744473-e3d9-4275-9d67-4c30eb498fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:34.442281 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5744473-e3d9-4275-9d67-4c30eb498fa4 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:34.442589 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5744473-e3d9-4275-9d67-4c30eb498fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:34.442862 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5744473-e3d9-4275-9d67-4c30eb498fa4 None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:34.444316 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5744473-e3d9-4275-9d67-4c30eb498fa4 None admin] RBAC: Authorizing `identity:get_project(project_id=4e0a8c4e892848b4a8d4fea9a731c82c)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:34.445782 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5744473-e3d9-4275-9d67-4c30eb498fa4 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:34.447824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 97/196] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:34 2022] GET /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:34.453769 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5744473-e3d9-4275-9d67-4c30eb498fa4 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:34.475392 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac90861-ec56-418c-b139-d84e071eb94d None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:34.485911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:34.542888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41691031-07cf-47cd-818a-a2a1fa6ab7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:34.544034 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41691031-07cf-47cd-818a-a2a1fa6ab7e2 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:34.544312 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41691031-07cf-47cd-818a-a2a1fa6ab7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:34.544676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41691031-07cf-47cd-818a-a2a1fa6ab7e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:34.554895 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:34.589660 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5744473-e3d9-4275-9d67-4c30eb498fa4 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:34.632474 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df2970c-b008-4a91-912f-37787fe7fee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:34.633328 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2970c-b008-4a91-912f-37787fe7fee9 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:34.633801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2970c-b008-4a91-912f-37787fe7fee9 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:34.634220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df2970c-b008-4a91-912f-37787fe7fee9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:34.635218 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2970c-b008-4a91-912f-37787fe7fee9 None admin] RBAC: Adding query filter params (role.id=49e0ba8d8c9f4824892b61f05d0036e8, scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c, user.id=e35e5b5f9a4349beb91c29f848414550) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:34.635806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2970c-b008-4a91-912f-37787fe7fee9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:34.637485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df2970c-b008-4a91-912f-37787fe7fee9 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:34.639058 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41691031-07cf-47cd-818a-a2a1fa6ab7e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:34.641493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41691031-07cf-47cd-818a-a2a1fa6ab7e2 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:34.644299 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 98/197] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:35:34 2022] GET /identity/v3/role_assignments?user.id=e35e5b5f9a4349beb91c29f848414550&scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c&role.id=49e0ba8d8c9f4824892b61f05d0036e8 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:34.645852 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821e5a7-f53d-4248-83b5-fb39cec9cd2e None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:34.646288 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821e5a7-f53d-4248-83b5-fb39cec9cd2e None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:34.646748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5821e5a7-f53d-4248-83b5-fb39cec9cd2e None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:34.648199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 99/198] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:34.654637 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57359453-7f21-467c-90e0-a13f9e72b5e6 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:34.655182 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57359453-7f21-467c-90e0-a13f9e72b5e6 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:34.655715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57359453-7f21-467c-90e0-a13f9e72b5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:34.695497 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-57359453-7f21-467c-90e0-a13f9e72b5e6 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:34.696737 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-57359453-7f21-467c-90e0-a13f9e72b5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:34.791849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 100/199] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 22:35:34.797890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41691031-07cf-47cd-818a-a2a1fa6ab7e2 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:34.813025 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:34.845536 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 100/200] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:34.870219 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57359453-7f21-467c-90e0-a13f9e72b5e6 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:34.931653 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41691031-07cf-47cd-818a-a2a1fa6ab7e2 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:34.938660 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:34.968813 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0374c6-b478-4055-9d39-4ce85cab26ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:34.969461 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0374c6-b478-4055-9d39-4ce85cab26ac None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:34.969747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0374c6-b478-4055-9d39-4ce85cab26ac None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:34.970025 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0374c6-b478-4055-9d39-4ce85cab26ac None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:34.971236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0374c6-b478-4055-9d39-4ce85cab26ac None admin] RBAC: Authorizing `identity:get_project(project_id=4e0a8c4e892848b4a8d4fea9a731c82c)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:34.972804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0374c6-b478-4055-9d39-4ce85cab26ac None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:34.974786 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 101/201] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:34 2022] GET /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:34.980390 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0374c6-b478-4055-9d39-4ce85cab26ac None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:34.984272 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57359453-7f21-467c-90e0-a13f9e72b5e6 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:35.020537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50051292-01f3-4a64-8e5a-486acb4a3b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:35.021393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50051292-01f3-4a64-8e5a-486acb4a3b41 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:35.021771 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50051292-01f3-4a64-8e5a-486acb4a3b41 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:35.022520 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50051292-01f3-4a64-8e5a-486acb4a3b41 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:35.033673 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50051292-01f3-4a64-8e5a-486acb4a3b41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:35.039048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-50051292-01f3-4a64-8e5a-486acb4a3b41 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 22:35:35.039048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:35.039048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:35.039048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:35.039048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:35.039048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:35.039048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:35.039048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:35.039048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:35.039048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:35.039048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:35.039048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:35.039048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:35.039048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:35.039048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:35.039048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:35.040196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:35.040196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:35.040196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:35.040196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:35.040196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:35.040196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:35.040196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:35.040196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:35.040196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:35.040196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:35.040196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:35.040196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:35.040196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:35.040196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:35.040196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:35.040196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:35.041106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:35.041106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:35.041106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:35.041106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:35.041106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:35.041106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:35.041106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:35.041106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:35.041106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:35.041106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:35.041106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 22:35:35.041106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:35.042009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 101/202] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:35.047144 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50051292-01f3-4a64-8e5a-486acb4a3b41 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:35.062562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:35.089875 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0374c6-b478-4055-9d39-4ce85cab26ac None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:35.124810 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bdc88-844b-4c01-ba13-ea14bb796dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:35.125787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bdc88-844b-4c01-ba13-ea14bb796dd6 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:35.126247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bdc88-844b-4c01-ba13-ea14bb796dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:35.126725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bdc88-844b-4c01-ba13-ea14bb796dd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:35.127773 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427bdc88-844b-4c01-ba13-ea14bb796dd6 None admin] RBAC: Adding query filter params (role.id=d4ee54c077084dcea38d7476927b61df, scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c, user.id=e35e5b5f9a4349beb91c29f848414550) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:35.128339 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427bdc88-844b-4c01-ba13-ea14bb796dd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:35.130076 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427bdc88-844b-4c01-ba13-ea14bb796dd6 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:35.136656 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 102/203] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:35:34 2022] GET /identity/v3/role_assignments?user.id=e35e5b5f9a4349beb91c29f848414550&scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c&role.id=d4ee54c077084dcea38d7476927b61df => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:35.164873 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50051292-01f3-4a64-8e5a-486acb4a3b41 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:35.206752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:35.224963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdfac6-6372-41d1-a8c6-8e252c05eb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:35.225631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdfac6-6372-41d1-a8c6-8e252c05eb78 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:35.225922 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdfac6-6372-41d1-a8c6-8e252c05eb78 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:35.226202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdfac6-6372-41d1-a8c6-8e252c05eb78 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:35.226978 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdfac6-6372-41d1-a8c6-8e252c05eb78 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:35.227296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdfac6-6372-41d1-a8c6-8e252c05eb78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:35.228832 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdfac6-6372-41d1-a8c6-8e252c05eb78 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:35.239562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 102/204] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:35.248263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bdc88-844b-4c01-ba13-ea14bb796dd6 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:35.401526 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bdc88-844b-4c01-ba13-ea14bb796dd6 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:35.446952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b50b2-1bae-43e4-aa36-628eb764f289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:35.448180 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b50b2-1bae-43e4-aa36-628eb764f289 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:35.448469 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b50b2-1bae-43e4-aa36-628eb764f289 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:35.448753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b50b2-1bae-43e4-aa36-628eb764f289 None admin] PATH_INFO: `/v3/users/0c3c47d36ee64327bc553ab61276989c` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:35.449952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b50b2-1bae-43e4-aa36-628eb764f289 None admin] RBAC: Authorizing `identity:get_user(user_id=0c3c47d36ee64327bc553ab61276989c)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:35.451716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b50b2-1bae-43e4-aa36-628eb764f289 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:35.453499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 103/205] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:35 2022] GET /identity/v3/users/0c3c47d36ee64327bc553ab61276989c => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:35.458868 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdfac6-6372-41d1-a8c6-8e252c05eb78 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:35.584668 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdfac6-6372-41d1-a8c6-8e252c05eb78 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:35.635218 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ba512-a490-4a5b-b1b6-3f5beadf912a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:35.635850 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ba512-a490-4a5b-b1b6-3f5beadf912a None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:35.636138 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ba512-a490-4a5b-b1b6-3f5beadf912a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:35.636419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ba512-a490-4a5b-b1b6-3f5beadf912a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:35.712265 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:35.730573 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ba512-a490-4a5b-b1b6-3f5beadf912a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:35.732071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ba512-a490-4a5b-b1b6-3f5beadf912a None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:35.858226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 103/206] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:35:35.863758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b50b2-1bae-43e4-aa36-628eb764f289 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:35.873454 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:35.990113 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b50b2-1bae-43e4-aa36-628eb764f289 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:36.030433 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc86aad-6294-471e-9bfe-e6fd73ce5545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:36.031456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc86aad-6294-471e-9bfe-e6fd73ce5545 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:36.031940 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc86aad-6294-471e-9bfe-e6fd73ce5545 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:36.032429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc86aad-6294-471e-9bfe-e6fd73ce5545 None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:36.039047 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc86aad-6294-471e-9bfe-e6fd73ce5545 None admin] RBAC: Authorizing `identity:get_project(project_id=bed1abbcdf7b4207893b683a5d6c0eb0)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:36.040817 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc86aad-6294-471e-9bfe-e6fd73ce5545 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:36.043559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 104/207] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:35 2022] GET /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:36.050744 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ba512-a490-4a5b-b1b6-3f5beadf912a None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:36.188717 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:36.209971 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ba512-a490-4a5b-b1b6-3f5beadf912a None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:36.254989 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13fea2-2a5c-43ae-a393-1b60883c7015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:36.255542 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13fea2-2a5c-43ae-a393-1b60883c7015 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:36.255825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13fea2-2a5c-43ae-a393-1b60883c7015 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:36.256103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13fea2-2a5c-43ae-a393-1b60883c7015 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:36.256891 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13fea2-2a5c-43ae-a393-1b60883c7015 None admin] RBAC: Adding query filter params (role.id=6408c231c0fe422fa2f095c2c8fd7a9e, scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0, user.id=0c3c47d36ee64327bc553ab61276989c) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:36.257202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13fea2-2a5c-43ae-a393-1b60883c7015 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:36.258658 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13fea2-2a5c-43ae-a393-1b60883c7015 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:36.265172 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 104/208] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:35:36 2022] GET /identity/v3/role_assignments?user.id=0c3c47d36ee64327bc553ab61276989c&scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0&role.id=6408c231c0fe422fa2f095c2c8fd7a9e => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:36.389007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cf67b-6f2c-4d51-aa0d-6886465f66ea None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:36.389326 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cf67b-6f2c-4d51-aa0d-6886465f66ea None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:36.389565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cf67b-6f2c-4d51-aa0d-6886465f66ea None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:36.391094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 105/209] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:36.396140 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bad6a-e2fa-4ca0-a570-761149434f49 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:36.396424 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bad6a-e2fa-4ca0-a570-761149434f49 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:36.396702 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36bad6a-e2fa-4ca0-a570-761149434f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:36.427203 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-d36bad6a-e2fa-4ca0-a570-761149434f49 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:36.428526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d36bad6a-e2fa-4ca0-a570-761149434f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:36.501093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0895783-8c22-402d-92e6-65d939dc3e8b None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:36.501595 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0895783-8c22-402d-92e6-65d939dc3e8b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:36.501670 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0895783-8c22-402d-92e6-65d939dc3e8b None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:36.503016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 106/210] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:36.508592 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21809fe-bb85-4e50-a7d5-264ccd3e2022 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:36.509172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21809fe-bb85-4e50-a7d5-264ccd3e2022 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:36.510265 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21809fe-bb85-4e50-a7d5-264ccd3e2022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:36.517665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 105/211] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:36.530926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-e21809fe-bb85-4e50-a7d5-264ccd3e2022 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:36.532577 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e21809fe-bb85-4e50-a7d5-264ccd3e2022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:36.545004 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bad6a-e2fa-4ca0-a570-761149434f49 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:36.610258 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 107/212] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:36.639713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:36.641078 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21809fe-bb85-4e50-a7d5-264ccd3e2022 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:36.645106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:36.664577 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36bad6a-e2fa-4ca0-a570-761149434f49 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:36.705399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30642e7e-9455-4da1-affd-7f9f0293aaf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:36.706062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30642e7e-9455-4da1-affd-7f9f0293aaf2 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:36.706369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30642e7e-9455-4da1-affd-7f9f0293aaf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:36.706654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30642e7e-9455-4da1-affd-7f9f0293aaf2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:36.720904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30642e7e-9455-4da1-affd-7f9f0293aaf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:36.727357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-30642e7e-9455-4da1-affd-7f9f0293aaf2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:36.727357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:36.727357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:36.727357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:36.727357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:36.727357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:36.727357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:36.727357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:36.727357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:36.727357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:36.727357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:36.727357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:36.727357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:36.727357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:36.727357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:36.727357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:36.728331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:36.728331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:36.728331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:36.728331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:36.728331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:36.728331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:36.728331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:36.728331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:36.728331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:36.728331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:36.728331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:36.728331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:36.728331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:36.728331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:36.728331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:36.728331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:36.729565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:36.729565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:36.729565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:36.729565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:36.729565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:36.729565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:36.729565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:36.729565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:36.729565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:36.729565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:36.729565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:36.729565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:36.729565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 106/213] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:35:36.735721 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30642e7e-9455-4da1-affd-7f9f0293aaf2 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:36.764667 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21809fe-bb85-4e50-a7d5-264ccd3e2022 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:36.805168 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2fe8c-b7b5-41a7-9d07-b895aa0f1efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:36.806991 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2fe8c-b7b5-41a7-9d07-b895aa0f1efd None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:36.807639 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2fe8c-b7b5-41a7-9d07-b895aa0f1efd None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:36.808109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e2fe8c-b7b5-41a7-9d07-b895aa0f1efd None admin] PATH_INFO: `/v3/domains/default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:36.810033 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2fe8c-b7b5-41a7-9d07-b895aa0f1efd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:36.812136 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e2fe8c-b7b5-41a7-9d07-b895aa0f1efd None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:36.814154 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 108/214] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:35:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:36.820272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2fe8c-b7b5-41a7-9d07-b895aa0f1efd None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:36.856203 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30642e7e-9455-4da1-affd-7f9f0293aaf2 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:36.892107 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675ba72-4618-42b2-90b0-5206d98fa70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:36.893047 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675ba72-4618-42b2-90b0-5206d98fa70b None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:36.893527 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675ba72-4618-42b2-90b0-5206d98fa70b None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:36.894017 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9675ba72-4618-42b2-90b0-5206d98fa70b None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:36.894983 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675ba72-4618-42b2-90b0-5206d98fa70b None admin] RBAC: Adding query filter params (name=member) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:36.895149 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:36.895894 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675ba72-4618-42b2-90b0-5206d98fa70b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:36.897068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9675ba72-4618-42b2-90b0-5206d98fa70b None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:36.910470 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 107/215] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:36.911905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675ba72-4618-42b2-90b0-5206d98fa70b None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:36.915112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:36.940755 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e2fe8c-b7b5-41a7-9d07-b895aa0f1efd None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:36.985238 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4dd78-c4aa-4404-95fa-20f1dfffb274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:36.985877 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4dd78-c4aa-4404-95fa-20f1dfffb274 None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:36.986357 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4dd78-c4aa-4404-95fa-20f1dfffb274 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:36.986746 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4dd78-c4aa-4404-95fa-20f1dfffb274 None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:36.987451 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4dd78-c4aa-4404-95fa-20f1dfffb274 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:36.989599 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4dd78-c4aa-4404-95fa-20f1dfffb274 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:37.022511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 109/216] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 22:35:36 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:35:37.053670 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9675ba72-4618-42b2-90b0-5206d98fa70b None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:37.093032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22ac0c-4820-4601-b94b-b35e91180573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:37.094099 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22ac0c-4820-4601-b94b-b35e91180573 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:37.094617 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22ac0c-4820-4601-b94b-b35e91180573 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:37.095104 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22ac0c-4820-4601-b94b-b35e91180573 None admin] PATH_INFO: `/v3/users/b97d48fcc9f54b1a9225e40f6bcf47be` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:37.111252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22ac0c-4820-4601-b94b-b35e91180573 None admin] RBAC: Authorizing `identity:get_user(user_id=b97d48fcc9f54b1a9225e40f6bcf47be)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:37.113226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22ac0c-4820-4601-b94b-b35e91180573 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:37.115628 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 108/217] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:36 2022] GET /identity/v3/users/b97d48fcc9f54b1a9225e40f6bcf47be => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:37.122269 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4dd78-c4aa-4404-95fa-20f1dfffb274 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:37.234704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4dd78-c4aa-4404-95fa-20f1dfffb274 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:37.263621 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:37.273019 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d8cfd-41ec-4453-acbb-2c03ae109d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:37.275352 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d8cfd-41ec-4453-acbb-2c03ae109d4f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:37.275641 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d8cfd-41ec-4453-acbb-2c03ae109d4f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:37.275973 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d8cfd-41ec-4453-acbb-2c03ae109d4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:37.356540 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d8cfd-41ec-4453-acbb-2c03ae109d4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:37.358429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d8cfd-41ec-4453-acbb-2c03ae109d4f None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:37.382184 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7b442-0a0c-441c-adbf-364c977d9f62 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:37.382815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7b442-0a0c-441c-adbf-364c977d9f62 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:37.383291 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7b442-0a0c-441c-adbf-364c977d9f62 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:37.385151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 109/218] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:37.390161 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4c85e-60fd-4c26-8429-bc1124f85d57 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:37.390722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4c85e-60fd-4c26-8429-bc1124f85d57 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:37.391197 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf4c85e-60fd-4c26-8429-bc1124f85d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:37.420964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-2bf4c85e-60fd-4c26-8429-bc1124f85d57 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:37.422524 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-2bf4c85e-60fd-4c26-8429-bc1124f85d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:37.474237 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 110/219] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:35:37.480335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d8cfd-41ec-4453-acbb-2c03ae109d4f None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:37.498608 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:37.520745 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:37.522222 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 110/220] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:37.557634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4c85e-60fd-4c26-8429-bc1124f85d57 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:37.639206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d8cfd-41ec-4453-acbb-2c03ae109d4f None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:37.677113 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d429b2-d4ac-4b76-b89f-3a949cbf1139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:37.677754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d429b2-d4ac-4b76-b89f-3a949cbf1139 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:37.678134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d429b2-d4ac-4b76-b89f-3a949cbf1139 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:37.678445 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d429b2-d4ac-4b76-b89f-3a949cbf1139 None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:37.679710 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d429b2-d4ac-4b76-b89f-3a949cbf1139 None admin] RBAC: Authorizing `identity:get_project(project_id=4e0a8c4e892848b4a8d4fea9a731c82c)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:37.681293 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d429b2-d4ac-4b76-b89f-3a949cbf1139 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:37.683473 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 111/221] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:37 2022] GET /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:37.684627 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8ebbd-1d46-45d2-a481-3e3875701af6 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:37.684908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8ebbd-1d46-45d2-a481-3e3875701af6 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:37.689983 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8ebbd-1d46-45d2-a481-3e3875701af6 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:37.691454 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 112/222] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:37.692287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8ebbd-1d46-45d2-a481-3e3875701af6 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:37.704131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf4c85e-60fd-4c26-8429-bc1124f85d57 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:37.750836 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f9ca8-c6ca-4548-b602-297022c1df77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:37.751965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f9ca8-c6ca-4548-b602-297022c1df77 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:37.752247 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f9ca8-c6ca-4548-b602-297022c1df77 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:37.752523 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f9ca8-c6ca-4548-b602-297022c1df77 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:37.767295 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f9ca8-c6ca-4548-b602-297022c1df77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:37.774434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-752f9ca8-c6ca-4548-b602-297022c1df77 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:35:37.774434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:37.774434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:37.774434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:37.774434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:37.774434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:37.774434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:37.774434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:37.774434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:37.774434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:37.774434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:37.774434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:37.774434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:37.774434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:37.774434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:37.774434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:37.775871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:37.775871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:37.775871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:37.775871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:37.775871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:37.775871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:37.775871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:37.775871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:37.775871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:37.775871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:37.775871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:37.775871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:37.775871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:37.775871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:37.775871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:37.775871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:37.776682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:37.776682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:37.776682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:37.776682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:37.776682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:37.776682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:37.776682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:37.776682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:37.776682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:37.776682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:37.776682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:35:37.776682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:37.776682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 111/223] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:35:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:35:37.780868 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7970d8f-5cea-4432-ae76-8f0322bdd678 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:37.780868 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7970d8f-5cea-4432-ae76-8f0322bdd678 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:37.780868 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7970d8f-5cea-4432-ae76-8f0322bdd678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:37.801570 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-c7970d8f-5cea-4432-ae76-8f0322bdd678 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:37.803061 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-c7970d8f-5cea-4432-ae76-8f0322bdd678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:37.809249 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:37.817485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8ebbd-1d46-45d2-a481-3e3875701af6 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:37.856859 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b5182-cc97-46bf-ae81-475ebaa42427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:37.857715 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b5182-cc97-46bf-ae81-475ebaa42427 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:37.858100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b5182-cc97-46bf-ae81-475ebaa42427 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:37.858512 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b5182-cc97-46bf-ae81-475ebaa42427 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:37.859441 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b5182-cc97-46bf-ae81-475ebaa42427 None admin] RBAC: Adding query filter params (role.id=267b3ef4524c42bb90a7002ee1639b74, scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c, user.id=b97d48fcc9f54b1a9225e40f6bcf47be) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:37.859859 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b5182-cc97-46bf-ae81-475ebaa42427 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:37.861482 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b5182-cc97-46bf-ae81-475ebaa42427 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:37.868116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 113/224] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:35:37 2022] GET /identity/v3/role_assignments?user.id=b97d48fcc9f54b1a9225e40f6bcf47be&scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c&role.id=267b3ef4524c42bb90a7002ee1639b74 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:37.869072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b5182-cc97-46bf-ae81-475ebaa42427 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:37.870705 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:37.912877 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 112/225] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:37.936233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7970d8f-5cea-4432-ae76-8f0322bdd678 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:38.069620 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b5182-cc97-46bf-ae81-475ebaa42427 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:38.111556 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7970d8f-5cea-4432-ae76-8f0322bdd678 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:38.118334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede363b-09c4-4990-ae5b-25a051a9c957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:38.119689 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede363b-09c4-4990-ae5b-25a051a9c957 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:38.120141 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede363b-09c4-4990-ae5b-25a051a9c957 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:38.120557 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ede363b-09c4-4990-ae5b-25a051a9c957 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:38.121431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede363b-09c4-4990-ae5b-25a051a9c957 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:38.121882 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede363b-09c4-4990-ae5b-25a051a9c957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:38.123450 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ede363b-09c4-4990-ae5b-25a051a9c957 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:38.132867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 114/226] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:38.139003 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede363b-09c4-4990-ae5b-25a051a9c957 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:38.166599 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810be7cb-f700-4fa9-9a1d-261c3e487de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:38.168535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810be7cb-f700-4fa9-9a1d-261c3e487de4 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:38.170389 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810be7cb-f700-4fa9-9a1d-261c3e487de4 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:38.170892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810be7cb-f700-4fa9-9a1d-261c3e487de4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:38.191762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:38.192921 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810be7cb-f700-4fa9-9a1d-261c3e487de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:38.204075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-810be7cb-f700-4fa9-9a1d-261c3e487de4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:35:38.204075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:38.204075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:38.204075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:38.204075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:38.204075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:38.204075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:38.204075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:38.204075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:38.204075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:38.204075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:38.204075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:38.204075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:38.204075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:38.204075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:38.204075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:38.205018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:38.205018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:38.205018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:38.205018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:38.205018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:38.205018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:38.205018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:38.205018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:38.205018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:38.205018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:38.205018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:38.205018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:38.205018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:38.205018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:38.205018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:38.205018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:38.205830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:38.205830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:38.205830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:38.205830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:38.205830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:38.205830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:38.205830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:38.205830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:38.205830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:38.205830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:38.205830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:35:38.205830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:38.208179 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 113/227] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:35:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:38.214376 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810be7cb-f700-4fa9-9a1d-261c3e487de4 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:38.277391 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ede363b-09c4-4990-ae5b-25a051a9c957 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:38.293319 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:38.327303 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ac733-b876-4db6-8486-d951cf43f4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:38.327896 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ac733-b876-4db6-8486-d951cf43f4dd None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:38.328182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ac733-b876-4db6-8486-d951cf43f4dd None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:38.328461 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ac733-b876-4db6-8486-d951cf43f4dd None admin] PATH_INFO: `/v3/users/e35e5b5f9a4349beb91c29f848414550` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:38.329666 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ac733-b876-4db6-8486-d951cf43f4dd None admin] RBAC: Authorizing `identity:get_user(user_id=e35e5b5f9a4349beb91c29f848414550)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:38.331241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500ac733-b876-4db6-8486-d951cf43f4dd None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:38.338879 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 115/228] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:38 2022] GET /identity/v3/users/e35e5b5f9a4349beb91c29f848414550 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:38.339756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ac733-b876-4db6-8486-d951cf43f4dd None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:38.359981 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810be7cb-f700-4fa9-9a1d-261c3e487de4 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:38.400805 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23554138-6bbb-4fe4-abff-ac060e408ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:38.401839 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23554138-6bbb-4fe4-abff-ac060e408ecc None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:38.403117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23554138-6bbb-4fe4-abff-ac060e408ecc None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:38.403800 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23554138-6bbb-4fe4-abff-ac060e408ecc None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:38.406019 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23554138-6bbb-4fe4-abff-ac060e408ecc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:38.406608 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23554138-6bbb-4fe4-abff-ac060e408ecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:38.409733 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23554138-6bbb-4fe4-abff-ac060e408ecc None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:38.426562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 114/229] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:35:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:38.433037 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23554138-6bbb-4fe4-abff-ac060e408ecc None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:38.537312 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:38.553746 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ac733-b876-4db6-8486-d951cf43f4dd None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:38.585863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23554138-6bbb-4fe4-abff-ac060e408ecc None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:38.594681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:38.642046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdf703-438f-4d8e-b8ef-c1879caa8090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:38.643801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdf703-438f-4d8e-b8ef-c1879caa8090 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:38.644102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdf703-438f-4d8e-b8ef-c1879caa8090 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:38.644386 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fdf703-438f-4d8e-b8ef-c1879caa8090 None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:38.646212 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdf703-438f-4d8e-b8ef-c1879caa8090 None admin] RBAC: Authorizing `identity:get_project(project_id=4e0a8c4e892848b4a8d4fea9a731c82c)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:38.648520 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fdf703-438f-4d8e-b8ef-c1879caa8090 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:38.650248 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 116/230] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:38 2022] GET /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c => generated 302 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:38.654315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fed315-dfa9-44d8-bb86-109032419b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:38.655172 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fed315-dfa9-44d8-bb86-109032419b69 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:38.655459 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fed315-dfa9-44d8-bb86-109032419b69 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:38.656312 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdf703-438f-4d8e-b8ef-c1879caa8090 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:38.656901 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fed315-dfa9-44d8-bb86-109032419b69 None admin] PATH_INFO: `/v3/users/e35e5b5f9a4349beb91c29f848414550` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:38.660157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fed315-dfa9-44d8-bb86-109032419b69 None admin] RBAC: Authorizing `identity:get_user(user_id=e35e5b5f9a4349beb91c29f848414550)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:38.662691 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fed315-dfa9-44d8-bb86-109032419b69 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:38.674027 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 115/231] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:38 2022] GET /identity/v3/users/e35e5b5f9a4349beb91c29f848414550 => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:38.687658 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fed315-dfa9-44d8-bb86-109032419b69 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:38.826973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fed315-dfa9-44d8-bb86-109032419b69 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:38.864797 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35840af9-23e4-408b-9699-15b394ac9b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:38.865386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35840af9-23e4-408b-9699-15b394ac9b3c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:38.865678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35840af9-23e4-408b-9699-15b394ac9b3c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:38.865961 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35840af9-23e4-408b-9699-15b394ac9b3c None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:38.867165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35840af9-23e4-408b-9699-15b394ac9b3c None admin] RBAC: Authorizing `identity:get_project(project_id=4e0a8c4e892848b4a8d4fea9a731c82c)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:38.869006 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35840af9-23e4-408b-9699-15b394ac9b3c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:38.875875 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 116/232] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:38 2022] GET /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:38.877078 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35840af9-23e4-408b-9699-15b394ac9b3c None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:38.927825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:38.930834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fdf703-438f-4d8e-b8ef-c1879caa8090 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:38.998225 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a47cbd-f70e-4d40-9313-d97a99cc6441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:38.998933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a47cbd-f70e-4d40-9313-d97a99cc6441 None admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:38.999221 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a47cbd-f70e-4d40-9313-d97a99cc6441 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:38.999503 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a47cbd-f70e-4d40-9313-d97a99cc6441 None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c/users/e35e5b5f9a4349beb91c29f848414550/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:39.002941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a47cbd-f70e-4d40-9313-d97a99cc6441 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e0a8c4e892848b4a8d4fea9a731c82c, user_id=e35e5b5f9a4349beb91c29f848414550, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:39.004413 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a47cbd-f70e-4d40-9313-d97a99cc6441 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:39.028494 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 117/233] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:35:38 2022] PUT /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c/users/e35e5b5f9a4349beb91c29f848414550/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:35:39.031240 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35840af9-23e4-408b-9699-15b394ac9b3c None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:39.091388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04ba47-37b7-4355-a2e6-e433aba98bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:39.092076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ba47-37b7-4355-a2e6-e433aba98bdf None admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:39.092360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ba47-37b7-4355-a2e6-e433aba98bdf None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:39.092639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04ba47-37b7-4355-a2e6-e433aba98bdf None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c/users/e35e5b5f9a4349beb91c29f848414550/roles/d4ee54c077084dcea38d7476927b61df` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:39.094848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04ba47-37b7-4355-a2e6-e433aba98bdf None admin] RBAC: Authorizing `identity:create_grant(project_id=4e0a8c4e892848b4a8d4fea9a731c82c, user_id=e35e5b5f9a4349beb91c29f848414550, role_id=d4ee54c077084dcea38d7476927b61df)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:39.096277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04ba47-37b7-4355-a2e6-e433aba98bdf None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:39.126423 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 117/234] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:35:38 2022] PUT /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c/users/e35e5b5f9a4349beb91c29f848414550/roles/d4ee54c077084dcea38d7476927b61df => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:35:39.389152 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8f0ab-2dca-45d4-8fed-9b3e07f2fbe0 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:39.389509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8f0ab-2dca-45d4-8fed-9b3e07f2fbe0 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:39.389746 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8f0ab-2dca-45d4-8fed-9b3e07f2fbe0 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:39.391160 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 118/235] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:39.396971 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe5bc6-0605-46c9-a11b-e4b44286c68e None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:39.397258 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe5bc6-0605-46c9-a11b-e4b44286c68e None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:39.397550 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbe5bc6-0605-46c9-a11b-e4b44286c68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:39.417498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-7dbe5bc6-0605-46c9-a11b-e4b44286c68e None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:39.418742 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-7dbe5bc6-0605-46c9-a11b-e4b44286c68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:39.506118 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 118/236] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:39.552321 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8f0ab-2dca-45d4-8fed-9b3e07f2fbe0 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:39.559785 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775cc68-9c75-42b3-8c76-a8eb46218078 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:39.560077 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775cc68-9c75-42b3-8c76-a8eb46218078 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:39.560358 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3775cc68-9c75-42b3-8c76-a8eb46218078 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:39.561793 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 119/237] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:35:39.566718 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb612d9-117d-44aa-aed7-b514d39cf176 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:39.567225 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb612d9-117d-44aa-aed7-b514d39cf176 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:39.567713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb612d9-117d-44aa-aed7-b514d39cf176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:39.583048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:39.593570 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-afb612d9-117d-44aa-aed7-b514d39cf176 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:39.595434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-afb612d9-117d-44aa-aed7-b514d39cf176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:39.631536 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:39.704317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 120/238] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:39.727951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb612d9-117d-44aa-aed7-b514d39cf176 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:39.764052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8f0ab-2dca-45d4-8fed-9b3e07f2fbe0 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:39.830161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ebf2d-ecc2-4ca4-8079-4a435f5832b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:39.830841 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ebf2d-ecc2-4ca4-8079-4a435f5832b4 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:39.831123 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ebf2d-ecc2-4ca4-8079-4a435f5832b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:39.831398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ebf2d-ecc2-4ca4-8079-4a435f5832b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:39.855893 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ebf2d-ecc2-4ca4-8079-4a435f5832b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:39.866333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-9e5ebf2d-ecc2-4ca4-8079-4a435f5832b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 22:35:39.866333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:39.866333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:39.866333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:39.866333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:39.866333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:39.866333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:39.866333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:39.866333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:39.866333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:39.866333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:39.866333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:39.866333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:39.866333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:39.866333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:39.866333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:39.867257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:39.867257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:39.867257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:39.867257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:39.867257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:39.867257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:39.867257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:39.867257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:39.867257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:39.867257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:39.867257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:39.867257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:39.867257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:39.867257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:39.867257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:39.867257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:39.868048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:39.868048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:39.868048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:39.868048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:39.868048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:39.868048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:39.868048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:39.868048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:39.868048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:39.868048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:39.868048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 22:35:39.868048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:39.870666 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 119/239] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:39.877752 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ebf2d-ecc2-4ca4-8079-4a435f5832b4 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:39.943458 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb612d9-117d-44aa-aed7-b514d39cf176 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:40.001907 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccf3f0-89f2-4fa5-8194-febb6148c72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:40.002517 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccf3f0-89f2-4fa5-8194-febb6148c72d None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:40.002811 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccf3f0-89f2-4fa5-8194-febb6148c72d None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:40.003096 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccf3f0-89f2-4fa5-8194-febb6148c72d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:40.004244 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccf3f0-89f2-4fa5-8194-febb6148c72d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:40.005706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfccf3f0-89f2-4fa5-8194-febb6148c72d None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:40.007652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 121/240] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:35:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:40.013023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccf3f0-89f2-4fa5-8194-febb6148c72d None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:40.044962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:40.059975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:40.119183 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfccf3f0-89f2-4fa5-8194-febb6148c72d None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:40.156831 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf962dd-70ef-483f-9887-097b3bc0ecfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:40.157782 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf962dd-70ef-483f-9887-097b3bc0ecfb None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:40.158208 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf962dd-70ef-483f-9887-097b3bc0ecfb None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:40.158790 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf962dd-70ef-483f-9887-097b3bc0ecfb None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:40.159613 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf962dd-70ef-483f-9887-097b3bc0ecfb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:40.161229 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf962dd-70ef-483f-9887-097b3bc0ecfb None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:40.164261 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ebf2d-ecc2-4ca4-8079-4a435f5832b4 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:40.188221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 122/241] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 22:35:40 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:35:40.253954 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d98f14-a730-4841-884e-03663fd3f1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:40.254548 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d98f14-a730-4841-884e-03663fd3f1cc None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:40.254840 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d98f14-a730-4841-884e-03663fd3f1cc None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:40.255122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d98f14-a730-4841-884e-03663fd3f1cc None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:40.255886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d98f14-a730-4841-884e-03663fd3f1cc None admin] RBAC: Adding query filter params (name=reader) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:40.256193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d98f14-a730-4841-884e-03663fd3f1cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:40.257611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d98f14-a730-4841-884e-03663fd3f1cc None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:40.270367 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 120/242] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:40.276745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf962dd-70ef-483f-9887-097b3bc0ecfb None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:40.399779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:40.420143 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf962dd-70ef-483f-9887-097b3bc0ecfb None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:40.458092 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2ad2c-3699-4ebf-88ef-ada54fe1ee8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:40.458777 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2ad2c-3699-4ebf-88ef-ada54fe1ee8b None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:40.459062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2ad2c-3699-4ebf-88ef-ada54fe1ee8b None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:40.459338 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2ad2c-3699-4ebf-88ef-ada54fe1ee8b None admin] PATH_INFO: `/v3/users/e25aa802d9bf4dd48d28fe8b101b90ee` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:40.473979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2ad2c-3699-4ebf-88ef-ada54fe1ee8b None admin] RBAC: Authorizing `identity:get_user(user_id=e25aa802d9bf4dd48d28fe8b101b90ee)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:40.475628 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2ad2c-3699-4ebf-88ef-ada54fe1ee8b None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:40.477755 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 123/243] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:40 2022] GET /identity/v3/users/e25aa802d9bf4dd48d28fe8b101b90ee => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:40.483292 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d98f14-a730-4841-884e-03663fd3f1cc None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:40.489570 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33605579-8cfb-4ff9-9e0f-fd72c13a0b1b None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:40.489864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33605579-8cfb-4ff9-9e0f-fd72c13a0b1b None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:40.490149 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33605579-8cfb-4ff9-9e0f-fd72c13a0b1b None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:40.491541 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 124/244] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:40.497178 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0de15d-6eef-4a26-8307-1be0179d7282 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:40.497468 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0de15d-6eef-4a26-8307-1be0179d7282 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:40.497751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0de15d-6eef-4a26-8307-1be0179d7282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:40.517914 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-7b0de15d-6eef-4a26-8307-1be0179d7282 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:40.519077 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-7b0de15d-6eef-4a26-8307-1be0179d7282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:40.606323 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 125/245] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:40.635821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0de15d-6eef-4a26-8307-1be0179d7282 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:40.652580 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d98f14-a730-4841-884e-03663fd3f1cc None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:40.704179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b44cd-e28a-463e-803e-c2c8bba08b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:40.704902 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b44cd-e28a-463e-803e-c2c8bba08b3f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:40.705437 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b44cd-e28a-463e-803e-c2c8bba08b3f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:40.705725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b44cd-e28a-463e-803e-c2c8bba08b3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:40.722072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:40.736137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:40.777250 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0de15d-6eef-4a26-8307-1be0179d7282 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:40.800708 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b44cd-e28a-463e-803e-c2c8bba08b3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:40.802498 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b44cd-e28a-463e-803e-c2c8bba08b3f None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:40.817329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a85806-7689-44ab-b461-d990dea2fe89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:40.817985 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a85806-7689-44ab-b461-d990dea2fe89 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:40.818277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a85806-7689-44ab-b461-d990dea2fe89 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:40.819761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a85806-7689-44ab-b461-d990dea2fe89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:40.833134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a85806-7689-44ab-b461-d990dea2fe89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:40.839997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-04a85806-7689-44ab-b461-d990dea2fe89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:40.839997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:40.839997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:40.839997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:40.839997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:40.839997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:40.839997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:40.839997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:40.839997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:40.839997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:40.839997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:40.839997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:40.839997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:40.839997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:40.839997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:40.839997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:40.840998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:40.840998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:40.840998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:40.840998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:40.840998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:40.840998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:40.840998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:40.840998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:40.840998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:40.840998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:40.840998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:40.840998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:40.840998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:40.840998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:40.840998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:40.840998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:40.842445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:40.842445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:40.842445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:40.842445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:40.842445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:40.842445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:40.842445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:40.842445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:40.842445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:40.842445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:40.842445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:40.842445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:40.842445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 126/246] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:35:40.847246 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a85806-7689-44ab-b461-d990dea2fe89 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:40.942070 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 121/247] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:35:40.949823 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b44cd-e28a-463e-803e-c2c8bba08b3f None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:40.973335 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a85806-7689-44ab-b461-d990dea2fe89 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:41.001137 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:41.009162 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:41.017667 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e8875-05c0-4263-ad84-64c0897671ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:41.018667 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e8875-05c0-4263-ad84-64c0897671ae None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:41.019180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e8875-05c0-4263-ad84-64c0897671ae None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:41.019674 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5e8875-05c0-4263-ad84-64c0897671ae None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:41.020597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e8875-05c0-4263-ad84-64c0897671ae None admin] RBAC: Adding query filter params (name=member) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:41.021106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e8875-05c0-4263-ad84-64c0897671ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:41.022720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5e8875-05c0-4263-ad84-64c0897671ae None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:41.032822 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 127/248] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:41.040185 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e8875-05c0-4263-ad84-64c0897671ae None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:41.079703 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b44cd-e28a-463e-803e-c2c8bba08b3f None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:41.129832 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a081cc-34bf-48c4-8ba5-356310367a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:41.130886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a081cc-34bf-48c4-8ba5-356310367a1d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:41.131420 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a081cc-34bf-48c4-8ba5-356310367a1d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:41.131899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a081cc-34bf-48c4-8ba5-356310367a1d None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:41.133289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a081cc-34bf-48c4-8ba5-356310367a1d None admin] RBAC: Authorizing `identity:get_project(project_id=4e0a8c4e892848b4a8d4fea9a731c82c)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:41.135038 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a081cc-34bf-48c4-8ba5-356310367a1d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:41.142196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 122/249] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:40 2022] GET /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:41.143731 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a081cc-34bf-48c4-8ba5-356310367a1d None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:41.180820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5e8875-05c0-4263-ad84-64c0897671ae None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:41.230072 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee49211-f08b-4f98-af6a-85a58738e097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:41.231117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee49211-f08b-4f98-af6a-85a58738e097 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:41.231610 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee49211-f08b-4f98-af6a-85a58738e097 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:41.232115 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee49211-f08b-4f98-af6a-85a58738e097 None admin] PATH_INFO: `/v3/users/b97d48fcc9f54b1a9225e40f6bcf47be` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:41.233533 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee49211-f08b-4f98-af6a-85a58738e097 None admin] RBAC: Authorizing `identity:get_user(user_id=b97d48fcc9f54b1a9225e40f6bcf47be)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:41.235218 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee49211-f08b-4f98-af6a-85a58738e097 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:41.237208 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 128/250] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:41 2022] GET /identity/v3/users/b97d48fcc9f54b1a9225e40f6bcf47be => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:41.244297 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee49211-f08b-4f98-af6a-85a58738e097 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:41.261945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a081cc-34bf-48c4-8ba5-356310367a1d None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:41.276895 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:41.307091 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de703816-c8c0-4aba-ba7a-4d5e45e6df67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:41.308177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de703816-c8c0-4aba-ba7a-4d5e45e6df67 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:41.308678 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de703816-c8c0-4aba-ba7a-4d5e45e6df67 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:41.309169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de703816-c8c0-4aba-ba7a-4d5e45e6df67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:41.310273 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de703816-c8c0-4aba-ba7a-4d5e45e6df67 None admin] RBAC: Adding query filter params (role.id=6408c231c0fe422fa2f095c2c8fd7a9e, scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c, user.id=e25aa802d9bf4dd48d28fe8b101b90ee) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:41.310831 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de703816-c8c0-4aba-ba7a-4d5e45e6df67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:41.312547 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de703816-c8c0-4aba-ba7a-4d5e45e6df67 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:41.317629 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:41.326814 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 123/251] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:35:41 2022] GET /identity/v3/role_assignments?user.id=e25aa802d9bf4dd48d28fe8b101b90ee&scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c&role.id=6408c231c0fe422fa2f095c2c8fd7a9e => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:41.365513 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee49211-f08b-4f98-af6a-85a58738e097 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:41.402372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f770c85-a8ef-424f-b012-8c5f3ea89cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:41.403044 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f770c85-a8ef-424f-b012-8c5f3ea89cd3 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:41.403330 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f770c85-a8ef-424f-b012-8c5f3ea89cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:41.403613 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f770c85-a8ef-424f-b012-8c5f3ea89cd3 None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:41.404859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f770c85-a8ef-424f-b012-8c5f3ea89cd3 None admin] RBAC: Authorizing `identity:get_project(project_id=4e0a8c4e892848b4a8d4fea9a731c82c)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:41.406352 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f770c85-a8ef-424f-b012-8c5f3ea89cd3 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:41.408454 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 129/252] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:41 2022] GET /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:41.414163 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de703816-c8c0-4aba-ba7a-4d5e45e6df67 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:41.522251 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de703816-c8c0-4aba-ba7a-4d5e45e6df67 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:41.560312 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653cd19-b193-44d8-af16-ca8214e92e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:41.561281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653cd19-b193-44d8-af16-ca8214e92e36 None admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:41.561737 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653cd19-b193-44d8-af16-ca8214e92e36 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:41.562189 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653cd19-b193-44d8-af16-ca8214e92e36 None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c/users/b97d48fcc9f54b1a9225e40f6bcf47be/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:41.564365 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653cd19-b193-44d8-af16-ca8214e92e36 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e0a8c4e892848b4a8d4fea9a731c82c, user_id=b97d48fcc9f54b1a9225e40f6bcf47be, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:41.565991 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653cd19-b193-44d8-af16-ca8214e92e36 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:41.598487 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 124/253] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:35:41 2022] PUT /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c/users/b97d48fcc9f54b1a9225e40f6bcf47be/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:35:41.866424 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaa2ba-bcde-4ac1-bcf6-5995fc944706 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:41.866927 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaa2ba-bcde-4ac1-bcf6-5995fc944706 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:41.866927 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeaa2ba-bcde-4ac1-bcf6-5995fc944706 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:41.868467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 130/254] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:41.874569 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050787-a7ee-4788-a0b6-26551c5caa92 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:41.875013 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050787-a7ee-4788-a0b6-26551c5caa92 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:41.875189 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10050787-a7ee-4788-a0b6-26551c5caa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:41.891146 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449099f8-96b3-4b7a-bff6-1a28a7f687f7 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:41.891448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449099f8-96b3-4b7a-bff6-1a28a7f687f7 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:41.891700 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449099f8-96b3-4b7a-bff6-1a28a7f687f7 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:41.893028 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 131/255] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:35:41.904456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-10050787-a7ee-4788-a0b6-26551c5caa92 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:41.905656 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-10050787-a7ee-4788-a0b6-26551c5caa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:41.907769 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2f92c-1da7-49e8-a80f-327d6dc17e80 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:41.908280 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2f92c-1da7-49e8-a80f-327d6dc17e80 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:41.908757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2f92c-1da7-49e8-a80f-327d6dc17e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:41.945072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:41.948821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-37f2f92c-1da7-49e8-a80f-327d6dc17e80 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:41.950254 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-37f2f92c-1da7-49e8-a80f-327d6dc17e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:42.012031 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 125/256] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:42.053787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10050787-a7ee-4788-a0b6-26551c5caa92 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:42.117021 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 132/257] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:42.152770 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2f92c-1da7-49e8-a80f-327d6dc17e80 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:42.184692 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10050787-a7ee-4788-a0b6-26551c5caa92 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:42.227822 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1751f-4cce-4e6e-b53d-31f727f42230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:42.229003 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1751f-4cce-4e6e-b53d-31f727f42230 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:42.229282 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1751f-4cce-4e6e-b53d-31f727f42230 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:42.229552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1751f-4cce-4e6e-b53d-31f727f42230 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:42.248416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1751f-4cce-4e6e-b53d-31f727f42230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:42.256374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-eca1751f-4cce-4e6e-b53d-31f727f42230 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:35:42.256374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:42.256374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:42.256374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:42.256374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:42.256374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:42.256374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:42.256374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:42.256374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:42.256374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:42.256374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:42.256374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:42.256374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:42.256374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:42.256374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:42.256374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:42.257289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:42.257289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:42.257289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:42.257289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:42.257289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:42.257289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:42.257289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:42.257289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:42.257289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:42.257289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:42.257289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:42.257289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:42.257289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:42.257289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:42.257289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:42.257289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:42.258085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:42.258085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:42.258085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:42.258085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:42.258085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:42.258085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:42.258085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:42.258085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:42.258085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:42.258085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:42.258085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:35:42.258085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:42.258085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 126/258] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:35:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:35:42.265278 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1751f-4cce-4e6e-b53d-31f727f42230 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:42.287348 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:42.293749 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:42.394568 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2f92c-1da7-49e8-a80f-327d6dc17e80 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:42.450079 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bde5f-267b-4f93-8290-5c6f9f8d9562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:42.452358 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bde5f-267b-4f93-8290-5c6f9f8d9562 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:42.452813 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bde5f-267b-4f93-8290-5c6f9f8d9562 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:42.453406 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bde5f-267b-4f93-8290-5c6f9f8d9562 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:42.464287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1751f-4cce-4e6e-b53d-31f727f42230 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:42.476295 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bde5f-267b-4f93-8290-5c6f9f8d9562 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:42.482022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-829bde5f-267b-4f93-8290-5c6f9f8d9562 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:35:42.482022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:42.482022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:42.482022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:42.482022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:42.482022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:42.482022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:42.482022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:42.482022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:42.482022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:42.482022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:42.482022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:42.482022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:42.482022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:42.482022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:42.482022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:42.483126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:42.483126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:42.483126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:42.483126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:42.483126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:42.483126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:42.483126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:42.483126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:42.483126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:42.483126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:42.483126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:42.483126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:42.483126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:42.483126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:42.483126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:42.483126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:42.484115 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:42.484115 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:42.484115 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:42.484115 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:42.484115 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:42.484115 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:42.484115 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:42.484115 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:42.484115 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:42.484115 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:42.484115 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:35:42.484115 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:42.489812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 133/259] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:35:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:42.494851 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bde5f-267b-4f93-8290-5c6f9f8d9562 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:42.533445 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87873a73-70c4-4a69-93c1-23650348ccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:42.534314 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87873a73-70c4-4a69-93c1-23650348ccb5 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:42.534875 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87873a73-70c4-4a69-93c1-23650348ccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:42.536003 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87873a73-70c4-4a69-93c1-23650348ccb5 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:42.537371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87873a73-70c4-4a69-93c1-23650348ccb5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:42.539882 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87873a73-70c4-4a69-93c1-23650348ccb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:42.541590 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87873a73-70c4-4a69-93c1-23650348ccb5 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:42.556635 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 127/260] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:35:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:42.561903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87873a73-70c4-4a69-93c1-23650348ccb5 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:42.716750 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bde5f-267b-4f93-8290-5c6f9f8d9562 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:42.751851 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:42.756161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:42.793728 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87873a73-70c4-4a69-93c1-23650348ccb5 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:42.794950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741d121-a010-466b-be31-54d621b3f9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:42.795834 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741d121-a010-466b-be31-54d621b3f9f7 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:42.796290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741d121-a010-466b-be31-54d621b3f9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:42.796737 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741d121-a010-466b-be31-54d621b3f9f7 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:42.797660 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741d121-a010-466b-be31-54d621b3f9f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:42.798138 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741d121-a010-466b-be31-54d621b3f9f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:42.799843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741d121-a010-466b-be31-54d621b3f9f7 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:42.816998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 134/261] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:42.823055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741d121-a010-466b-be31-54d621b3f9f7 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:42.888416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1da5d-48f5-497b-a26f-2dbf5ce871cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:42.889076 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1da5d-48f5-497b-a26f-2dbf5ce871cd None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:42.889368 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1da5d-48f5-497b-a26f-2dbf5ce871cd None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:42.889652 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b1da5d-48f5-497b-a26f-2dbf5ce871cd None admin] PATH_INFO: `/v3/users/e35e5b5f9a4349beb91c29f848414550` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:42.895059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1da5d-48f5-497b-a26f-2dbf5ce871cd None admin] RBAC: Authorizing `identity:get_user(user_id=e35e5b5f9a4349beb91c29f848414550)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:42.896522 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b1da5d-48f5-497b-a26f-2dbf5ce871cd None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:42.898476 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 128/262] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:42 2022] GET /identity/v3/users/e35e5b5f9a4349beb91c29f848414550 => generated 283 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:42.903734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1da5d-48f5-497b-a26f-2dbf5ce871cd None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:42.969496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741d121-a010-466b-be31-54d621b3f9f7 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:43.014089 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b82ee-f1a1-40d7-b967-df9e21d2cbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:43.014765 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b82ee-f1a1-40d7-b967-df9e21d2cbda None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:43.015048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b82ee-f1a1-40d7-b967-df9e21d2cbda None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:43.015323 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b82ee-f1a1-40d7-b967-df9e21d2cbda None admin] PATH_INFO: `/v3/users/e35e5b5f9a4349beb91c29f848414550` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:43.019356 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b82ee-f1a1-40d7-b967-df9e21d2cbda None admin] RBAC: Authorizing `identity:get_user(user_id=e35e5b5f9a4349beb91c29f848414550)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:43.020829 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617b82ee-f1a1-40d7-b967-df9e21d2cbda None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:43.022723 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 135/263] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:42 2022] GET /identity/v3/users/e35e5b5f9a4349beb91c29f848414550 => generated 283 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:43.028516 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b82ee-f1a1-40d7-b967-df9e21d2cbda None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:43.081979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:43.136849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b82ee-f1a1-40d7-b967-df9e21d2cbda None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:43.154802 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b1da5d-48f5-497b-a26f-2dbf5ce871cd None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:43.180342 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd7298-ad7a-4a20-8a8e-c6bcb11d6a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:43.180971 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd7298-ad7a-4a20-8a8e-c6bcb11d6a51 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:43.181811 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd7298-ad7a-4a20-8a8e-c6bcb11d6a51 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:43.182094 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd7298-ad7a-4a20-8a8e-c6bcb11d6a51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:43.215957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d378055-6c04-48cb-b9b3-70255c6dd543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:43.216605 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d378055-6c04-48cb-b9b3-70255c6dd543 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:43.216897 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d378055-6c04-48cb-b9b3-70255c6dd543 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:43.217184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d378055-6c04-48cb-b9b3-70255c6dd543 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:43.250840 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:43.256294 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd7298-ad7a-4a20-8a8e-c6bcb11d6a51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:43.257851 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd7298-ad7a-4a20-8a8e-c6bcb11d6a51 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:43.311804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:43.349145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d378055-6c04-48cb-b9b3-70255c6dd543 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:43.351008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d378055-6c04-48cb-b9b3-70255c6dd543 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:43.380105 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 136/264] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 22:35:43.386416 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd7298-ad7a-4a20-8a8e-c6bcb11d6a51 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:43.515176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd7298-ad7a-4a20-8a8e-c6bcb11d6a51 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:43.559373 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6ff86-d14a-4d45-979a-1a7cea8b9291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:43.560034 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6ff86-d14a-4d45-979a-1a7cea8b9291 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:43.560318 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6ff86-d14a-4d45-979a-1a7cea8b9291 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:43.560602 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c6ff86-d14a-4d45-979a-1a7cea8b9291 None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:43.563920 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 129/265] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 22:35:43.564464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6ff86-d14a-4d45-979a-1a7cea8b9291 None admin] RBAC: Authorizing `identity:get_project(project_id=4e0a8c4e892848b4a8d4fea9a731c82c)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:43.565913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c6ff86-d14a-4d45-979a-1a7cea8b9291 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:43.567862 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 137/266] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:43 2022] GET /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:43.571359 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d378055-6c04-48cb-b9b3-70255c6dd543 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:43.577371 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6ff86-d14a-4d45-979a-1a7cea8b9291 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:43.612579 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:43.681045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:43.775741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c6ff86-d14a-4d45-979a-1a7cea8b9291 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:43.781141 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d378055-6c04-48cb-b9b3-70255c6dd543 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:43.841826 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102aba03-60f0-411a-bce4-2f58619993a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:43.842480 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aba03-60f0-411a-bce4-2f58619993a7 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:43.842767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aba03-60f0-411a-bce4-2f58619993a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:43.843046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102aba03-60f0-411a-bce4-2f58619993a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:43.843848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102aba03-60f0-411a-bce4-2f58619993a7 None admin] RBAC: Adding query filter params (role.id=49e0ba8d8c9f4824892b61f05d0036e8, scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c, user.id=e35e5b5f9a4349beb91c29f848414550) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:43.844162 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102aba03-60f0-411a-bce4-2f58619993a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:43.845617 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102aba03-60f0-411a-bce4-2f58619993a7 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:43.849977 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04c8c2-95c3-4520-b81f-87bd8b139478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:43.850656 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04c8c2-95c3-4520-b81f-87bd8b139478 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:43.850939 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04c8c2-95c3-4520-b81f-87bd8b139478 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:43.851216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e04c8c2-95c3-4520-b81f-87bd8b139478 None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:43.854235 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04c8c2-95c3-4520-b81f-87bd8b139478 None admin] RBAC: Authorizing `identity:get_project(project_id=4e0a8c4e892848b4a8d4fea9a731c82c)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:43.855715 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e04c8c2-95c3-4520-b81f-87bd8b139478 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:43.857413 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 130/267] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:43 2022] GET /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:43.860665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 138/268] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:35:43 2022] GET /identity/v3/role_assignments?user.id=e35e5b5f9a4349beb91c29f848414550&scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c&role.id=49e0ba8d8c9f4824892b61f05d0036e8 => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:43.867499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04c8c2-95c3-4520-b81f-87bd8b139478 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:43.891942 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87ac0-0ea0-40e0-a0ef-ff81877583aa None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:43.892268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87ac0-0ea0-40e0-a0ef-ff81877583aa None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:43.892506 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e87ac0-0ea0-40e0-a0ef-ff81877583aa None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:43.893907 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 139/269] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:35:43.912270 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa0e84-44f7-4304-8ab8-7110ecb774c0 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:43.912575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa0e84-44f7-4304-8ab8-7110ecb774c0 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:43.912828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfa0e84-44f7-4304-8ab8-7110ecb774c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:43.944032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-4dfa0e84-44f7-4304-8ab8-7110ecb774c0 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:43.945311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-4dfa0e84-44f7-4304-8ab8-7110ecb774c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:44.070514 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 140/270] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:44.104946 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e04c8c2-95c3-4520-b81f-87bd8b139478 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:44.109700 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa0e84-44f7-4304-8ab8-7110ecb774c0 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:44.126716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:44.132901 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:44.165409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c497ca8-6496-4f8f-bcc7-d0069d660a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:44.166789 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c497ca8-6496-4f8f-bcc7-d0069d660a07 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:44.167081 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c497ca8-6496-4f8f-bcc7-d0069d660a07 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:44.167361 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c497ca8-6496-4f8f-bcc7-d0069d660a07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:44.168181 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c497ca8-6496-4f8f-bcc7-d0069d660a07 None admin] RBAC: Adding query filter params (role.id=d4ee54c077084dcea38d7476927b61df, scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c, user.id=e35e5b5f9a4349beb91c29f848414550) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:44.168492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c497ca8-6496-4f8f-bcc7-d0069d660a07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:44.169960 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c497ca8-6496-4f8f-bcc7-d0069d660a07 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:44.176754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 131/271] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:35:43 2022] GET /identity/v3/role_assignments?user.id=e35e5b5f9a4349beb91c29f848414550&scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c&role.id=d4ee54c077084dcea38d7476927b61df => generated 608 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:44.178007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab33756-5bb0-4b29-af2f-58f3e538cb03 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:44.178296 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab33756-5bb0-4b29-af2f-58f3e538cb03 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:44.178605 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab33756-5bb0-4b29-af2f-58f3e538cb03 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:44.179869 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 132/272] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:44.180941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcf8eb-8dd0-4222-9472-8dcc4e8dd2e7 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:44.181269 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcf8eb-8dd0-4222-9472-8dcc4e8dd2e7 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:44.181550 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcf8eb-8dd0-4222-9472-8dcc4e8dd2e7 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:44.182897 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 133/273] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:44.188756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42b1ea-a6cb-4595-8910-f374fa711b09 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:44.189271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42b1ea-a6cb-4595-8910-f374fa711b09 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:44.189696 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a42b1ea-a6cb-4595-8910-f374fa711b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:44.211275 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-2a42b1ea-a6cb-4595-8910-f374fa711b09 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:44.213268 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-2a42b1ea-a6cb-4595-8910-f374fa711b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:44.245886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfa0e84-44f7-4304-8ab8-7110ecb774c0 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:44.286612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ae498-c3eb-47c3-a444-a5d9df15987b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:44.287422 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ae498-c3eb-47c3-a444-a5d9df15987b None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:44.287683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ae498-c3eb-47c3-a444-a5d9df15987b None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:44.287964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ae498-c3eb-47c3-a444-a5d9df15987b None admin] PATH_INFO: `/v3/domains/default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:44.289198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ae498-c3eb-47c3-a444-a5d9df15987b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:44.291256 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ae498-c3eb-47c3-a444-a5d9df15987b None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:44.292912 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 141/274] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:35:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:44.293217 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 134/275] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:44.294089 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dd84d-2447-4fa1-a48f-a23904e8c787 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:44.298728 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dd84d-2447-4fa1-a48f-a23904e8c787 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:44.298728 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25dd84d-2447-4fa1-a48f-a23904e8c787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:44.307716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42b1ea-a6cb-4595-8910-f374fa711b09 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:44.320683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-f25dd84d-2447-4fa1-a48f-a23904e8c787 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:44.321991 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-f25dd84d-2447-4fa1-a48f-a23904e8c787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:44.411840 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 142/276] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:44.412699 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dd84d-2447-4fa1-a48f-a23904e8c787 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:44.424517 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:44.439285 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a42b1ea-a6cb-4595-8910-f374fa711b09 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:44.456516 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:44.489511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6c385-b687-4e34-82ec-ac9382701cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:44.490672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6c385-b687-4e34-82ec-ac9382701cc7 None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:44.491125 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6c385-b687-4e34-82ec-ac9382701cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:44.491593 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6c385-b687-4e34-82ec-ac9382701cc7 None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:44.492410 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6c385-b687-4e34-82ec-ac9382701cc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:44.494045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6c385-b687-4e34-82ec-ac9382701cc7 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:44.524116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 135/277] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 22:35:44 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:35:44.525926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6c385-b687-4e34-82ec-ac9382701cc7 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:44.540715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25dd84d-2447-4fa1-a48f-a23904e8c787 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:44.588947 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa421d4a-3487-4de3-8896-9faccd2a310a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:44.589972 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa421d4a-3487-4de3-8896-9faccd2a310a None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:44.590816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa421d4a-3487-4de3-8896-9faccd2a310a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:44.591250 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa421d4a-3487-4de3-8896-9faccd2a310a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:44.608239 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa421d4a-3487-4de3-8896-9faccd2a310a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:44.615205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-aa421d4a-3487-4de3-8896-9faccd2a310a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 22:35:44.615205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:44.615205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:44.615205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:44.615205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:44.615205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:44.615205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:44.615205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:44.615205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:44.615205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:44.615205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:44.615205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:44.615205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:44.615205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:44.615205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:44.615205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:44.616336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:44.616336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:44.616336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:44.616336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:44.616336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:44.616336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:44.616336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:44.616336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:44.616336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:44.616336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:44.616336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:44.616336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:44.616336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:44.616336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:44.616336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:44.616336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:44.617134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:44.617134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:44.617134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:44.617134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:44.617134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:44.617134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:44.617134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:44.617134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:44.617134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:44.617134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:44.617134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 22:35:44.617134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:44.617134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 143/278] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:44.622573 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa421d4a-3487-4de3-8896-9faccd2a310a None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:44.660841 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6c385-b687-4e34-82ec-ac9382701cc7 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:44.706223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa87daf-847a-4f3d-a053-27a3a983c424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:44.706937 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa87daf-847a-4f3d-a053-27a3a983c424 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:44.707217 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa87daf-847a-4f3d-a053-27a3a983c424 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:44.707510 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa87daf-847a-4f3d-a053-27a3a983c424 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:44.711172 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:44.721424 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa87daf-847a-4f3d-a053-27a3a983c424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:44.727054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-5aa87daf-847a-4f3d-a053-27a3a983c424 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:44.727054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:44.727054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:44.727054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:44.727054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:44.727054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:44.727054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:44.727054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:44.727054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:44.727054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:44.727054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:44.727054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:44.727054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:44.727054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:44.727054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:44.727054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:44.728053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:44.728053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:44.728053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:44.728053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:44.728053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:44.728053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:44.728053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:44.728053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:44.728053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:44.728053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:44.728053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:44.728053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:44.728053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:44.728053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:44.728053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:44.728053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:44.728860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:44.728860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:44.728860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:44.728860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:44.728860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:44.728860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:44.728860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:44.728860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:44.728860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:44.728860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:44.728860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:44.728860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:44.728860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 136/279] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:44.730052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9d934-8868-47d3-a2f3-e2f061222d9e None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:44.730052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9d934-8868-47d3-a2f3-e2f061222d9e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:44.730052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9d934-8868-47d3-a2f3-e2f061222d9e None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:44.734369 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 137/280] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:44.735692 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9d934-8868-47d3-a2f3-e2f061222d9e None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:44.761969 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa421d4a-3487-4de3-8896-9faccd2a310a None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:44.769995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:44.805729 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f24cd-8731-45d2-bd2d-3e719df9ca52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:44.806432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f24cd-8731-45d2-bd2d-3e719df9ca52 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:44.806721 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f24cd-8731-45d2-bd2d-3e719df9ca52 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:44.807000 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f24cd-8731-45d2-bd2d-3e719df9ca52 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:44.807789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f24cd-8731-45d2-bd2d-3e719df9ca52 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:44.808031 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f24cd-8731-45d2-bd2d-3e719df9ca52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:44.809405 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f24cd-8731-45d2-bd2d-3e719df9ca52 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:44.821545 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 144/281] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:44.823475 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23fb05-d2e3-4909-b121-8fc0e05e3e26 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:44.823762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23fb05-d2e3-4909-b121-8fc0e05e3e26 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:44.824039 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23fb05-d2e3-4909-b121-8fc0e05e3e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:44.849486 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-eb23fb05-d2e3-4909-b121-8fc0e05e3e26 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:44.850791 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-eb23fb05-d2e3-4909-b121-8fc0e05e3e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:44.859834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9d934-8868-47d3-a2f3-e2f061222d9e None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:44.901189 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cf8a2-f70b-4801-a0ca-30f1a38a3bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:44.901821 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cf8a2-f70b-4801-a0ca-30f1a38a3bc2 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:44.902104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cf8a2-f70b-4801-a0ca-30f1a38a3bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:44.903245 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cf8a2-f70b-4801-a0ca-30f1a38a3bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:44.903245 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cf8a2-f70b-4801-a0ca-30f1a38a3bc2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:44.903510 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cf8a2-f70b-4801-a0ca-30f1a38a3bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:44.904818 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cf8a2-f70b-4801-a0ca-30f1a38a3bc2 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:44.915570 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 138/282] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:44.916805 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cf8a2-f70b-4801-a0ca-30f1a38a3bc2 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:44.940476 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 145/283] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:44.945920 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23fb05-d2e3-4909-b121-8fc0e05e3e26 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:45.032466 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:45.042751 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:45.050600 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cf8a2-f70b-4801-a0ca-30f1a38a3bc2 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:45.083396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23fb05-d2e3-4909-b121-8fc0e05e3e26 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:45.097375 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68265ad-c6d8-4bb8-9e53-b466a4876bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:45.098471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68265ad-c6d8-4bb8-9e53-b466a4876bd8 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:45.099283 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68265ad-c6d8-4bb8-9e53-b466a4876bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:45.100072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68265ad-c6d8-4bb8-9e53-b466a4876bd8 None admin] PATH_INFO: `/v3/users/e25aa802d9bf4dd48d28fe8b101b90ee` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:45.101624 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68265ad-c6d8-4bb8-9e53-b466a4876bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=e25aa802d9bf4dd48d28fe8b101b90ee)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:45.104086 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68265ad-c6d8-4bb8-9e53-b466a4876bd8 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:45.105891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 139/284] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:44 2022] GET /identity/v3/users/e25aa802d9bf4dd48d28fe8b101b90ee => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:45.111340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68265ad-c6d8-4bb8-9e53-b466a4876bd8 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:45.133360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7392319-758c-4127-8bd8-2f8fe09de19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:45.134466 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7392319-758c-4127-8bd8-2f8fe09de19d None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:45.135516 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7392319-758c-4127-8bd8-2f8fe09de19d None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:45.136032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7392319-758c-4127-8bd8-2f8fe09de19d None admin] PATH_INFO: `/v3/users/accf1e5c7457415fb7f11365cb6de786` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:45.155121 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7392319-758c-4127-8bd8-2f8fe09de19d None admin] RBAC: Authorizing `identity:get_user(user_id=accf1e5c7457415fb7f11365cb6de786)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:45.157360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7392319-758c-4127-8bd8-2f8fe09de19d None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:45.159749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 146/285] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:44 2022] GET /identity/v3/users/accf1e5c7457415fb7f11365cb6de786 => generated 293 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:45.160675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7392319-758c-4127-8bd8-2f8fe09de19d None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:45.226837 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68265ad-c6d8-4bb8-9e53-b466a4876bd8 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:45.262900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6cfe6-def3-4672-88ff-b02d89b1e3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:45.263645 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6cfe6-def3-4672-88ff-b02d89b1e3ef None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:45.264000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6cfe6-def3-4672-88ff-b02d89b1e3ef None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:45.264348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6cfe6-def3-4672-88ff-b02d89b1e3ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:45.275710 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6cfe6-def3-4672-88ff-b02d89b1e3ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:45.280900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-b6b6cfe6-def3-4672-88ff-b02d89b1e3ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:45.280900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:45.280900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:45.280900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:45.280900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:45.280900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:45.280900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:45.280900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:45.280900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:45.280900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:45.280900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:45.280900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:45.280900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:45.280900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:45.280900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:45.280900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:45.281984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:45.281984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:45.281984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:45.281984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:45.281984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:45.281984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:45.281984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:45.281984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:45.281984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:45.281984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:45.281984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:45.281984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:45.281984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:45.281984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:45.281984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:45.281984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:45.283041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:45.283041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:45.283041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:45.283041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:45.283041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:45.283041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:45.283041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:45.283041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:45.283041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:45.283041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:45.283041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:45.283041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:45.285445 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 140/286] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:45.285565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7392319-758c-4127-8bd8-2f8fe09de19d None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:45.285657 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6cfe6-def3-4672-88ff-b02d89b1e3ef None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:45.306944 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:45.307685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:45.342687 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986bbd5-1848-4528-a678-32d8d07ba29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:45.343804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986bbd5-1848-4528-a678-32d8d07ba29a None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:45.344228 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986bbd5-1848-4528-a678-32d8d07ba29a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:45.344627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986bbd5-1848-4528-a678-32d8d07ba29a None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:45.346644 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986bbd5-1848-4528-a678-32d8d07ba29a None admin] RBAC: Authorizing `identity:get_project(project_id=4e0a8c4e892848b4a8d4fea9a731c82c)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:45.349023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986bbd5-1848-4528-a678-32d8d07ba29a None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:45.351684 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 147/287] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:45 2022] GET /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:45.352591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986bbd5-1848-4528-a678-32d8d07ba29a None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:45.415635 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6cfe6-def3-4672-88ff-b02d89b1e3ef None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:45.454876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c3c2a-eea4-468d-883d-642a3bf2bcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:45.455647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c3c2a-eea4-468d-883d-642a3bf2bcbf None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:45.456061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c3c2a-eea4-468d-883d-642a3bf2bcbf None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:45.456433 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c3c2a-eea4-468d-883d-642a3bf2bcbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:45.457346 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c3c2a-eea4-468d-883d-642a3bf2bcbf None admin] RBAC: Adding query filter params (role.id=267b3ef4524c42bb90a7002ee1639b74, user.id=accf1e5c7457415fb7f11365cb6de786, scope.system=all) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:45.457729 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c3c2a-eea4-468d-883d-642a3bf2bcbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:45.459319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c3c2a-eea4-468d-883d-642a3bf2bcbf None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:45.470644 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 141/288] 10.222.0.48 () {56 vars in 1308 bytes} [Wed Jul 27 22:35:45 2022] GET /identity/v3/role_assignments?user.id=accf1e5c7457415fb7f11365cb6de786&scope.system=all&role.id=267b3ef4524c42bb90a7002ee1639b74 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:45.471800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c3c2a-eea4-468d-883d-642a3bf2bcbf None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:45.483270 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986bbd5-1848-4528-a678-32d8d07ba29a None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:45.521904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5655d-456d-4a58-b632-971db1bfb626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:45.522590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5655d-456d-4a58-b632-971db1bfb626 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:45.523864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5655d-456d-4a58-b632-971db1bfb626 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:45.524335 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5655d-456d-4a58-b632-971db1bfb626 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:45.525671 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5655d-456d-4a58-b632-971db1bfb626 None admin] RBAC: Adding query filter params (name=member) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:45.525991 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5655d-456d-4a58-b632-971db1bfb626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:45.527469 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5655d-456d-4a58-b632-971db1bfb626 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:45.551313 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 148/289] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:45.557194 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5655d-456d-4a58-b632-971db1bfb626 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:45.654710 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:45.659385 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:45.683252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c3c2a-eea4-468d-883d-642a3bf2bcbf None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:45.731581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145a793-0151-4416-abd4-8a5b086c6300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:45.732540 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145a793-0151-4416-abd4-8a5b086c6300 None admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:45.732827 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145a793-0151-4416-abd4-8a5b086c6300 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:45.733105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145a793-0151-4416-abd4-8a5b086c6300 None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c/users/e25aa802d9bf4dd48d28fe8b101b90ee/roles/6408c231c0fe422fa2f095c2c8fd7a9e` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:45.735102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145a793-0151-4416-abd4-8a5b086c6300 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e0a8c4e892848b4a8d4fea9a731c82c, user_id=e25aa802d9bf4dd48d28fe8b101b90ee, role_id=6408c231c0fe422fa2f095c2c8fd7a9e)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:45.736552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145a793-0151-4416-abd4-8a5b086c6300 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:45.748214 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5655d-456d-4a58-b632-971db1bfb626 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:45.763562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 142/290] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:35:45 2022] PUT /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c/users/e25aa802d9bf4dd48d28fe8b101b90ee/roles/6408c231c0fe422fa2f095c2c8fd7a9e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:35:45.792260 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426baea3-c7a3-4cee-a3ed-6ab0ccb3a4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:45.792944 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426baea3-c7a3-4cee-a3ed-6ab0ccb3a4e6 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:45.793232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426baea3-c7a3-4cee-a3ed-6ab0ccb3a4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:45.793568 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426baea3-c7a3-4cee-a3ed-6ab0ccb3a4e6 None admin] PATH_INFO: `/v3/users/b97d48fcc9f54b1a9225e40f6bcf47be` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:45.794906 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426baea3-c7a3-4cee-a3ed-6ab0ccb3a4e6 None admin] RBAC: Authorizing `identity:get_user(user_id=b97d48fcc9f54b1a9225e40f6bcf47be)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:45.796378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426baea3-c7a3-4cee-a3ed-6ab0ccb3a4e6 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:45.798354 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 149/291] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:45 2022] GET /identity/v3/users/b97d48fcc9f54b1a9225e40f6bcf47be => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:45.804776 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145a793-0151-4416-abd4-8a5b086c6300 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:45.943074 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145a793-0151-4416-abd4-8a5b086c6300 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:45.986843 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f262d13-1a59-4f4e-9b77-6578d88843b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:45.988027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f262d13-1a59-4f4e-9b77-6578d88843b2 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:45.988027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f262d13-1a59-4f4e-9b77-6578d88843b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:45.988027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f262d13-1a59-4f4e-9b77-6578d88843b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:46.008438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:46.069025 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f262d13-1a59-4f4e-9b77-6578d88843b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:46.070861 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f262d13-1a59-4f4e-9b77-6578d88843b2 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:46.194200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 143/292] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:35:46.199388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426baea3-c7a3-4cee-a3ed-6ab0ccb3a4e6 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:46.338615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426baea3-c7a3-4cee-a3ed-6ab0ccb3a4e6 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:46.356351 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:46.383973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97fea41-e64b-4f41-a1f6-a50ddf32e586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:46.384684 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fea41-e64b-4f41-a1f6-a50ddf32e586 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:46.384974 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fea41-e64b-4f41-a1f6-a50ddf32e586 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:46.385254 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97fea41-e64b-4f41-a1f6-a50ddf32e586 None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:46.386468 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fea41-e64b-4f41-a1f6-a50ddf32e586 None admin] RBAC: Authorizing `identity:get_project(project_id=4e0a8c4e892848b4a8d4fea9a731c82c)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:46.387921 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97fea41-e64b-4f41-a1f6-a50ddf32e586 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:46.389767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 150/293] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:46 2022] GET /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:46.395524 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f262d13-1a59-4f4e-9b77-6578d88843b2 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:46.485621 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:46.570694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f262d13-1a59-4f4e-9b77-6578d88843b2 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:46.629318 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9308dd53-4766-42a6-b073-f78d91035b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:46.629953 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308dd53-4766-42a6-b073-f78d91035b32 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:46.630241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308dd53-4766-42a6-b073-f78d91035b32 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:46.630565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308dd53-4766-42a6-b073-f78d91035b32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:46.631369 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308dd53-4766-42a6-b073-f78d91035b32 None admin] RBAC: Adding query filter params (role.id=267b3ef4524c42bb90a7002ee1639b74, scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c, user.id=b97d48fcc9f54b1a9225e40f6bcf47be) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:46.631681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308dd53-4766-42a6-b073-f78d91035b32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:46.633138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9308dd53-4766-42a6-b073-f78d91035b32 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:46.643134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 144/294] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:35:46 2022] GET /identity/v3/role_assignments?user.id=b97d48fcc9f54b1a9225e40f6bcf47be&scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c&role.id=267b3ef4524c42bb90a7002ee1639b74 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:46.952592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940f0e2-afd6-4dd4-997c-08a112df504b None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:46.952965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940f0e2-afd6-4dd4-997c-08a112df504b None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:46.953166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940f0e2-afd6-4dd4-997c-08a112df504b None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:46.954708 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 151/295] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:46.960848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f0a5b-cab3-446a-a032-92ece98d2bac None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:46.961136 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f0a5b-cab3-446a-a032-92ece98d2bac None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:46.961411 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f0a5b-cab3-446a-a032-92ece98d2bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:46.981611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-f13f0a5b-cab3-446a-a032-92ece98d2bac None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:46.983181 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-f13f0a5b-cab3-446a-a032-92ece98d2bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:47.064454 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 145/296] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:47.088558 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940f0e2-afd6-4dd4-997c-08a112df504b None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:47.132039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed9d46-0674-4bf8-8820-7c60f311552c None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:47.132651 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed9d46-0674-4bf8-8820-7c60f311552c None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:47.133158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed9d46-0674-4bf8-8820-7c60f311552c None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:47.135624 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 146/297] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:35:47.140737 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ed627-d5d5-4b65-a3ad-515401b321fe None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:47.141252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ed627-d5d5-4b65-a3ad-515401b321fe None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:47.141727 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ed627-d5d5-4b65-a3ad-515401b321fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:47.162134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-156ed627-d5d5-4b65-a3ad-515401b321fe None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:47.163708 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-156ed627-d5d5-4b65-a3ad-515401b321fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:47.196505 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940f0e2-afd6-4dd4-997c-08a112df504b None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:47.199041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:47.237128 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f3a3a-266b-48e7-8b7a-74acea5c4ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:47.237701 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f3a3a-266b-48e7-8b7a-74acea5c4ba3 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:47.238031 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f3a3a-266b-48e7-8b7a-74acea5c4ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:47.238374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2f3a3a-266b-48e7-8b7a-74acea5c4ba3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:47.254961 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2f3a3a-266b-48e7-8b7a-74acea5c4ba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:47.255229 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 147/298] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:47.260965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-2b2f3a3a-266b-48e7-8b7a-74acea5c4ba3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 22:35:47.260965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:47.260965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:47.260965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:47.260965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:47.260965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:47.260965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:47.260965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:47.260965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:47.260965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:47.260965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:47.260965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:47.260965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:47.260965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:47.260965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:47.260965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:47.261846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:47.261846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:47.261846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:47.261846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:47.261846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:47.261846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:47.261846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:47.261846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:47.261846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:47.261846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:47.261846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:47.261846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:47.261846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:47.261846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:47.261846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:47.261846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:47.262709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:47.262709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:47.262709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:47.262709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:47.262709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:47.262709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:47.262709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:47.262709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:47.262709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:47.262709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:47.262709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 22:35:47.262709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:47.262709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 152/299] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:47.268030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ed627-d5d5-4b65-a3ad-515401b321fe None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:47.284380 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f3a3a-266b-48e7-8b7a-74acea5c4ba3 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:47.355136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:47.405317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ed627-d5d5-4b65-a3ad-515401b321fe None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:47.418608 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2f3a3a-266b-48e7-8b7a-74acea5c4ba3 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:47.450015 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462522a1-63af-4b67-ace1-447681afb977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:47.451507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462522a1-63af-4b67-ace1-447681afb977 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:47.451796 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462522a1-63af-4b67-ace1-447681afb977 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:47.452081 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462522a1-63af-4b67-ace1-447681afb977 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:47.453086 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462522a1-63af-4b67-ace1-447681afb977 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:47.453397 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462522a1-63af-4b67-ace1-447681afb977 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:47.455242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462522a1-63af-4b67-ace1-447681afb977 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:47.461663 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc457a8-dc6f-4949-9e9a-c27cef057f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:47.463247 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc457a8-dc6f-4949-9e9a-c27cef057f8f None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:47.463732 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc457a8-dc6f-4949-9e9a-c27cef057f8f None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:47.464246 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc457a8-dc6f-4949-9e9a-c27cef057f8f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:47.465380 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 148/300] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:47.466150 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc457a8-dc6f-4949-9e9a-c27cef057f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:47.467854 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc457a8-dc6f-4949-9e9a-c27cef057f8f None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:47.474017 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 153/301] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:35:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:47.474136 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462522a1-63af-4b67-ace1-447681afb977 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:47.476392 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc457a8-dc6f-4949-9e9a-c27cef057f8f None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:47.507460 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:47.584264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462522a1-63af-4b67-ace1-447681afb977 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:47.611752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc457a8-dc6f-4949-9e9a-c27cef057f8f None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:47.625829 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:47.635661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc4943-1f75-4378-8f00-74a8e74b9628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:47.636373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc4943-1f75-4378-8f00-74a8e74b9628 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:47.636660 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc4943-1f75-4378-8f00-74a8e74b9628 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:47.637968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc4943-1f75-4378-8f00-74a8e74b9628 None admin] PATH_INFO: `/v3/users/b432480941c94272a68e94f552832fc1` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:47.652569 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc4943-1f75-4378-8f00-74a8e74b9628 None admin] RBAC: Authorizing `identity:get_user(user_id=b432480941c94272a68e94f552832fc1)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:47.654132 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc4943-1f75-4378-8f00-74a8e74b9628 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:47.654905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f654c2-6ea1-46e2-b424-c1e67386ea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:47.655865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f654c2-6ea1-46e2-b424-c1e67386ea4b None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:47.655982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 149/302] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:47 2022] GET /identity/v3/users/b432480941c94272a68e94f552832fc1 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:47.656393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f654c2-6ea1-46e2-b424-c1e67386ea4b None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:47.656672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f654c2-6ea1-46e2-b424-c1e67386ea4b None admin] PATH_INFO: `/v3/groups` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:47.657408 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f654c2-6ea1-46e2-b424-c1e67386ea4b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:47.662371 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f654c2-6ea1-46e2-b424-c1e67386ea4b None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:47.663360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc4943-1f75-4378-8f00-74a8e74b9628 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:47.686926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 154/303] 10.222.0.48 () {60 vars in 1134 bytes} [Wed Jul 27 22:35:47 2022] POST /identity/v3/groups => generated 229 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:35:47.770710 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:47.782502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8623cd3-f59e-484b-b07b-0324c5311f70 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:47.782797 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8623cd3-f59e-484b-b07b-0324c5311f70 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:47.783084 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8623cd3-f59e-484b-b07b-0324c5311f70 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:47.784471 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 155/304] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:35:47.785692 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc4943-1f75-4378-8f00-74a8e74b9628 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:47.791348 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261ac4c-d4df-4213-967a-a826741efebe None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:47.791634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261ac4c-d4df-4213-967a-a826741efebe None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:47.791920 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6261ac4c-d4df-4213-967a-a826741efebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:47.811446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-6261ac4c-d4df-4213-967a-a826741efebe None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:47.812688 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6261ac4c-d4df-4213-967a-a826741efebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:47.825388 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f1388-58a6-49a9-ae59-424fd2dca261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:47.826691 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f1388-58a6-49a9-ae59-424fd2dca261 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:47.826971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f1388-58a6-49a9-ae59-424fd2dca261 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:47.827245 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f1388-58a6-49a9-ae59-424fd2dca261 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:47.828171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f1388-58a6-49a9-ae59-424fd2dca261 None admin] RBAC: Adding query filter params (role.id=6408c231c0fe422fa2f095c2c8fd7a9e, user.id=b432480941c94272a68e94f552832fc1, scope.system=all) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:47.828482 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f1388-58a6-49a9-ae59-424fd2dca261 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:47.829956 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9f1388-58a6-49a9-ae59-424fd2dca261 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:47.836090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 150/305] 10.222.0.48 () {56 vars in 1308 bytes} [Wed Jul 27 22:35:47 2022] GET /identity/v3/role_assignments?user.id=b432480941c94272a68e94f552832fc1&scope.system=all&role.id=6408c231c0fe422fa2f095c2c8fd7a9e => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:47.902473 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 156/306] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:47.922011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f1388-58a6-49a9-ae59-424fd2dca261 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:48.049016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f1388-58a6-49a9-ae59-424fd2dca261 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:48.085197 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e52d8-b1a2-45d9-8e25-f7ecfdcff1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:48.086093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e52d8-b1a2-45d9-8e25-f7ecfdcff1b3 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:48.086549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e52d8-b1a2-45d9-8e25-f7ecfdcff1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:48.087045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104e52d8-b1a2-45d9-8e25-f7ecfdcff1b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:48.098949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104e52d8-b1a2-45d9-8e25-f7ecfdcff1b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:48.104779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-104e52d8-b1a2-45d9-8e25-f7ecfdcff1b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:48.104779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:48.104779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:48.104779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:48.104779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:48.104779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:48.104779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:48.104779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:48.104779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:48.104779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:48.104779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:48.104779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:48.104779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:48.104779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:48.104779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:48.104779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:48.105848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:48.105848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:48.105848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:48.105848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:48.105848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:48.105848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:48.105848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:48.105848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:48.105848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:48.105848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:48.105848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:48.105848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:48.105848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:48.105848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:48.105848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:48.105848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:48.106870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:48.106870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:48.106870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:48.106870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:48.106870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:48.106870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:48.106870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:48.106870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:48.106870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:48.106870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:48.106870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:48.106870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:48.109068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 151/307] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:48.114931 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261ac4c-d4df-4213-967a-a826741efebe None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:48.225694 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6261ac4c-d4df-4213-967a-a826741efebe None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:48.227490 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:48.266719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b996f8f-2d34-439d-a43d-34a83b5a6bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:48.268026 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b996f8f-2d34-439d-a43d-34a83b5a6bb5 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:48.268454 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b996f8f-2d34-439d-a43d-34a83b5a6bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:48.268870 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b996f8f-2d34-439d-a43d-34a83b5a6bb5 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:48.269757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b996f8f-2d34-439d-a43d-34a83b5a6bb5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:48.270205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b996f8f-2d34-439d-a43d-34a83b5a6bb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:48.271749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b996f8f-2d34-439d-a43d-34a83b5a6bb5 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:48.281314 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 157/308] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:48.287672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e52d8-b1a2-45d9-8e25-f7ecfdcff1b3 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:48.310683 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:48.326446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50fba-1293-463e-94bc-f03ea2e43d6a None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:48.326736 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50fba-1293-463e-94bc-f03ea2e43d6a None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:48.327313 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac50fba-1293-463e-94bc-f03ea2e43d6a None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:48.329396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 158/309] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:48.334394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bd74b-cbef-445b-a2b6-66f33819c01c None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:48.334690 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bd74b-cbef-445b-a2b6-66f33819c01c None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:48.334975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bd74b-cbef-445b-a2b6-66f33819c01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:48.354711 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-a71bd74b-cbef-445b-a2b6-66f33819c01c None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:48.355918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a71bd74b-cbef-445b-a2b6-66f33819c01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:48.424904 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104e52d8-b1a2-45d9-8e25-f7ecfdcff1b3 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:48.433790 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 159/310] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:48.457519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bd74b-cbef-445b-a2b6-66f33819c01c None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:48.462983 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdfaf7-2db6-4096-864d-8725ded5aa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:48.463651 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdfaf7-2db6-4096-864d-8725ded5aa3e None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:48.463936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdfaf7-2db6-4096-864d-8725ded5aa3e None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:48.464217 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bdfaf7-2db6-4096-864d-8725ded5aa3e None admin] PATH_INFO: `/v3/users/accf1e5c7457415fb7f11365cb6de786` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:48.465421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdfaf7-2db6-4096-864d-8725ded5aa3e None admin] RBAC: Authorizing `identity:get_user(user_id=accf1e5c7457415fb7f11365cb6de786)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:48.467469 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bdfaf7-2db6-4096-864d-8725ded5aa3e None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:48.469786 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 152/311] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:48 2022] GET /identity/v3/users/accf1e5c7457415fb7f11365cb6de786 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:48.475550 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdfaf7-2db6-4096-864d-8725ded5aa3e None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:48.569427 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:48.576911 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bd74b-cbef-445b-a2b6-66f33819c01c None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:48.583029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:48.606180 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bdfaf7-2db6-4096-864d-8725ded5aa3e None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:48.615662 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1e09b-9476-4936-91eb-daa400dd4d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:48.616320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1e09b-9476-4936-91eb-daa400dd4d20 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:48.616928 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1e09b-9476-4936-91eb-daa400dd4d20 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:48.617046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1e09b-9476-4936-91eb-daa400dd4d20 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:48.629066 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1e09b-9476-4936-91eb-daa400dd4d20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:48.635130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-e8f1e09b-9476-4936-91eb-daa400dd4d20 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 22:35:48.635130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:48.635130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:48.635130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:48.635130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:48.635130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:48.635130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:48.635130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:48.635130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:48.635130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:48.635130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:48.635130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:48.635130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:48.635130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:48.635130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:48.635130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:48.636226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:48.636226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:48.636226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:48.636226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:48.636226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:48.636226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:48.636226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:48.636226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:48.636226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:48.636226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:48.636226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:48.636226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:48.636226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:48.636226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:48.636226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:48.636226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:48.637180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:48.637180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:48.637180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:48.637180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:48.637180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:48.637180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:48.637180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:48.637180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:48.637180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:48.637180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:48.637180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 22:35:48.637180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:48.637180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 160/312] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:48.643560 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1e09b-9476-4936-91eb-daa400dd4d20 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:48.651407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42db2a-0d7f-4f0d-b2f8-b48d7e8a8405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:48.652348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42db2a-0d7f-4f0d-b2f8-b48d7e8a8405 None admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:48.652921 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42db2a-0d7f-4f0d-b2f8-b48d7e8a8405 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:48.653377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42db2a-0d7f-4f0d-b2f8-b48d7e8a8405 None admin] PATH_INFO: `/v3/system/users/accf1e5c7457415fb7f11365cb6de786/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:48.655127 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42db2a-0d7f-4f0d-b2f8-b48d7e8a8405 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=accf1e5c7457415fb7f11365cb6de786, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:48.656804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42db2a-0d7f-4f0d-b2f8-b48d7e8a8405 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:48.667210 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 153/313] 10.222.0.48 () {58 vars in 1334 bytes} [Wed Jul 27 22:35:48 2022] PUT /identity/v3/system/users/accf1e5c7457415fb7f11365cb6de786/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:35:48.764050 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1e09b-9476-4936-91eb-daa400dd4d20 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:48.803005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153bd4f0-cf95-42fe-8583-3cbf7606cf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:48.804081 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bd4f0-cf95-42fe-8583-3cbf7606cf8f None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:48.804607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bd4f0-cf95-42fe-8583-3cbf7606cf8f None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:48.805079 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153bd4f0-cf95-42fe-8583-3cbf7606cf8f None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:48.806568 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bd4f0-cf95-42fe-8583-3cbf7606cf8f None admin] RBAC: Adding query filter params (name=reader) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:48.807084 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bd4f0-cf95-42fe-8583-3cbf7606cf8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:48.808684 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153bd4f0-cf95-42fe-8583-3cbf7606cf8f None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:48.822604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 161/314] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:48.825214 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42db2a-0d7f-4f0d-b2f8-b48d7e8a8405 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:48.931200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42db2a-0d7f-4f0d-b2f8-b48d7e8a8405 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:48.966817 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918efe18-4bad-474c-9090-3ee58ecba4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:48.967846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918efe18-4bad-474c-9090-3ee58ecba4a0 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:48.968328 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918efe18-4bad-474c-9090-3ee58ecba4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:48.968864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918efe18-4bad-474c-9090-3ee58ecba4a0 None admin] PATH_INFO: `/v3/users/e25aa802d9bf4dd48d28fe8b101b90ee` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:48.970329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918efe18-4bad-474c-9090-3ee58ecba4a0 None admin] RBAC: Authorizing `identity:get_user(user_id=e25aa802d9bf4dd48d28fe8b101b90ee)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:48.972013 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918efe18-4bad-474c-9090-3ee58ecba4a0 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:48.974251 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 154/315] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:48 2022] GET /identity/v3/users/e25aa802d9bf4dd48d28fe8b101b90ee => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:48.981194 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153bd4f0-cf95-42fe-8583-3cbf7606cf8f None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:49.002646 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:49.088711 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153bd4f0-cf95-42fe-8583-3cbf7606cf8f None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:49.122227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa49c2-3b6f-42b0-b09e-625e07301de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:49.122883 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa49c2-3b6f-42b0-b09e-625e07301de6 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:49.123168 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa49c2-3b6f-42b0-b09e-625e07301de6 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:49.123462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa49c2-3b6f-42b0-b09e-625e07301de6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:49.191746 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa49c2-3b6f-42b0-b09e-625e07301de6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:49.193221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa49c2-3b6f-42b0-b09e-625e07301de6 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:49.210933 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:49.298539 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 162/316] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:35:49.300023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918efe18-4bad-474c-9090-3ee58ecba4a0 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:49.316235 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:49.414248 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918efe18-4bad-474c-9090-3ee58ecba4a0 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:49.450972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9092916-106c-4ef3-901b-c41369332ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:49.451891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9092916-106c-4ef3-901b-c41369332ec5 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:49.452179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9092916-106c-4ef3-901b-c41369332ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:49.452461 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9092916-106c-4ef3-901b-c41369332ec5 None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:49.453645 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9092916-106c-4ef3-901b-c41369332ec5 None admin] RBAC: Authorizing `identity:get_project(project_id=4e0a8c4e892848b4a8d4fea9a731c82c)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:49.455130 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9092916-106c-4ef3-901b-c41369332ec5 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:49.457111 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 155/317] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:49 2022] GET /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:49.462917 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa49c2-3b6f-42b0-b09e-625e07301de6 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:49.565586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa49c2-3b6f-42b0-b09e-625e07301de6 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:49.588640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:49.609152 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483fa9e6-7811-451f-88a4-f5c07ee7edd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:49.610017 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fa9e6-7811-451f-88a4-f5c07ee7edd0 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:49.610556 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fa9e6-7811-451f-88a4-f5c07ee7edd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:49.611056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483fa9e6-7811-451f-88a4-f5c07ee7edd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:49.612043 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fa9e6-7811-451f-88a4-f5c07ee7edd0 None admin] RBAC: Adding query filter params (role.id=6408c231c0fe422fa2f095c2c8fd7a9e, scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c, user.id=e25aa802d9bf4dd48d28fe8b101b90ee) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:49.612574 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fa9e6-7811-451f-88a4-f5c07ee7edd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:49.614208 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483fa9e6-7811-451f-88a4-f5c07ee7edd0 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:49.620885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 163/318] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:35:49 2022] GET /identity/v3/role_assignments?user.id=e25aa802d9bf4dd48d28fe8b101b90ee&scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c&role.id=6408c231c0fe422fa2f095c2c8fd7a9e => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:49.896708 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461ac97-764e-463d-88f3-adbc372c2e5c None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:49.897074 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461ac97-764e-463d-88f3-adbc372c2e5c None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:49.897277 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461ac97-764e-463d-88f3-adbc372c2e5c None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:49.898854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 156/319] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:49.901270 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf8558-6399-4359-9271-d146d739d8c5 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:49.901557 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf8558-6399-4359-9271-d146d739d8c5 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:49.901827 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf8558-6399-4359-9271-d146d739d8c5 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:49.903375 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 164/320] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:49.904527 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ce02f-5b93-4a76-8d43-00d916ed5f1b None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:49.904828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ce02f-5b93-4a76-8d43-00d916ed5f1b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:49.905113 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488ce02f-5b93-4a76-8d43-00d916ed5f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:49.908752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81999bcc-031e-4a3a-81ef-3c7e45837973 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:49.909062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81999bcc-031e-4a3a-81ef-3c7e45837973 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:49.909312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81999bcc-031e-4a3a-81ef-3c7e45837973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:49.924513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-488ce02f-5b93-4a76-8d43-00d916ed5f1b None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:49.925707 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-488ce02f-5b93-4a76-8d43-00d916ed5f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:49.927837 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-81999bcc-031e-4a3a-81ef-3c7e45837973 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:49.929124 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-81999bcc-031e-4a3a-81ef-3c7e45837973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:50.000903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 157/321] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:50.003823 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 165/322] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:50.021926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ce02f-5b93-4a76-8d43-00d916ed5f1b None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:50.028809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81999bcc-031e-4a3a-81ef-3c7e45837973 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:50.033540 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:50.127356 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488ce02f-5b93-4a76-8d43-00d916ed5f1b None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:50.135750 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81999bcc-031e-4a3a-81ef-3c7e45837973 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:50.150618 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:50.161407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ca823-592b-4b10-ab89-1b30cf3eb248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:50.162557 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ca823-592b-4b10-ab89-1b30cf3eb248 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:50.162854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ca823-592b-4b10-ab89-1b30cf3eb248 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:50.163135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ca823-592b-4b10-ab89-1b30cf3eb248 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:50.164423 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ca823-592b-4b10-ab89-1b30cf3eb248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:50.166482 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097ca823-592b-4b10-ab89-1b30cf3eb248 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:50.172600 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 158/323] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:35:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:50.173440 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ca823-592b-4b10-ab89-1b30cf3eb248 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:50.183252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be530d9b-1041-440d-9923-c40567703018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:50.183912 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be530d9b-1041-440d-9923-c40567703018 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:50.184198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be530d9b-1041-440d-9923-c40567703018 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:50.184477 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be530d9b-1041-440d-9923-c40567703018 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:50.195216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be530d9b-1041-440d-9923-c40567703018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:50.200710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-be530d9b-1041-440d-9923-c40567703018 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 22:35:50.200710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:50.200710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:50.200710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:50.200710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:50.200710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:50.200710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:50.200710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:50.200710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:50.200710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:50.200710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:50.200710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:50.200710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:50.200710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:50.200710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:50.200710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:50.201841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:50.201841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:50.201841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:50.201841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:50.201841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:50.201841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:50.201841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:50.201841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:50.201841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:50.201841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:50.201841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:50.201841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:50.201841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:50.201841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:50.201841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:50.201841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:50.202678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:50.202678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:50.202678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:50.202678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:50.202678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:50.202678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:50.202678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:50.202678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:50.202678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:50.202678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:50.202678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 22:35:50.202678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:50.202678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 166/324] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:35:50.208151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be530d9b-1041-440d-9923-c40567703018 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:50.264283 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:50.288137 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ca823-592b-4b10-ab89-1b30cf3eb248 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:50.318506 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be530d9b-1041-440d-9923-c40567703018 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:50.326671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476475b-0d7e-422c-bec6-a552311d75d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:50.327306 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476475b-0d7e-422c-bec6-a552311d75d9 None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:50.327584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476475b-0d7e-422c-bec6-a552311d75d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:50.327852 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476475b-0d7e-422c-bec6-a552311d75d9 None admin] PATH_INFO: `/v3/groups` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:50.328543 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476475b-0d7e-422c-bec6-a552311d75d9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:50.329967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476475b-0d7e-422c-bec6-a552311d75d9 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:50.347939 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 159/325] 10.222.0.48 () {60 vars in 1134 bytes} [Wed Jul 27 22:35:50 2022] POST /identity/v3/groups => generated 226 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:35:50.357735 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a582c-8a26-4ed0-96f7-93e7da067ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:50.358525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a582c-8a26-4ed0-96f7-93e7da067ada None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:50.358906 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a582c-8a26-4ed0-96f7-93e7da067ada None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:50.359193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9a582c-8a26-4ed0-96f7-93e7da067ada None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:50.359937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a582c-8a26-4ed0-96f7-93e7da067ada None admin] RBAC: Adding query filter params (name=reader) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:50.360249 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a582c-8a26-4ed0-96f7-93e7da067ada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:50.361677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9a582c-8a26-4ed0-96f7-93e7da067ada None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:50.371747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 167/326] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:50.378477 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476475b-0d7e-422c-bec6-a552311d75d9 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:50.488965 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476475b-0d7e-422c-bec6-a552311d75d9 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:50.524664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6bd070-35ef-40d2-bd9c-17f57e2599b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:50.525885 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bd070-35ef-40d2-bd9c-17f57e2599b3 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:50.526139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bd070-35ef-40d2-bd9c-17f57e2599b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:50.526443 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6bd070-35ef-40d2-bd9c-17f57e2599b3 None admin] PATH_INFO: `/v3/users/b432480941c94272a68e94f552832fc1` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:50.527608 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bd070-35ef-40d2-bd9c-17f57e2599b3 None admin] RBAC: Authorizing `identity:get_user(user_id=b432480941c94272a68e94f552832fc1)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:50.529053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6bd070-35ef-40d2-bd9c-17f57e2599b3 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:50.530889 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 160/327] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:50 2022] GET /identity/v3/users/b432480941c94272a68e94f552832fc1 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:50.536749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a582c-8a26-4ed0-96f7-93e7da067ada None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:50.570259 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:50.647491 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9a582c-8a26-4ed0-96f7-93e7da067ada None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:50.685898 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3967692-32e3-4814-ba6f-149a8a256a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:50.687973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3967692-32e3-4814-ba6f-149a8a256a0e None admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:50.687973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3967692-32e3-4814-ba6f-149a8a256a0e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:50.687973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3967692-32e3-4814-ba6f-149a8a256a0e None admin] PATH_INFO: `/v3/system/users/b432480941c94272a68e94f552832fc1/roles/6408c231c0fe422fa2f095c2c8fd7a9e` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:50.688746 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3967692-32e3-4814-ba6f-149a8a256a0e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b432480941c94272a68e94f552832fc1, role_id=6408c231c0fe422fa2f095c2c8fd7a9e)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:50.690145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3967692-32e3-4814-ba6f-149a8a256a0e None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:50.701694 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 168/328] 10.222.0.48 () {58 vars in 1334 bytes} [Wed Jul 27 22:35:50 2022] PUT /identity/v3/system/users/b432480941c94272a68e94f552832fc1/roles/6408c231c0fe422fa2f095c2c8fd7a9e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:35:50.828349 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed226e5b-ee4c-4b0a-9d06-beab6f4c8617 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:50.828556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed226e5b-ee4c-4b0a-9d06-beab6f4c8617 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:50.828860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed226e5b-ee4c-4b0a-9d06-beab6f4c8617 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:50.830221 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 161/329] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:50.835994 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b894c9-cba6-4135-a3f1-1c2ee80a9a51 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:50.836287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b894c9-cba6-4135-a3f1-1c2ee80a9a51 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:50.836574 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b894c9-cba6-4135-a3f1-1c2ee80a9a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:50.860924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-80b894c9-cba6-4135-a3f1-1c2ee80a9a51 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:50.862130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-80b894c9-cba6-4135-a3f1-1c2ee80a9a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:50.937449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 169/330] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:50.963842 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed226e5b-ee4c-4b0a-9d06-beab6f4c8617 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:50.973531 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:51.086909 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed226e5b-ee4c-4b0a-9d06-beab6f4c8617 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:51.126235 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e12948-819d-4d1b-9b51-e6119fa0bcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:51.126931 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e12948-819d-4d1b-9b51-e6119fa0bcaa None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:51.127220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e12948-819d-4d1b-9b51-e6119fa0bcaa None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:51.127499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e12948-819d-4d1b-9b51-e6119fa0bcaa None admin] PATH_INFO: `/v3/roles/member` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:51.141054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e12948-819d-4d1b-9b51-e6119fa0bcaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:51.146744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-b9e12948-819d-4d1b-9b51-e6119fa0bcaa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:51.146744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:51.146744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:51.146744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:51.146744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:51.146744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:51.146744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:51.146744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:51.146744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:51.146744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:51.146744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:51.146744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:51.146744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:51.146744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:51.146744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:51.146744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:51.147618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:51.147618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:51.147618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:51.147618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:51.147618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:51.147618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:51.147618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:51.147618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:51.147618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:51.147618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:51.147618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:51.147618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:51.147618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:51.147618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:51.147618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:51.147618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:51.148407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:51.148407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:51.148407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:51.148407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:51.148407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:51.148407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:51.148407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:51.148407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:51.148407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:51.148407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:51.148407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:51.148407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:51.148407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 162/331] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:51.156394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b894c9-cba6-4135-a3f1-1c2ee80a9a51 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:51.190864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:51.277366 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b894c9-cba6-4135-a3f1-1c2ee80a9a51 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:51.327461 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3a8ec-a129-400f-ba7f-60f232ed52aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:51.328214 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3a8ec-a129-400f-ba7f-60f232ed52aa None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:51.328381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3a8ec-a129-400f-ba7f-60f232ed52aa None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:51.328660 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3a8ec-a129-400f-ba7f-60f232ed52aa None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:51.329384 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3a8ec-a129-400f-ba7f-60f232ed52aa None admin] RBAC: Adding query filter params (name=member) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:51.329696 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3a8ec-a129-400f-ba7f-60f232ed52aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:51.331104 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3a8ec-a129-400f-ba7f-60f232ed52aa None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:51.345892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 170/332] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:51.352992 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e12948-819d-4d1b-9b51-e6119fa0bcaa None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:51.434741 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:51.483105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e12948-819d-4d1b-9b51-e6119fa0bcaa None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:51.533138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb230c-44f7-42ab-8431-92ba6ffea271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:51.533804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb230c-44f7-42ab-8431-92ba6ffea271 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:51.534087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb230c-44f7-42ab-8431-92ba6ffea271 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:51.534388 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb230c-44f7-42ab-8431-92ba6ffea271 None admin] PATH_INFO: `/v3/users/accf1e5c7457415fb7f11365cb6de786` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:51.539037 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb230c-44f7-42ab-8431-92ba6ffea271 None admin] RBAC: Authorizing `identity:get_user(user_id=accf1e5c7457415fb7f11365cb6de786)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:51.540528 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb230c-44f7-42ab-8431-92ba6ffea271 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:51.542475 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 163/333] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:51 2022] GET /identity/v3/users/accf1e5c7457415fb7f11365cb6de786 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:51.547865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3a8ec-a129-400f-ba7f-60f232ed52aa None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:51.682699 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:51.697465 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3a8ec-a129-400f-ba7f-60f232ed52aa None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:51.737654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6c65e-3a2d-49a9-a970-424b4ebe0d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:51.738280 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6c65e-3a2d-49a9-a970-424b4ebe0d56 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:51.738590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6c65e-3a2d-49a9-a970-424b4ebe0d56 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:51.738867 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6c65e-3a2d-49a9-a970-424b4ebe0d56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:51.739667 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6c65e-3a2d-49a9-a970-424b4ebe0d56 None admin] RBAC: Adding query filter params (role.id=267b3ef4524c42bb90a7002ee1639b74, user.id=accf1e5c7457415fb7f11365cb6de786, scope.system=all) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:51.739981 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6c65e-3a2d-49a9-a970-424b4ebe0d56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:51.741412 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6c65e-3a2d-49a9-a970-424b4ebe0d56 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:51.761441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 171/334] 10.222.0.48 () {56 vars in 1308 bytes} [Wed Jul 27 22:35:51 2022] GET /identity/v3/role_assignments?user.id=accf1e5c7457415fb7f11365cb6de786&scope.system=all&role.id=267b3ef4524c42bb90a7002ee1639b74 => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:53.316182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4daddf-6535-4c8d-84aa-7c2de520849b None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:53.316688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4daddf-6535-4c8d-84aa-7c2de520849b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:53.318524 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4daddf-6535-4c8d-84aa-7c2de520849b None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:53.318524 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 164/335] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:53.332593 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e884e-df24-4f3e-bd6b-a7ed776acc3a None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:53.333097 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e884e-df24-4f3e-bd6b-a7ed776acc3a None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:53.333171 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e884e-df24-4f3e-bd6b-a7ed776acc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:53.359200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab15b7-5c75-4fad-9d38-cc6ccfbb27d6 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:53.359504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab15b7-5c75-4fad-9d38-cc6ccfbb27d6 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:53.359770 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab15b7-5c75-4fad-9d38-cc6ccfbb27d6 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:53.361126 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 165/336] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:35:53.366252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37edeb-2116-4ae4-b754-902718dd2ffb None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:53.370809 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37edeb-2116-4ae4-b754-902718dd2ffb None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:53.371157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37edeb-2116-4ae4-b754-902718dd2ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:53.376617 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-3c6e884e-df24-4f3e-bd6b-a7ed776acc3a None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:53.382904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-3c6e884e-df24-4f3e-bd6b-a7ed776acc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:53.409803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-8b37edeb-2116-4ae4-b754-902718dd2ffb None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:53.415313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8b37edeb-2116-4ae4-b754-902718dd2ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:53.553891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 166/337] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:53.555046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f52a62-81fc-41fe-bfc8-ce52396b896a None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:53.555340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f52a62-81fc-41fe-bfc8-ce52396b896a None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:53.555624 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f52a62-81fc-41fe-bfc8-ce52396b896a None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:53.557601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 167/338] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:53.564905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 172/339] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:53.566166 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217173db-23a2-438a-be27-44220b19b974 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:53.566547 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217173db-23a2-438a-be27-44220b19b974 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:53.566783 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217173db-23a2-438a-be27-44220b19b974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:53.589429 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e884e-df24-4f3e-bd6b-a7ed776acc3a None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:53.615416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-217173db-23a2-438a-be27-44220b19b974 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:53.617056 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-217173db-23a2-438a-be27-44220b19b974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:53.681865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:53.706116 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e884e-df24-4f3e-bd6b-a7ed776acc3a None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:53.744713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 168/340] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:53.745905 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217173db-23a2-438a-be27-44220b19b974 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:53.751017 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:53.757004 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d91257-5191-408b-b211-7d4734217291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:53.757680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d91257-5191-408b-b211-7d4734217291 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:53.757992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d91257-5191-408b-b211-7d4734217291 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:53.758277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d91257-5191-408b-b211-7d4734217291 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:53.773695 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d91257-5191-408b-b211-7d4734217291 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:53.778897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-f6d91257-5191-408b-b211-7d4734217291 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:53.778897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:53.778897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:53.778897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:53.778897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:53.778897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:53.778897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:53.778897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:53.778897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:53.778897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:53.778897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:53.778897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:53.778897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:53.778897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:53.778897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:53.778897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:53.779788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:53.779788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:53.779788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:53.779788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:53.779788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:53.779788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:53.779788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:53.779788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:53.779788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:53.779788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:53.779788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:53.779788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:53.779788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:53.779788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:53.779788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:53.779788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:53.780597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:53.780597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:53.780597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:53.780597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:53.780597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:53.780597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:53.780597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:53.780597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:53.780597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:53.780597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:53.780597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:53.780597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:53.784901 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 173/341] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:53.786125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d91257-5191-408b-b211-7d4734217291 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:53.863565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217173db-23a2-438a-be27-44220b19b974 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:53.904022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61316310-5a90-42ac-bf76-2e856f59ba7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:53.905027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61316310-5a90-42ac-bf76-2e856f59ba7f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:53.905513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61316310-5a90-42ac-bf76-2e856f59ba7f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:53.905992 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61316310-5a90-42ac-bf76-2e856f59ba7f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:53.919611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61316310-5a90-42ac-bf76-2e856f59ba7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:53.923475 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d91257-5191-408b-b211-7d4734217291 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:53.926426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-61316310-5a90-42ac-bf76-2e856f59ba7f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:35:53.926426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:53.926426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:53.926426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:53.926426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:53.926426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:53.926426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:53.926426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:53.926426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:53.926426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:53.926426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:53.926426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:53.926426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:53.926426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:53.926426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:53.926426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:53.927295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:53.927295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:53.927295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:53.927295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:53.927295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:53.927295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:53.927295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:53.927295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:53.927295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:53.927295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:53.927295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:53.927295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:53.927295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:53.927295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:53.927295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:53.927295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:53.928083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:53.928083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:53.928083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:53.928083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:53.928083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:53.928083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:53.928083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:53.928083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:53.928083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:53.928083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:53.928083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:35:53.928083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:53.930713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 169/342] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:35:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:53.931753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61316310-5a90-42ac-bf76-2e856f59ba7f None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:53.983610 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496cbfa-413f-4e92-8bd0-71bf52e02c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:53.984253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496cbfa-413f-4e92-8bd0-71bf52e02c93 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:53.984542 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496cbfa-413f-4e92-8bd0-71bf52e02c93 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:53.984824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2496cbfa-413f-4e92-8bd0-71bf52e02c93 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:53.985549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496cbfa-413f-4e92-8bd0-71bf52e02c93 None admin] RBAC: Adding query filter params (name=member) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:53.985872 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496cbfa-413f-4e92-8bd0-71bf52e02c93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:53.987284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2496cbfa-413f-4e92-8bd0-71bf52e02c93 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:53.998752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:54.000678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 174/343] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:54.001573 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496cbfa-413f-4e92-8bd0-71bf52e02c93 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:54.004057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:54.047818 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61316310-5a90-42ac-bf76-2e856f59ba7f None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:54.084541 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da200d70-c288-4623-89bd-47d29e40c4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:54.085547 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da200d70-c288-4623-89bd-47d29e40c4cb None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:54.086036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da200d70-c288-4623-89bd-47d29e40c4cb None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:54.086613 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da200d70-c288-4623-89bd-47d29e40c4cb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:54.100815 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da200d70-c288-4623-89bd-47d29e40c4cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:54.108106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-da200d70-c288-4623-89bd-47d29e40c4cb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 22:35:54.108106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:54.108106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:54.108106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:54.108106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:54.108106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:54.108106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:54.108106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:54.108106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:54.108106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:54.108106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:54.108106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:54.108106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:54.108106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:54.108106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:54.108106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:54.109008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:54.109008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:54.109008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:54.109008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:54.109008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:54.109008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:54.109008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:54.109008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:54.109008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:54.109008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:54.109008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:54.109008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:54.109008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:54.109008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:54.109008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:54.109008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:54.109847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:54.109847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:54.109847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:54.109847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:54.109847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:54.109847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:54.109847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:54.109847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:54.109847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:54.109847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:54.109847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 22:35:54.109847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:54.112102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 170/344] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:54.112755 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da200d70-c288-4623-89bd-47d29e40c4cb None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:54.171792 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2496cbfa-413f-4e92-8bd0-71bf52e02c93 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:54.213220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c2366-f5c6-4fab-ba28-b28122f72657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:54.213785 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c2366-f5c6-4fab-ba28-b28122f72657 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:54.214066 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c2366-f5c6-4fab-ba28-b28122f72657 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:54.214360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c2366-f5c6-4fab-ba28-b28122f72657 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:54.216526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c2366-f5c6-4fab-ba28-b28122f72657 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:54.216526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c2366-f5c6-4fab-ba28-b28122f72657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:54.217618 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c2366-f5c6-4fab-ba28-b28122f72657 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:54.226782 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 175/345] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:35:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:54.228796 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea338c5-6ca0-4ab3-9461-9f506dac64ac None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:54.228955 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea338c5-6ca0-4ab3-9461-9f506dac64ac None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:54.229226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea338c5-6ca0-4ab3-9461-9f506dac64ac None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:54.234496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 176/346] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:54.234496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea338c5-6ca0-4ab3-9461-9f506dac64ac None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:54.265242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da200d70-c288-4623-89bd-47d29e40c4cb None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:54.287104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:54.315656 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7d1d1-c6f5-4cd4-9e16-a1fbbd4da587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:54.316649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7d1d1-c6f5-4cd4-9e16-a1fbbd4da587 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:54.317898 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7d1d1-c6f5-4cd4-9e16-a1fbbd4da587 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:54.318685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7d1d1-c6f5-4cd4-9e16-a1fbbd4da587 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:54.321340 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:54.377631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea338c5-6ca0-4ab3-9461-9f506dac64ac None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:54.401784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7d1d1-c6f5-4cd4-9e16-a1fbbd4da587 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:54.403623 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7d1d1-c6f5-4cd4-9e16-a1fbbd4da587 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:54.416318 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a2f74-60c5-4217-b132-62185b8d3c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:54.417026 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a2f74-60c5-4217-b132-62185b8d3c96 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:54.417406 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a2f74-60c5-4217-b132-62185b8d3c96 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:54.417692 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a2f74-60c5-4217-b132-62185b8d3c96 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:54.418482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a2f74-60c5-4217-b132-62185b8d3c96 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:54.418790 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a2f74-60c5-4217-b132-62185b8d3c96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:54.420366 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a2f74-60c5-4217-b132-62185b8d3c96 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:54.430614 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 177/347] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:54.431993 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6929c-e757-4bed-81d7-43bb57082d80 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:54.432292 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6929c-e757-4bed-81d7-43bb57082d80 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:54.432575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6929c-e757-4bed-81d7-43bb57082d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:54.453333 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-00d6929c-e757-4bed-81d7-43bb57082d80 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:54.454571 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-00d6929c-e757-4bed-81d7-43bb57082d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:54.528436 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 178/348] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:54.529333 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6929c-e757-4bed-81d7-43bb57082d80 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:54.535112 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 171/349] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:35:54.536157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7d1d1-c6f5-4cd4-9e16-a1fbbd4da587 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:54.556259 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:54.614485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:54.653610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7d1d1-c6f5-4cd4-9e16-a1fbbd4da587 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:54.666554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6929c-e757-4bed-81d7-43bb57082d80 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:54.693041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11c7ba-b7b4-4310-82e0-8a46f42a88ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:54.693947 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11c7ba-b7b4-4310-82e0-8a46f42a88ca None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:54.694236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11c7ba-b7b4-4310-82e0-8a46f42a88ca None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:54.694545 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b11c7ba-b7b4-4310-82e0-8a46f42a88ca None admin] PATH_INFO: `/v3/users/b432480941c94272a68e94f552832fc1` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:54.695747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11c7ba-b7b4-4310-82e0-8a46f42a88ca None admin] RBAC: Authorizing `identity:get_user(user_id=b432480941c94272a68e94f552832fc1)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:54.697755 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b11c7ba-b7b4-4310-82e0-8a46f42a88ca None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:54.699420 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 172/350] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:35:54 2022] GET /identity/v3/users/b432480941c94272a68e94f552832fc1 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:54.700135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11c7ba-b7b4-4310-82e0-8a46f42a88ca None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:54.711927 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbe7c48-dba7-40e1-a867-16f7fd2413db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:54.712962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe7c48-dba7-40e1-a867-16f7fd2413db None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:54.712962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe7c48-dba7-40e1-a867-16f7fd2413db None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:54.713153 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe7c48-dba7-40e1-a867-16f7fd2413db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:54.794765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:54.794958 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe7c48-dba7-40e1-a867-16f7fd2413db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:54.796698 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbe7c48-dba7-40e1-a867-16f7fd2413db None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:54.821351 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b11c7ba-b7b4-4310-82e0-8a46f42a88ca None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:54.858492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce109a5-a16f-403a-a4e0-b711de87ab6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:54.859426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce109a5-a16f-403a-a4e0-b711de87ab6b None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:54.859879 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce109a5-a16f-403a-a4e0-b711de87ab6b None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:54.860346 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce109a5-a16f-403a-a4e0-b711de87ab6b None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:54.861678 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce109a5-a16f-403a-a4e0-b711de87ab6b None admin] RBAC: Authorizing `identity:get_project(project_id=bed1abbcdf7b4207893b683a5d6c0eb0)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:54.863320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce109a5-a16f-403a-a4e0-b711de87ab6b None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:54.865460 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 173/351] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:54 2022] GET /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:54.865614 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:54.866704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce109a5-a16f-403a-a4e0-b711de87ab6b None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:54.924330 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 179/352] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:35:54.925698 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c820698-2a5a-483e-837e-b549f64a6fa1 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:54.925990 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c820698-2a5a-483e-837e-b549f64a6fa1 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:54.926272 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c820698-2a5a-483e-837e-b549f64a6fa1 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:54.927686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 180/353] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:54.932156 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c820698-2a5a-483e-837e-b549f64a6fa1 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:54.986037 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce109a5-a16f-403a-a4e0-b711de87ab6b None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:55.028721 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa9511-18e5-40f8-8470-0e8266026489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:55.029081 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa9511-18e5-40f8-8470-0e8266026489 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:55.029362 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa9511-18e5-40f8-8470-0e8266026489 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:55.029645 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa9511-18e5-40f8-8470-0e8266026489 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:55.043461 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa9511-18e5-40f8-8470-0e8266026489 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:55.049928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-80fa9511-18e5-40f8-8470-0e8266026489 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:55.049928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:55.049928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:55.049928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:55.049928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:55.049928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:55.049928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:55.049928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:55.049928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:55.049928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:55.049928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:55.049928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:55.049928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:55.049928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:55.049928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:55.049928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:55.050997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:55.050997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:55.050997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:55.050997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:55.050997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:55.050997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:55.050997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:55.050997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:55.050997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:55.050997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:55.050997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:55.050997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:55.050997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:55.050997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:55.050997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:55.050997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:55.051772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:55.051772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:55.051772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:55.051772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:55.051772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:55.051772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:55.051772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:55.051772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:55.051772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:55.051772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:55.051772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:55.051772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:55.051772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 174/354] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:55.052462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa9511-18e5-40f8-8470-0e8266026489 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:55.067835 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:55.084965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c820698-2a5a-483e-837e-b549f64a6fa1 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:55.133751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d0c78-0cd1-4de5-be59-673da6998d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:55.135219 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d0c78-0cd1-4de5-be59-673da6998d30 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:55.135666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d0c78-0cd1-4de5-be59-673da6998d30 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:55.136098 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d0c78-0cd1-4de5-be59-673da6998d30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:55.137015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d0c78-0cd1-4de5-be59-673da6998d30 None admin] RBAC: Adding query filter params (role.id=6408c231c0fe422fa2f095c2c8fd7a9e, user.id=b432480941c94272a68e94f552832fc1, scope.system=all) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:55.137462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d0c78-0cd1-4de5-be59-673da6998d30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:55.139047 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d0c78-0cd1-4de5-be59-673da6998d30 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:55.156293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 181/355] 10.222.0.48 () {56 vars in 1308 bytes} [Wed Jul 27 22:35:54 2022] GET /identity/v3/role_assignments?user.id=b432480941c94272a68e94f552832fc1&scope.system=all&role.id=6408c231c0fe422fa2f095c2c8fd7a9e => generated 510 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:55.157518 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d0c78-0cd1-4de5-be59-673da6998d30 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:55.172914 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:55.209304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa9511-18e5-40f8-8470-0e8266026489 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:55.252410 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73169c62-9b41-4614-b550-8c1777cc3e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:55.252995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73169c62-9b41-4614-b550-8c1777cc3e07 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:55.253280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73169c62-9b41-4614-b550-8c1777cc3e07 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:55.253663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73169c62-9b41-4614-b550-8c1777cc3e07 None admin] PATH_INFO: `/v3/groups/5144b06cc24d4ac1adebf28e5854fef5` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:55.261857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73169c62-9b41-4614-b550-8c1777cc3e07 None admin] RBAC: Authorizing `identity:get_group(group_id=5144b06cc24d4ac1adebf28e5854fef5)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:55.263368 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73169c62-9b41-4614-b550-8c1777cc3e07 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:55.270486 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 175/356] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 22:35:55 2022] GET /identity/v3/groups/5144b06cc24d4ac1adebf28e5854fef5 => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:55.271995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa87ac5-84c0-4d47-a2f1-c76748578414 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:55.272297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa87ac5-84c0-4d47-a2f1-c76748578414 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:55.272580 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa87ac5-84c0-4d47-a2f1-c76748578414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:55.292889 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d0c78-0cd1-4de5-be59-673da6998d30 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:55.295446 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-efa87ac5-84c0-4d47-a2f1-c76748578414 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:55.296744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-efa87ac5-84c0-4d47-a2f1-c76748578414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:55.345938 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522436c-b851-4ac5-8c9c-e93273b402fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:55.348516 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522436c-b851-4ac5-8c9c-e93273b402fa None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:55.348808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522436c-b851-4ac5-8c9c-e93273b402fa None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:55.349087 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522436c-b851-4ac5-8c9c-e93273b402fa None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:55.350331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522436c-b851-4ac5-8c9c-e93273b402fa None admin] RBAC: Authorizing `identity:get_project(project_id=bed1abbcdf7b4207893b683a5d6c0eb0)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:55.351806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f522436c-b851-4ac5-8c9c-e93273b402fa None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:55.353893 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 182/357] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:55 2022] GET /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:55.354846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522436c-b851-4ac5-8c9c-e93273b402fa None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:55.380912 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 176/358] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:55.382540 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa87ac5-84c0-4d47-a2f1-c76748578414 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:55.387503 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:55.457809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:55.485941 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522436c-b851-4ac5-8c9c-e93273b402fa None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:55.503737 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa87ac5-84c0-4d47-a2f1-c76748578414 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:55.524843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a419246-1ad8-457e-b23f-6e2f6c3ff159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:55.525864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a419246-1ad8-457e-b23f-6e2f6c3ff159 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:55.526363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a419246-1ad8-457e-b23f-6e2f6c3ff159 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:55.526670 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a419246-1ad8-457e-b23f-6e2f6c3ff159 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:55.527403 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a419246-1ad8-457e-b23f-6e2f6c3ff159 None admin] RBAC: Adding query filter params (name=member) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:55.529714 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a419246-1ad8-457e-b23f-6e2f6c3ff159 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:55.529714 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a419246-1ad8-457e-b23f-6e2f6c3ff159 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:55.539212 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 183/359] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:55.539823 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a419246-1ad8-457e-b23f-6e2f6c3ff159 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:55.549776 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19125e25-495f-4899-aaaa-9abdd76feaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:55.551112 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19125e25-495f-4899-aaaa-9abdd76feaa6 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:55.551581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19125e25-495f-4899-aaaa-9abdd76feaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:55.551871 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19125e25-495f-4899-aaaa-9abdd76feaa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:55.552680 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19125e25-495f-4899-aaaa-9abdd76feaa6 None admin] RBAC: Adding query filter params (group.id=5144b06cc24d4ac1adebf28e5854fef5, role.id=267b3ef4524c42bb90a7002ee1639b74, scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:55.553379 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19125e25-495f-4899-aaaa-9abdd76feaa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:55.555269 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19125e25-495f-4899-aaaa-9abdd76feaa6 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:55.564233 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 177/360] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jul 27 22:35:55 2022] GET /identity/v3/role_assignments?group.id=5144b06cc24d4ac1adebf28e5854fef5&scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0&role.id=267b3ef4524c42bb90a7002ee1639b74 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:55.565301 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19125e25-495f-4899-aaaa-9abdd76feaa6 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:55.663812 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:55.690637 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a419246-1ad8-457e-b23f-6e2f6c3ff159 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:55.710181 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19125e25-495f-4899-aaaa-9abdd76feaa6 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:55.733156 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10baba-1fd4-42cf-aea1-911ff13ccbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:55.733827 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10baba-1fd4-42cf-aea1-911ff13ccbac None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:55.734598 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10baba-1fd4-42cf-aea1-911ff13ccbac None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:55.734890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10baba-1fd4-42cf-aea1-911ff13ccbac None admin] PATH_INFO: `/v3/groups/5144b06cc24d4ac1adebf28e5854fef5` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:55.736972 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10baba-1fd4-42cf-aea1-911ff13ccbac None admin] RBAC: Authorizing `identity:get_group(group_id=5144b06cc24d4ac1adebf28e5854fef5)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:55.738571 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10baba-1fd4-42cf-aea1-911ff13ccbac None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:55.740286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 184/361] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 22:35:55 2022] GET /identity/v3/groups/5144b06cc24d4ac1adebf28e5854fef5 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:55.741663 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e6a74-d648-4492-8d10-92c15ad65285 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:55.741949 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e6a74-d648-4492-8d10-92c15ad65285 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:55.742228 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e6a74-d648-4492-8d10-92c15ad65285 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:55.748961 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 185/362] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:55.748961 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e6a74-d648-4492-8d10-92c15ad65285 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:55.755578 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbaf1b2-7680-44fd-aba3-3c4d3a6fd990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:55.756175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbaf1b2-7680-44fd-aba3-3c4d3a6fd990 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:55.756466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbaf1b2-7680-44fd-aba3-3c4d3a6fd990 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:55.756758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbaf1b2-7680-44fd-aba3-3c4d3a6fd990 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:55.761736 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:55.770194 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbaf1b2-7680-44fd-aba3-3c4d3a6fd990 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:55.776315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-abbaf1b2-7680-44fd-aba3-3c4d3a6fd990 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:35:55.776315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:55.776315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:55.776315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:55.776315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:55.776315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:55.776315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:55.776315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:55.776315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:55.776315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:55.776315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:55.776315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:55.776315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:55.776315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:55.776315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:55.776315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:55.777213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:55.777213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:55.777213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:55.777213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:55.777213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:55.777213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:55.777213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:55.777213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:55.777213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:55.777213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:55.777213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:55.777213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:55.777213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:55.777213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:55.777213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:55.777213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:55.778063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:55.778063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:55.778063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:55.778063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:55.778063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:55.778063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:55.778063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:55.778063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:55.778063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:55.778063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:55.778063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:35:55.778063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:55.778063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 178/363] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:35:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:55.778063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbaf1b2-7680-44fd-aba3-3c4d3a6fd990 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:55.883231 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e6a74-d648-4492-8d10-92c15ad65285 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:55.924886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbaf1b2-7680-44fd-aba3-3c4d3a6fd990 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:55.926361 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d43259-590e-42f2-9a49-4228e0384f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:55.927001 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d43259-590e-42f2-9a49-4228e0384f40 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:55.927289 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d43259-590e-42f2-9a49-4228e0384f40 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:55.927568 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d43259-590e-42f2-9a49-4228e0384f40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:55.960141 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:55.973307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac272b9e-0ff8-49cb-86e1-f2f612da6e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:55.974385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac272b9e-0ff8-49cb-86e1-f2f612da6e2b None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:55.974676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac272b9e-0ff8-49cb-86e1-f2f612da6e2b None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:55.974996 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac272b9e-0ff8-49cb-86e1-f2f612da6e2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:55.980184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac272b9e-0ff8-49cb-86e1-f2f612da6e2b None admin] RBAC: Adding query filter params (group.id=5144b06cc24d4ac1adebf28e5854fef5, role.id=d4ee54c077084dcea38d7476927b61df, scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:55.980184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac272b9e-0ff8-49cb-86e1-f2f612da6e2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:55.980184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac272b9e-0ff8-49cb-86e1-f2f612da6e2b None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:55.986218 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 179/364] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jul 27 22:35:55 2022] GET /identity/v3/role_assignments?group.id=5144b06cc24d4ac1adebf28e5854fef5&scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0&role.id=d4ee54c077084dcea38d7476927b61df => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:55.988153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac596b9-1d91-4aa4-936f-afc161a5ef50 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:55.988440 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac596b9-1d91-4aa4-936f-afc161a5ef50 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:55.988718 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac596b9-1d91-4aa4-936f-afc161a5ef50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:56.014918 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-3ac596b9-1d91-4aa4-936f-afc161a5ef50 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:56.016233 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-3ac596b9-1d91-4aa4-936f-afc161a5ef50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:56.021396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d43259-590e-42f2-9a49-4228e0384f40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:56.022921 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d43259-590e-42f2-9a49-4228e0384f40 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:56.034234 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:56.104963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 180/365] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:35:56.106004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac596b9-1d91-4aa4-936f-afc161a5ef50 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:56.160474 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 186/366] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:35:56.161814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d43259-590e-42f2-9a49-4228e0384f40 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:56.244843 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac596b9-1d91-4aa4-936f-afc161a5ef50 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:56.286768 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:56.290193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061cbf0-7ce0-4ac0-a6d3-933f0f9666d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:56.291365 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061cbf0-7ce0-4ac0-a6d3-933f0f9666d2 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:56.291658 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061cbf0-7ce0-4ac0-a6d3-933f0f9666d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:56.291938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d061cbf0-7ce0-4ac0-a6d3-933f0f9666d2 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:56.292669 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061cbf0-7ce0-4ac0-a6d3-933f0f9666d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:56.292982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061cbf0-7ce0-4ac0-a6d3-933f0f9666d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:56.294386 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d061cbf0-7ce0-4ac0-a6d3-933f0f9666d2 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:56.303015 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 181/367] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:35:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:56.303922 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061cbf0-7ce0-4ac0-a6d3-933f0f9666d2 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:56.306376 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d43259-590e-42f2-9a49-4228e0384f40 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:56.319008 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:56.351316 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfac440-fe26-40b7-b6ba-531f2596caf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:56.352079 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfac440-fe26-40b7-b6ba-531f2596caf4 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:56.352425 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfac440-fe26-40b7-b6ba-531f2596caf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:56.353374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfac440-fe26-40b7-b6ba-531f2596caf4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:56.366683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfac440-fe26-40b7-b6ba-531f2596caf4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:56.371828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-6cfac440-fe26-40b7-b6ba-531f2596caf4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:35:56.371828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:56.371828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:56.371828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:56.371828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:56.371828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:56.371828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:56.371828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:56.371828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:56.371828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:56.371828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:56.371828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:56.371828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:56.371828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:56.371828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:56.371828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:56.372741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:56.372741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:56.372741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:56.372741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:56.372741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:56.372741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:56.372741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:56.372741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:56.372741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:56.372741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:56.372741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:56.372741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:56.372741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:56.372741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:56.372741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:56.372741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:56.373534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:56.373534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:56.373534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:56.373534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:56.373534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:56.373534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:56.373534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:56.373534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:56.373534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:56.373534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:56.373534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:35:56.373534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:56.374638 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 187/368] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:35:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:56.375205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfac440-fe26-40b7-b6ba-531f2596caf4 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:56.420568 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d061cbf0-7ce0-4ac0-a6d3-933f0f9666d2 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:56.457869 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77813bca-7620-41ac-b0fc-baf662acac37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:56.458715 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77813bca-7620-41ac-b0fc-baf662acac37 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:56.459001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77813bca-7620-41ac-b0fc-baf662acac37 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:56.459279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77813bca-7620-41ac-b0fc-baf662acac37 None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:56.460502 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77813bca-7620-41ac-b0fc-baf662acac37 None admin] RBAC: Authorizing `identity:get_project(project_id=4e0a8c4e892848b4a8d4fea9a731c82c)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:56.461948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77813bca-7620-41ac-b0fc-baf662acac37 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:56.464415 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 182/369] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:56 2022] GET /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:56.465008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77813bca-7620-41ac-b0fc-baf662acac37 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:56.486120 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfac440-fe26-40b7-b6ba-531f2596caf4 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:56.522358 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca39050-f93e-4b49-b3b2-68d7a487cd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:56.522991 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca39050-f93e-4b49-b3b2-68d7a487cd9c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:56.523273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca39050-f93e-4b49-b3b2-68d7a487cd9c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:56.523545 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca39050-f93e-4b49-b3b2-68d7a487cd9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:56.561627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:56.570799 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:56.578502 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77813bca-7620-41ac-b0fc-baf662acac37 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:56.600091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca39050-f93e-4b49-b3b2-68d7a487cd9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:56.600091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca39050-f93e-4b49-b3b2-68d7a487cd9c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:56.616955 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfdff7-0f1d-480b-8a99-d28431370795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:56.617592 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfdff7-0f1d-480b-8a99-d28431370795 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:56.617883 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfdff7-0f1d-480b-8a99-d28431370795 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:56.618164 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dfdff7-0f1d-480b-8a99-d28431370795 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:56.619041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfdff7-0f1d-480b-8a99-d28431370795 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:56.619353 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfdff7-0f1d-480b-8a99-d28431370795 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:56.620804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dfdff7-0f1d-480b-8a99-d28431370795 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:56.630623 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 183/370] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:56.631455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfdff7-0f1d-480b-8a99-d28431370795 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:56.706378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 188/371] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:35:56.707296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca39050-f93e-4b49-b3b2-68d7a487cd9c None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:56.741435 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dfdff7-0f1d-480b-8a99-d28431370795 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:56.760967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:56.784276 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:56.784902 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78e906-7945-4b8e-985b-541b6334e527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:56.785875 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78e906-7945-4b8e-985b-541b6334e527 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:56.786413 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78e906-7945-4b8e-985b-541b6334e527 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:56.786887 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78e906-7945-4b8e-985b-541b6334e527 None admin] PATH_INFO: `/v3/groups/5144b06cc24d4ac1adebf28e5854fef5` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:56.788285 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78e906-7945-4b8e-985b-541b6334e527 None admin] RBAC: Authorizing `identity:get_group(group_id=5144b06cc24d4ac1adebf28e5854fef5)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:56.789940 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c78e906-7945-4b8e-985b-541b6334e527 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:56.792165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 184/372] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 22:35:56 2022] GET /identity/v3/groups/5144b06cc24d4ac1adebf28e5854fef5 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:56.793152 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78e906-7945-4b8e-985b-541b6334e527 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:56.828015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca39050-f93e-4b49-b3b2-68d7a487cd9c None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:56.867640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d66ca5-ee7a-4056-9a24-1bd60f8c9fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:56.868837 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d66ca5-ee7a-4056-9a24-1bd60f8c9fd3 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:56.869158 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d66ca5-ee7a-4056-9a24-1bd60f8c9fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:56.869395 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d66ca5-ee7a-4056-9a24-1bd60f8c9fd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:56.924843 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78e906-7945-4b8e-985b-541b6334e527 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:56.957595 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d66ca5-ee7a-4056-9a24-1bd60f8c9fd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:56.959511 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d66ca5-ee7a-4056-9a24-1bd60f8c9fd3 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:56.970548 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310fbd7-7220-4d96-aa01-e87fe0c76a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:56.971204 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310fbd7-7220-4d96-aa01-e87fe0c76a5d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:56.971491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310fbd7-7220-4d96-aa01-e87fe0c76a5d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:56.971770 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8310fbd7-7220-4d96-aa01-e87fe0c76a5d None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:56.973395 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310fbd7-7220-4d96-aa01-e87fe0c76a5d None admin] RBAC: Authorizing `identity:get_project(project_id=4e0a8c4e892848b4a8d4fea9a731c82c)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:56.975533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8310fbd7-7220-4d96-aa01-e87fe0c76a5d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:56.977661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 185/373] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:56 2022] GET /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:56.978314 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310fbd7-7220-4d96-aa01-e87fe0c76a5d None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:57.035748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:57.044487 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:57.084301 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 189/374] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:35:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:35:57.086065 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d66ca5-ee7a-4056-9a24-1bd60f8c9fd3 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:57.115741 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8310fbd7-7220-4d96-aa01-e87fe0c76a5d None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:57.163748 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb77fd-7662-4b37-80ee-ed360fcae8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:57.166384 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb77fd-7662-4b37-80ee-ed360fcae8bb None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:57.166384 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb77fd-7662-4b37-80ee-ed360fcae8bb None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:57.166384 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb77fd-7662-4b37-80ee-ed360fcae8bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:57.166384 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb77fd-7662-4b37-80ee-ed360fcae8bb None admin] RBAC: Adding query filter params (group.id=5144b06cc24d4ac1adebf28e5854fef5, role.id=267b3ef4524c42bb90a7002ee1639b74, scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:57.166384 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb77fd-7662-4b37-80ee-ed360fcae8bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:57.167837 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb77fd-7662-4b37-80ee-ed360fcae8bb None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:57.176676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 186/375] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jul 27 22:35:56 2022] GET /identity/v3/role_assignments?group.id=5144b06cc24d4ac1adebf28e5854fef5&scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c&role.id=267b3ef4524c42bb90a7002ee1639b74 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:57.177850 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb77fd-7662-4b37-80ee-ed360fcae8bb None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:57.226570 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d66ca5-ee7a-4056-9a24-1bd60f8c9fd3 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:57.277261 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9e149-138c-4a7a-b018-2c024b606ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:57.278367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9e149-138c-4a7a-b018-2c024b606ee1 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:57.278877 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9e149-138c-4a7a-b018-2c024b606ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:57.279452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9e149-138c-4a7a-b018-2c024b606ee1 None admin] PATH_INFO: `/v3/groups/5144b06cc24d4ac1adebf28e5854fef5` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:57.280991 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9e149-138c-4a7a-b018-2c024b606ee1 None admin] RBAC: Authorizing `identity:get_group(group_id=5144b06cc24d4ac1adebf28e5854fef5)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:57.282763 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9e149-138c-4a7a-b018-2c024b606ee1 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:57.285078 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 190/376] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 22:35:57 2022] GET /identity/v3/groups/5144b06cc24d4ac1adebf28e5854fef5 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:57.292620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9e149-138c-4a7a-b018-2c024b606ee1 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:57.314358 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb77fd-7662-4b37-80ee-ed360fcae8bb None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:57.348340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:57.377486 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:57.398524 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf202daf-b927-4df6-8d0c-e9280c5abe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:57.399737 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf202daf-b927-4df6-8d0c-e9280c5abe77 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:57.400248 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf202daf-b927-4df6-8d0c-e9280c5abe77 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:57.400723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf202daf-b927-4df6-8d0c-e9280c5abe77 None admin] PATH_INFO: `/v3/projects/a383910370a74720956232cbcc0a7762` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:57.403034 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf202daf-b927-4df6-8d0c-e9280c5abe77 None admin] RBAC: Authorizing `identity:get_project(project_id=a383910370a74720956232cbcc0a7762)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:57.404763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf202daf-b927-4df6-8d0c-e9280c5abe77 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:57.408168 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 187/377] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:57 2022] GET /identity/v3/projects/a383910370a74720956232cbcc0a7762 => generated 344 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:57.426436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf202daf-b927-4df6-8d0c-e9280c5abe77 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:57.478375 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9e149-138c-4a7a-b018-2c024b606ee1 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:57.520727 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418287bf-8595-4c03-982c-c0478d13366b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:57.521463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418287bf-8595-4c03-982c-c0478d13366b None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:57.521648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418287bf-8595-4c03-982c-c0478d13366b None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:57.521917 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418287bf-8595-4c03-982c-c0478d13366b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:57.522741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418287bf-8595-4c03-982c-c0478d13366b None admin] RBAC: Adding query filter params (group.id=5144b06cc24d4ac1adebf28e5854fef5, role.id=d4ee54c077084dcea38d7476927b61df, scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:57.523146 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418287bf-8595-4c03-982c-c0478d13366b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:57.524524 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418287bf-8595-4c03-982c-c0478d13366b None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:57.530307 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 191/378] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jul 27 22:35:57 2022] GET /identity/v3/role_assignments?group.id=5144b06cc24d4ac1adebf28e5854fef5&scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c&role.id=d4ee54c077084dcea38d7476927b61df => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:57.595508 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf202daf-b927-4df6-8d0c-e9280c5abe77 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:57.668212 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71186c44-09e4-4f13-9414-b61637f1d14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:57.668900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71186c44-09e4-4f13-9414-b61637f1d14c None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:57.669190 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71186c44-09e4-4f13-9414-b61637f1d14c None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:57.669466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71186c44-09e4-4f13-9414-b61637f1d14c None admin] PATH_INFO: `/v3/groups/910f84889034407e9c4b772d821c0e1b` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:57.678153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71186c44-09e4-4f13-9414-b61637f1d14c None admin] RBAC: Authorizing `identity:get_group(group_id=910f84889034407e9c4b772d821c0e1b)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:57.679678 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71186c44-09e4-4f13-9414-b61637f1d14c None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:57.681789 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 188/379] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 22:35:57 2022] GET /identity/v3/groups/910f84889034407e9c4b772d821c0e1b => generated 229 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:57.687746 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418287bf-8595-4c03-982c-c0478d13366b None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:57.792611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deccb7e-5f2b-4587-8640-72aaba488a06 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:57.792927 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deccb7e-5f2b-4587-8640-72aaba488a06 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:57.793167 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deccb7e-5f2b-4587-8640-72aaba488a06 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:57.794549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 189/380] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:35:57.801262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418287bf-8595-4c03-982c-c0478d13366b None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:57.807747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f97cdd-ca99-4a9b-8f3f-e7f6691b1d1b None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:57.808038 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f97cdd-ca99-4a9b-8f3f-e7f6691b1d1b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:57.808322 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f97cdd-ca99-4a9b-8f3f-e7f6691b1d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:57.810716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:57.838086 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-99f97cdd-ca99-4a9b-8f3f-e7f6691b1d1b None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:57.839754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-99f97cdd-ca99-4a9b-8f3f-e7f6691b1d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:57.880902 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b826762-bdfd-47cc-97f7-8872baa6fe89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:57.883513 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b826762-bdfd-47cc-97f7-8872baa6fe89 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:57.884571 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b826762-bdfd-47cc-97f7-8872baa6fe89 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:57.886207 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b826762-bdfd-47cc-97f7-8872baa6fe89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:57.888418 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b826762-bdfd-47cc-97f7-8872baa6fe89 None admin] RBAC: Adding query filter params (group.id=910f84889034407e9c4b772d821c0e1b, role.id=49e0ba8d8c9f4824892b61f05d0036e8, scope.project.id=a383910370a74720956232cbcc0a7762) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:57.888973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b826762-bdfd-47cc-97f7-8872baa6fe89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:57.891845 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b826762-bdfd-47cc-97f7-8872baa6fe89 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:57.904246 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 192/381] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jul 27 22:35:57 2022] GET /identity/v3/role_assignments?group.id=910f84889034407e9c4b772d821c0e1b&scope.project.id=a383910370a74720956232cbcc0a7762&role.id=49e0ba8d8c9f4824892b61f05d0036e8 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:57.921504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:57.954213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 190/382] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 27 22:35:57.985467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b826762-bdfd-47cc-97f7-8872baa6fe89 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:58.126831 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b826762-bdfd-47cc-97f7-8872baa6fe89 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:58.166430 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392a250-db9f-4567-a198-d7b9fef33701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:58.167470 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392a250-db9f-4567-a198-d7b9fef33701 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:58.167973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392a250-db9f-4567-a198-d7b9fef33701 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:58.168447 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a392a250-db9f-4567-a198-d7b9fef33701 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:58.180543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a392a250-db9f-4567-a198-d7b9fef33701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:58.187127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-a392a250-db9f-4567-a198-d7b9fef33701 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:58.187127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:58.187127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:58.187127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:58.187127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:58.187127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:58.187127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:58.187127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:58.187127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:58.187127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:58.187127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:58.187127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:58.187127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:58.187127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:58.187127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:58.187127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:58.189360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:58.189360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:58.189360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:58.189360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:58.189360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:58.189360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:58.189360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:58.189360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:58.189360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:58.189360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:58.189360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:58.189360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:58.189360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:58.189360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:58.189360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:58.189360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:58.190224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:58.190224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:58.190224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:58.190224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:58.190224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:58.190224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:58.190224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:58.190224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:58.190224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:58.190224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:58.190224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:35:58.190224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:35:58.193071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 193/383] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:35:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:35:58.199113 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f97cdd-ca99-4a9b-8f3f-e7f6691b1d1b None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:58.331250 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f97cdd-ca99-4a9b-8f3f-e7f6691b1d1b None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:58.383648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24997ca0-eb0e-438a-994e-22239bc1d76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:58.384325 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24997ca0-eb0e-438a-994e-22239bc1d76b None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:58.384611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24997ca0-eb0e-438a-994e-22239bc1d76b None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:58.384884 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24997ca0-eb0e-438a-994e-22239bc1d76b None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:58.385608 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24997ca0-eb0e-438a-994e-22239bc1d76b None admin] RBAC: Adding query filter params (name=member) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:58.385916 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24997ca0-eb0e-438a-994e-22239bc1d76b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:58.387311 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24997ca0-eb0e-438a-994e-22239bc1d76b None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:58.401411 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 191/384] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:35:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:58.402832 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392a250-db9f-4567-a198-d7b9fef33701 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:58.458053 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:58.551087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b68ba-3919-4b37-a8f8-cc05824004ee None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:58.551608 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b68ba-3919-4b37-a8f8-cc05824004ee None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:58.551608 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b68ba-3919-4b37-a8f8-cc05824004ee None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:58.553215 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 192/385] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:35:58.557969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aebdfd-a386-4a95-b95a-52be84116c9a None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:58.558257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aebdfd-a386-4a95-b95a-52be84116c9a None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:58.558608 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aebdfd-a386-4a95-b95a-52be84116c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:58.581465 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a392a250-db9f-4567-a198-d7b9fef33701 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:58.597281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-51aebdfd-a386-4a95-b95a-52be84116c9a None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:35:58.600625 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-51aebdfd-a386-4a95-b95a-52be84116c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:35:58.654964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615bd7f-a50e-4539-a2e5-93dcbfdcc46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:58.655622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615bd7f-a50e-4539-a2e5-93dcbfdcc46e None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:58.655912 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615bd7f-a50e-4539-a2e5-93dcbfdcc46e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:58.656195 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615bd7f-a50e-4539-a2e5-93dcbfdcc46e None admin] PATH_INFO: `/v3/groups/5144b06cc24d4ac1adebf28e5854fef5` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:58.659416 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615bd7f-a50e-4539-a2e5-93dcbfdcc46e None admin] RBAC: Authorizing `identity:get_group(group_id=5144b06cc24d4ac1adebf28e5854fef5)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:58.661569 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615bd7f-a50e-4539-a2e5-93dcbfdcc46e None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:58.663388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 194/386] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 22:35:58 2022] GET /identity/v3/groups/5144b06cc24d4ac1adebf28e5854fef5 => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:58.667046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:58.669256 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615bd7f-a50e-4539-a2e5-93dcbfdcc46e None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:58.717795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 193/387] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:35:58.750667 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aebdfd-a386-4a95-b95a-52be84116c9a None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:58.868001 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:58.871854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aebdfd-a386-4a95-b95a-52be84116c9a None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:58.878321 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615bd7f-a50e-4539-a2e5-93dcbfdcc46e None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:58.919512 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c7c66-6f66-4b56-adf1-1ad053d8bae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:58.920394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115780cb-4fad-4ffc-b6b1-850eedc65229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:58.921230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c7c66-6f66-4b56-adf1-1ad053d8bae0 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:58.922045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115780cb-4fad-4ffc-b6b1-850eedc65229 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:58.922500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c7c66-6f66-4b56-adf1-1ad053d8bae0 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:58.922928 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115780cb-4fad-4ffc-b6b1-850eedc65229 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:58.923358 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c7c66-6f66-4b56-adf1-1ad053d8bae0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:58.923924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115780cb-4fad-4ffc-b6b1-850eedc65229 None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:58.925954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115780cb-4fad-4ffc-b6b1-850eedc65229 None admin] RBAC: Authorizing `identity:get_project(project_id=bed1abbcdf7b4207893b683a5d6c0eb0)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:58.928879 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115780cb-4fad-4ffc-b6b1-850eedc65229 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:58.931687 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 195/388] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:58 2022] GET /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:58.939300 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115780cb-4fad-4ffc-b6b1-850eedc65229 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:58.953614 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c7c66-6f66-4b56-adf1-1ad053d8bae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:35:58.969754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-ae1c7c66-6f66-4b56-adf1-1ad053d8bae0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:35:58.969754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:35:58.969754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:35:58.969754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:35:58.969754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:35:58.969754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:35:58.969754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:35:58.969754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:35:58.969754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:35:58.969754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:35:58.969754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:35:58.969754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:35:58.969754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:35:58.969754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:35:58.969754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:35:58.969754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:35:58.970750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:35:58.970750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:35:58.970750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:35:58.970750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:35:58.970750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:35:58.970750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:35:58.970750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:35:58.970750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:35:58.970750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:35:58.970750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:35:58.970750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:35:58.970750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:35:58.970750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:35:58.970750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:35:58.970750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:35:58.970750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:35:58.971597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:35:58.971597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:35:58.971597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:35:58.971597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:35:58.971597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:35:58.971597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:35:58.971597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:35:58.971597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:35:58.971597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:35:58.971597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:35:58.971597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:35:58.971597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:35:58.971597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 194/389] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:35:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:35:58.980814 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c7c66-6f66-4b56-adf1-1ad053d8bae0 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:59.054162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:59.065772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115780cb-4fad-4ffc-b6b1-850eedc65229 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:59.102301 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194205b-f8ad-4f37-a979-76a9ec2edd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:59.103331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194205b-f8ad-4f37-a979-76a9ec2edd09 None admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:59.103780 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194205b-f8ad-4f37-a979-76a9ec2edd09 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:59.104213 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1194205b-f8ad-4f37-a979-76a9ec2edd09 None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0/groups/5144b06cc24d4ac1adebf28e5854fef5/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:59.106323 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194205b-f8ad-4f37-a979-76a9ec2edd09 None admin] RBAC: Authorizing `identity:create_grant(project_id=bed1abbcdf7b4207893b683a5d6c0eb0, group_id=5144b06cc24d4ac1adebf28e5854fef5, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:59.107935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1194205b-f8ad-4f37-a979-76a9ec2edd09 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:59.126224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 196/390] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Jul 27 22:35:58 2022] PUT /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0/groups/5144b06cc24d4ac1adebf28e5854fef5/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:35:59.186785 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c7c66-6f66-4b56-adf1-1ad053d8bae0 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:59.232957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ca662-f262-4465-b29d-bb075f07556e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:59.233843 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ca662-f262-4465-b29d-bb075f07556e None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:59.234285 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ca662-f262-4465-b29d-bb075f07556e None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:59.234758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ca662-f262-4465-b29d-bb075f07556e None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:59.235647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ca662-f262-4465-b29d-bb075f07556e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:35:59.236112 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ca662-f262-4465-b29d-bb075f07556e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:59.237654 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ca662-f262-4465-b29d-bb075f07556e None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:59.247755 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 195/391] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:35:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:35:59.253745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194205b-f8ad-4f37-a979-76a9ec2edd09 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:59.290101 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:59.404878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1194205b-f8ad-4f37-a979-76a9ec2edd09 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:59.443166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b011a-14f9-4c2a-abdd-44319eedc6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:59.443847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b011a-14f9-4c2a-abdd-44319eedc6f0 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:59.444130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b011a-14f9-4c2a-abdd-44319eedc6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:59.444408 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b011a-14f9-4c2a-abdd-44319eedc6f0 None admin] PATH_INFO: `/v3/groups/5144b06cc24d4ac1adebf28e5854fef5` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:59.445641 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b011a-14f9-4c2a-abdd-44319eedc6f0 None admin] RBAC: Authorizing `identity:get_group(group_id=5144b06cc24d4ac1adebf28e5854fef5)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:59.447696 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b011a-14f9-4c2a-abdd-44319eedc6f0 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:59.449546 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 197/392] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 22:35:59 2022] GET /identity/v3/groups/5144b06cc24d4ac1adebf28e5854fef5 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:59.455315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ca662-f262-4465-b29d-bb075f07556e None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:59.596130 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:59.619883 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ca662-f262-4465-b29d-bb075f07556e None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:59.675115 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e278b3-4ee1-4459-af33-5128dd9bc290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:59.675767 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e278b3-4ee1-4459-af33-5128dd9bc290 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:59.676051 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e278b3-4ee1-4459-af33-5128dd9bc290 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:59.676328 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e278b3-4ee1-4459-af33-5128dd9bc290 None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:59.683102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e278b3-4ee1-4459-af33-5128dd9bc290 None admin] RBAC: Authorizing `identity:get_project(project_id=bed1abbcdf7b4207893b683a5d6c0eb0)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:59.684568 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e278b3-4ee1-4459-af33-5128dd9bc290 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:59.686290 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 196/393] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:35:59 2022] GET /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:35:59.692046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b011a-14f9-4c2a-abdd-44319eedc6f0 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:35:59.806934 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:35:59.823672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b011a-14f9-4c2a-abdd-44319eedc6f0 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:35:59.884511 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ea3d8-aa9a-4dec-8ee8-4cfc61171975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:35:59.885211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ea3d8-aa9a-4dec-8ee8-4cfc61171975 None admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:35:59.885504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ea3d8-aa9a-4dec-8ee8-4cfc61171975 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:35:59.886836 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ea3d8-aa9a-4dec-8ee8-4cfc61171975 None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0/groups/5144b06cc24d4ac1adebf28e5854fef5/roles/d4ee54c077084dcea38d7476927b61df` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:35:59.895109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ea3d8-aa9a-4dec-8ee8-4cfc61171975 None admin] RBAC: Authorizing `identity:create_grant(project_id=bed1abbcdf7b4207893b683a5d6c0eb0, group_id=5144b06cc24d4ac1adebf28e5854fef5, role_id=d4ee54c077084dcea38d7476927b61df)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:35:59.896554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ea3d8-aa9a-4dec-8ee8-4cfc61171975 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:35:59.916813 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 198/394] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Jul 27 22:35:59 2022] PUT /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0/groups/5144b06cc24d4ac1adebf28e5854fef5/roles/d4ee54c077084dcea38d7476927b61df => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:36:00.130412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949585e-dd1e-4383-8735-da2583b6ac04 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:00.130810 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949585e-dd1e-4383-8735-da2583b6ac04 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:00.131011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949585e-dd1e-4383-8735-da2583b6ac04 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:00.132636 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 197/395] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:00.138961 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51c1f7-d063-4547-88c3-db36d7c655fe None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:00.139227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51c1f7-d063-4547-88c3-db36d7c655fe None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:00.139456 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51c1f7-d063-4547-88c3-db36d7c655fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:00.165029 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-ab51c1f7-d063-4547-88c3-db36d7c655fe None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:00.166261 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ab51c1f7-d063-4547-88c3-db36d7c655fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:00.228521 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3d9f7-7319-47c0-9e8a-539610d82672 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:00.228812 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3d9f7-7319-47c0-9e8a-539610d82672 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:00.229129 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3d9f7-7319-47c0-9e8a-539610d82672 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:00.230702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 198/396] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:00.236343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2a59f-9941-4f2c-8c55-417466b0f55d None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:00.237385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2a59f-9941-4f2c-8c55-417466b0f55d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:00.237693 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2a59f-9941-4f2c-8c55-417466b0f55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:00.254209 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 199/397] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:00.263176 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-4cd2a59f-9941-4f2c-8c55-417466b0f55d None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:00.265960 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-4cd2a59f-9941-4f2c-8c55-417466b0f55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:00.283731 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51c1f7-d063-4547-88c3-db36d7c655fe None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:00.380154 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 199/398] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:36:00.438868 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:00.462572 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2a59f-9941-4f2c-8c55-417466b0f55d None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:00.468107 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab51c1f7-d063-4547-88c3-db36d7c655fe None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:00.536937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cc24e-6cc0-45c6-8a42-814c633d3303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:00.537602 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cc24e-6cc0-45c6-8a42-814c633d3303 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:00.537886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cc24e-6cc0-45c6-8a42-814c633d3303 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:00.538162 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cc24e-6cc0-45c6-8a42-814c633d3303 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:00.553310 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cc24e-6cc0-45c6-8a42-814c633d3303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:00.564543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-ea8cc24e-6cc0-45c6-8a42-814c633d3303 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:36:00.564543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:00.564543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:00.564543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:00.564543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:00.564543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:00.564543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:00.564543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:00.564543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:00.564543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:00.564543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:00.564543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:00.564543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:00.564543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:00.564543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:00.564543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:00.565500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:00.565500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:00.565500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:00.565500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:00.565500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:00.565500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:00.565500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:00.565500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:00.565500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:00.565500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:00.565500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:00.565500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:00.565500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:00.565500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:00.565500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:00.565500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:00.566293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:00.566293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:00.566293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:00.566293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:00.566293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:00.566293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:00.566293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:00.566293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:00.566293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:00.566293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:00.566293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:36:00.566293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:00.568671 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 200/399] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:36:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:00.573272 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cc24e-6cc0-45c6-8a42-814c633d3303 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:00.629424 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:00.648422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2a59f-9941-4f2c-8c55-417466b0f55d None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:00.700413 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d80a8f-6fd8-4271-881e-7a07d11dafc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:00.701660 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d80a8f-6fd8-4271-881e-7a07d11dafc5 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:00.702157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d80a8f-6fd8-4271-881e-7a07d11dafc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:00.702664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d80a8f-6fd8-4271-881e-7a07d11dafc5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:00.714056 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d80a8f-6fd8-4271-881e-7a07d11dafc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:00.718386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cc24e-6cc0-45c6-8a42-814c633d3303 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:00.720011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-57d80a8f-6fd8-4271-881e-7a07d11dafc5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:36:00.720011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:00.720011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:00.720011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:00.720011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:00.720011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:00.720011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:00.720011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:00.720011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:00.720011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:00.720011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:00.720011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:00.720011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:00.720011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:00.720011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:00.720011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:00.720880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:00.720880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:00.720880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:00.720880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:00.720880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:00.720880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:00.720880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:00.720880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:00.720880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:00.720880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:00.720880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:00.720880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:00.720880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:00.720880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:00.720880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:00.720880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:00.721694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:00.721694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:00.721694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:00.721694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:00.721694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:00.721694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:00.721694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:00.721694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:00.721694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:00.721694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:00.721694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:36:00.721694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:00.724339 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 200/400] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:36:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:00.725772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408db464-90d5-4fdc-89a4-bc0386fa9b8e None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:00.726262 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408db464-90d5-4fdc-89a4-bc0386fa9b8e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:00.726783 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408db464-90d5-4fdc-89a4-bc0386fa9b8e None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:00.729126 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 201/401] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:00.731303 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408db464-90d5-4fdc-89a4-bc0386fa9b8e None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:00.767672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7287143-2ee4-40f2-9122-7f0928f002bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:00.768309 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7287143-2ee4-40f2-9122-7f0928f002bf None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:00.768608 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7287143-2ee4-40f2-9122-7f0928f002bf None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:00.768871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7287143-2ee4-40f2-9122-7f0928f002bf None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:00.769589 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7287143-2ee4-40f2-9122-7f0928f002bf None admin] RBAC: Adding query filter params (name=member) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:00.769900 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7287143-2ee4-40f2-9122-7f0928f002bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:00.772427 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7287143-2ee4-40f2-9122-7f0928f002bf None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:00.778198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:00.789214 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 201/402] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:36:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:00.789214 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a040ccd-8430-46ac-901d-b52dd69b9b65 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:00.789214 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a040ccd-8430-46ac-901d-b52dd69b9b65 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:00.789214 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a040ccd-8430-46ac-901d-b52dd69b9b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:00.809942 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-7a040ccd-8430-46ac-901d-b52dd69b9b65 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:00.811172 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-7a040ccd-8430-46ac-901d-b52dd69b9b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:00.854890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408db464-90d5-4fdc-89a4-bc0386fa9b8e None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:00.896217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 202/403] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:00.897390 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a040ccd-8430-46ac-901d-b52dd69b9b65 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:00.904721 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ef7b9-bd0a-4e28-850a-5bfbba408cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:00.907019 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ef7b9-bd0a-4e28-850a-5bfbba408cd8 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:00.908908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ef7b9-bd0a-4e28-850a-5bfbba408cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:00.909408 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ef7b9-bd0a-4e28-850a-5bfbba408cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:00.910357 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ef7b9-bd0a-4e28-850a-5bfbba408cd8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:00.911209 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ef7b9-bd0a-4e28-850a-5bfbba408cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:00.914076 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ef7b9-bd0a-4e28-850a-5bfbba408cd8 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:00.928470 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 202/404] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:00.929862 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ef7b9-bd0a-4e28-850a-5bfbba408cd8 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:00.943791 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:01.031017 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a040ccd-8430-46ac-901d-b52dd69b9b65 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:01.056145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ef7b9-bd0a-4e28-850a-5bfbba408cd8 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:01.067896 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:01.083922 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda6150-d6bc-482d-98a0-d3c48fd3eaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:01.084576 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda6150-d6bc-482d-98a0-d3c48fd3eaca None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:01.084860 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda6150-d6bc-482d-98a0-d3c48fd3eaca None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:01.085134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beda6150-d6bc-482d-98a0-d3c48fd3eaca None admin] PATH_INFO: `/v3/groups/5144b06cc24d4ac1adebf28e5854fef5` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:01.086423 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda6150-d6bc-482d-98a0-d3c48fd3eaca None admin] RBAC: Authorizing `identity:get_group(group_id=5144b06cc24d4ac1adebf28e5854fef5)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:01.088425 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beda6150-d6bc-482d-98a0-d3c48fd3eaca None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:01.095000 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 203/405] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 22:36:00 2022] GET /identity/v3/groups/5144b06cc24d4ac1adebf28e5854fef5 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:01.095000 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda6150-d6bc-482d-98a0-d3c48fd3eaca None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:01.107936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a15233-626d-4e91-b858-e55534c321ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:01.108588 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a15233-626d-4e91-b858-e55534c321ef None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:01.108876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a15233-626d-4e91-b858-e55534c321ef None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:01.109157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a15233-626d-4e91-b858-e55534c321ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:01.121855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a15233-626d-4e91-b858-e55534c321ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:01.128562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-c1a15233-626d-4e91-b858-e55534c321ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:36:01.128562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:01.128562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:01.128562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:01.128562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:01.128562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:01.128562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:01.128562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:01.128562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:01.128562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:01.128562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:01.128562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:01.128562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:01.128562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:01.128562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:01.128562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:01.129456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:01.129456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:01.129456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:01.129456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:01.129456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:01.129456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:01.129456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:01.129456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:01.129456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:01.129456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:01.129456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:01.129456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:01.129456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:01.129456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:01.129456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:01.129456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:01.130311 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:01.130311 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:01.130311 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:01.130311 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:01.130311 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:01.130311 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:01.130311 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:01.130311 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:01.130311 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:01.130311 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:01.130311 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:36:01.130311 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:01.134412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 203/406] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:36:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:01.135497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a15233-626d-4e91-b858-e55534c321ef None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:01.226401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:01.231113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beda6150-d6bc-482d-98a0-d3c48fd3eaca None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:01.264222 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a15233-626d-4e91-b858-e55534c321ef None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:01.266205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c5929-51a2-46b6-b70e-c80f5ecd295c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:01.267145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c5929-51a2-46b6-b70e-c80f5ecd295c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:01.267633 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c5929-51a2-46b6-b70e-c80f5ecd295c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:01.268101 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c5929-51a2-46b6-b70e-c80f5ecd295c None admin] PATH_INFO: `/v3/groups/5144b06cc24d4ac1adebf28e5854fef5` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:01.269423 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c5929-51a2-46b6-b70e-c80f5ecd295c None admin] RBAC: Authorizing `identity:get_group(group_id=5144b06cc24d4ac1adebf28e5854fef5)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:01.271075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c5929-51a2-46b6-b70e-c80f5ecd295c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:01.273134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 204/407] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 22:36:01 2022] GET /identity/v3/groups/5144b06cc24d4ac1adebf28e5854fef5 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:01.274171 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c5929-51a2-46b6-b70e-c80f5ecd295c None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:01.310755 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a68a1-ab1c-49e2-854d-319389cd5006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:01.315510 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a68a1-ab1c-49e2-854d-319389cd5006 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:01.315909 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a68a1-ab1c-49e2-854d-319389cd5006 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:01.317143 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8a68a1-ab1c-49e2-854d-319389cd5006 None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:01.317676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a68a1-ab1c-49e2-854d-319389cd5006 None admin] RBAC: Authorizing `identity:get_project(project_id=4e0a8c4e892848b4a8d4fea9a731c82c)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:01.320452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8a68a1-ab1c-49e2-854d-319389cd5006 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:01.326779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 204/408] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:36:01 2022] GET /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:01.326779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a68a1-ab1c-49e2-854d-319389cd5006 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:01.358964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:01.396526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c5929-51a2-46b6-b70e-c80f5ecd295c None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:01.434920 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90513f4-5a33-4bf8-af9c-8156d1e9ae80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:01.435932 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90513f4-5a33-4bf8-af9c-8156d1e9ae80 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:01.436443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90513f4-5a33-4bf8-af9c-8156d1e9ae80 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:01.436930 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90513f4-5a33-4bf8-af9c-8156d1e9ae80 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:01.437859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90513f4-5a33-4bf8-af9c-8156d1e9ae80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:01.438397 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90513f4-5a33-4bf8-af9c-8156d1e9ae80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:01.439958 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90513f4-5a33-4bf8-af9c-8156d1e9ae80 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:01.449080 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 205/409] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:36:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:01.450102 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90513f4-5a33-4bf8-af9c-8156d1e9ae80 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:01.453487 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8a68a1-ab1c-49e2-854d-319389cd5006 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:01.494736 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84f20c-f107-4141-a055-23b9937e14c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:01.495732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84f20c-f107-4141-a055-23b9937e14c0 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:01.495865 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84f20c-f107-4141-a055-23b9937e14c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:01.496084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b84f20c-f107-4141-a055-23b9937e14c0 None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:01.497252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84f20c-f107-4141-a055-23b9937e14c0 None admin] RBAC: Authorizing `identity:get_project(project_id=4e0a8c4e892848b4a8d4fea9a731c82c)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:01.498975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b84f20c-f107-4141-a055-23b9937e14c0 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:01.500818 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 205/410] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:36:01 2022] GET /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:01.501587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84f20c-f107-4141-a055-23b9937e14c0 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:01.511663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:01.556633 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90513f4-5a33-4bf8-af9c-8156d1e9ae80 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:01.585215 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:01.595631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe716e5-0562-4258-ac80-a73c1fec1eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:01.596317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe716e5-0562-4258-ac80-a73c1fec1eaa None admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:01.596605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe716e5-0562-4258-ac80-a73c1fec1eaa None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:01.596892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe716e5-0562-4258-ac80-a73c1fec1eaa None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c/groups/5144b06cc24d4ac1adebf28e5854fef5/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:01.600898 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe716e5-0562-4258-ac80-a73c1fec1eaa None admin] RBAC: Authorizing `identity:create_grant(project_id=4e0a8c4e892848b4a8d4fea9a731c82c, group_id=5144b06cc24d4ac1adebf28e5854fef5, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:01.602335 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe716e5-0562-4258-ac80-a73c1fec1eaa None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:01.617523 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 206/411] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Jul 27 22:36:01 2022] PUT /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c/groups/5144b06cc24d4ac1adebf28e5854fef5/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:36:01.622265 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b84f20c-f107-4141-a055-23b9937e14c0 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:01.627300 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe716e5-0562-4258-ac80-a73c1fec1eaa None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:01.663294 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdcb08-656f-4661-a04f-ed8610364eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:01.664227 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdcb08-656f-4661-a04f-ed8610364eeb None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:01.664657 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdcb08-656f-4661-a04f-ed8610364eeb None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:01.664989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdcb08-656f-4661-a04f-ed8610364eeb None admin] PATH_INFO: `/v3/groups/910f84889034407e9c4b772d821c0e1b` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:01.667151 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdcb08-656f-4661-a04f-ed8610364eeb None admin] RBAC: Authorizing `identity:get_group(group_id=910f84889034407e9c4b772d821c0e1b)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:01.668964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdcb08-656f-4661-a04f-ed8610364eeb None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:01.671317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 206/412] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 22:36:01 2022] GET /identity/v3/groups/910f84889034407e9c4b772d821c0e1b => generated 229 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:01.672943 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a73923-6c70-407a-b37d-9b8744826de5 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:01.673307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a73923-6c70-407a-b37d-9b8744826de5 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:01.674077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a73923-6c70-407a-b37d-9b8744826de5 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:01.678396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 207/413] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:01.678396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a73923-6c70-407a-b37d-9b8744826de5 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:01.762974 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe716e5-0562-4258-ac80-a73c1fec1eaa None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:01.789274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:01.806920 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3fba4-b33c-43d9-8567-4321d3562262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:01.807607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3fba4-b33c-43d9-8567-4321d3562262 None admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:01.807892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3fba4-b33c-43d9-8567-4321d3562262 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:01.808171 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3fba4-b33c-43d9-8567-4321d3562262 None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c/groups/5144b06cc24d4ac1adebf28e5854fef5/roles/d4ee54c077084dcea38d7476927b61df` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:01.810466 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3fba4-b33c-43d9-8567-4321d3562262 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e0a8c4e892848b4a8d4fea9a731c82c, group_id=5144b06cc24d4ac1adebf28e5854fef5, role_id=d4ee54c077084dcea38d7476927b61df)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:01.811906 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd3fba4-b33c-43d9-8567-4321d3562262 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:01.824644 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a73923-6c70-407a-b37d-9b8744826de5 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:01.829878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 207/414] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Jul 27 22:36:01 2022] PUT /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c/groups/5144b06cc24d4ac1adebf28e5854fef5/roles/d4ee54c077084dcea38d7476927b61df => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:36:01.831491 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31839a95-e887-4271-a649-1c388d63c15f None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:01.831868 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31839a95-e887-4271-a649-1c388d63c15f None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:01.832153 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31839a95-e887-4271-a649-1c388d63c15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:01.858003 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-31839a95-e887-4271-a649-1c388d63c15f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:01.859577 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-31839a95-e887-4271-a649-1c388d63c15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:01.871579 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf90b2-fdad-41d4-83e9-95151b609650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:01.872657 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf90b2-fdad-41d4-83e9-95151b609650 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:01.873685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf90b2-fdad-41d4-83e9-95151b609650 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:01.874206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdf90b2-fdad-41d4-83e9-95151b609650 None admin] PATH_INFO: `/v3/projects/a383910370a74720956232cbcc0a7762` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:01.876643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf90b2-fdad-41d4-83e9-95151b609650 None admin] RBAC: Authorizing `identity:get_project(project_id=a383910370a74720956232cbcc0a7762)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:01.878883 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdf90b2-fdad-41d4-83e9-95151b609650 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:01.882531 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 208/415] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:36:01 2022] GET /identity/v3/projects/a383910370a74720956232cbcc0a7762 => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:01.892136 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf90b2-fdad-41d4-83e9-95151b609650 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:01.959997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:01.961550 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 208/416] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:01.985703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31839a95-e887-4271-a649-1c388d63c15f None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:02.064769 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdf90b2-fdad-41d4-83e9-95151b609650 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:02.103848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31839a95-e887-4271-a649-1c388d63c15f None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:02.104924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8504ac-845d-498a-93db-bf05d81dc26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:02.105777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8504ac-845d-498a-93db-bf05d81dc26d None admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:02.106919 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8504ac-845d-498a-93db-bf05d81dc26d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:02.107223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8504ac-845d-498a-93db-bf05d81dc26d None admin] PATH_INFO: `/v3/projects/a383910370a74720956232cbcc0a7762/groups/910f84889034407e9c4b772d821c0e1b/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:02.109332 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8504ac-845d-498a-93db-bf05d81dc26d None admin] RBAC: Authorizing `identity:create_grant(project_id=a383910370a74720956232cbcc0a7762, group_id=910f84889034407e9c4b772d821c0e1b, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:02.110757 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8504ac-845d-498a-93db-bf05d81dc26d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:02.134479 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 209/417] 10.222.0.48 () {58 vars in 1442 bytes} [Wed Jul 27 22:36:01 2022] PUT /identity/v3/projects/a383910370a74720956232cbcc0a7762/groups/910f84889034407e9c4b772d821c0e1b/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:36:02.148518 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466502c3-9346-4488-81d7-dd0b2de686c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:02.149209 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466502c3-9346-4488-81d7-dd0b2de686c9 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:02.149531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466502c3-9346-4488-81d7-dd0b2de686c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:02.149804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466502c3-9346-4488-81d7-dd0b2de686c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:02.162681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466502c3-9346-4488-81d7-dd0b2de686c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:02.168009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-466502c3-9346-4488-81d7-dd0b2de686c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:36:02.168009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:02.168009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:02.168009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:02.168009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:02.168009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:02.168009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:02.168009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:02.168009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:02.168009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:02.168009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:02.168009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:02.168009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:02.168009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:02.168009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:02.168009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:02.168970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:02.168970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:02.168970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:02.168970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:02.168970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:02.168970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:02.168970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:02.168970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:02.168970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:02.168970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:02.168970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:02.168970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:02.168970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:02.168970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:02.168970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:02.168970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:02.169788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:02.169788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:02.169788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:02.169788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:02.169788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:02.169788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:02.169788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:02.169788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:02.169788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:02.169788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:02.169788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:36:02.169788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:02.169788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 209/418] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:36:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:02.175520 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8504ac-845d-498a-93db-bf05d81dc26d None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:02.179144 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:02.294164 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8504ac-845d-498a-93db-bf05d81dc26d None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:02.338599 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b483045-eca0-42b6-be60-44d397d3e6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:02.339656 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b483045-eca0-42b6-be60-44d397d3e6e5 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:02.340113 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b483045-eca0-42b6-be60-44d397d3e6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:02.340577 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b483045-eca0-42b6-be60-44d397d3e6e5 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:02.341496 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b483045-eca0-42b6-be60-44d397d3e6e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:02.341971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b483045-eca0-42b6-be60-44d397d3e6e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:02.343558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b483045-eca0-42b6-be60-44d397d3e6e5 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:02.355653 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 210/419] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:36:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:02.365587 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466502c3-9346-4488-81d7-dd0b2de686c9 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:02.409330 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:02.440652 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9d5db-fc73-4111-b621-57e426189251 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:02.441242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9d5db-fc73-4111-b621-57e426189251 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:02.441706 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9d5db-fc73-4111-b621-57e426189251 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:02.443746 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 211/420] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:36:02.452106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3fa3c-6841-40a8-9412-4ba227f87714 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:02.452711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3fa3c-6841-40a8-9412-4ba227f87714 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:02.453182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea3fa3c-6841-40a8-9412-4ba227f87714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:02.480099 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-bea3fa3c-6841-40a8-9412-4ba227f87714 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:02.482508 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-bea3fa3c-6841-40a8-9412-4ba227f87714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:02.491508 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466502c3-9346-4488-81d7-dd0b2de686c9 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:02.562507 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ee0ac-a640-4614-a94a-995a900a33bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:02.563493 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ee0ac-a640-4614-a94a-995a900a33bf None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:02.563984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ee0ac-a640-4614-a94a-995a900a33bf None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:02.565816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ee0ac-a640-4614-a94a-995a900a33bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:02.609046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:02.629360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 212/421] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:02.680222 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ee0ac-a640-4614-a94a-995a900a33bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:02.682216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ee0ac-a640-4614-a94a-995a900a33bf None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:02.697656 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3fa3c-6841-40a8-9412-4ba227f87714 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:02.745559 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:02.807609 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 210/422] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:36:02.813067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ee0ac-a640-4614-a94a-995a900a33bf None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:02.831596 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea3fa3c-6841-40a8-9412-4ba227f87714 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:02.867210 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f0417-7b69-403c-9294-11b0be3b686f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:02.867861 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f0417-7b69-403c-9294-11b0be3b686f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:02.868182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f0417-7b69-403c-9294-11b0be3b686f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:02.868460 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f0417-7b69-403c-9294-11b0be3b686f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:02.881944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f0417-7b69-403c-9294-11b0be3b686f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:02.890304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-2f9f0417-7b69-403c-9294-11b0be3b686f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:36:02.890304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:02.890304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:02.890304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:02.890304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:02.890304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:02.890304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:02.890304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:02.890304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:02.890304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:02.890304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:02.890304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:02.890304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:02.890304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:02.890304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:02.890304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:02.891234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:02.891234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:02.891234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:02.891234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:02.891234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:02.891234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:02.891234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:02.891234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:02.891234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:02.891234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:02.891234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:02.891234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:02.891234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:02.891234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:02.891234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:02.891234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:02.892029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:02.892029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:02.892029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:02.892029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:02.892029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:02.892029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:02.892029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:02.892029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:02.892029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:02.892029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:02.892029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:36:02.892029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:02.892029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 213/423] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:36:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:02.899275 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f0417-7b69-403c-9294-11b0be3b686f None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:02.967261 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ee0ac-a640-4614-a94a-995a900a33bf None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:03.001705 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:03.022867 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285d18a-0f91-47c3-b602-8c2f3f21ae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:03.023519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285d18a-0f91-47c3-b602-8c2f3f21ae37 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:03.023797 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285d18a-0f91-47c3-b602-8c2f3f21ae37 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:03.024066 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7285d18a-0f91-47c3-b602-8c2f3f21ae37 None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:03.026125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285d18a-0f91-47c3-b602-8c2f3f21ae37 None admin] RBAC: Authorizing `identity:get_project(project_id=bed1abbcdf7b4207893b683a5d6c0eb0)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:03.028631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7285d18a-0f91-47c3-b602-8c2f3f21ae37 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:03.030288 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 211/424] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:36:02 2022] GET /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:03.038893 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285d18a-0f91-47c3-b602-8c2f3f21ae37 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:03.053882 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:03.089961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f0417-7b69-403c-9294-11b0be3b686f None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:03.153114 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337dbea4-6cff-46af-9127-21fe3f22430c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:03.153754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dbea4-6cff-46af-9127-21fe3f22430c None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:03.154041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dbea4-6cff-46af-9127-21fe3f22430c None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:03.154320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337dbea4-6cff-46af-9127-21fe3f22430c None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:03.155070 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337dbea4-6cff-46af-9127-21fe3f22430c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:03.155379 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337dbea4-6cff-46af-9127-21fe3f22430c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:03.156762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337dbea4-6cff-46af-9127-21fe3f22430c None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:03.174820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 214/425] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:03.180464 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337dbea4-6cff-46af-9127-21fe3f22430c None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:03.216821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7285d18a-0f91-47c3-b602-8c2f3f21ae37 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:03.279222 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b4259-d0fb-498f-85fd-16623221ffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:03.279892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b4259-d0fb-498f-85fd-16623221ffe5 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:03.280182 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b4259-d0fb-498f-85fd-16623221ffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:03.280464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b4259-d0fb-498f-85fd-16623221ffe5 None admin] PATH_INFO: `/v3/groups/5144b06cc24d4ac1adebf28e5854fef5` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:03.281646 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b4259-d0fb-498f-85fd-16623221ffe5 None admin] RBAC: Authorizing `identity:get_group(group_id=5144b06cc24d4ac1adebf28e5854fef5)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:03.283134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b4259-d0fb-498f-85fd-16623221ffe5 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:03.285162 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 212/426] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 22:36:03 2022] GET /identity/v3/groups/5144b06cc24d4ac1adebf28e5854fef5 => generated 226 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:03.290800 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b4259-d0fb-498f-85fd-16623221ffe5 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:03.367095 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337dbea4-6cff-46af-9127-21fe3f22430c None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:03.395261 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:03.421406 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:03.433726 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cecb61-bd60-43ba-9581-5d370870db0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:03.434369 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cecb61-bd60-43ba-9581-5d370870db0f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:03.434671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cecb61-bd60-43ba-9581-5d370870db0f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:03.434953 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cecb61-bd60-43ba-9581-5d370870db0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:03.465069 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b4259-d0fb-498f-85fd-16623221ffe5 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:03.531340 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc874635-b7a6-475e-b592-de8fbec17805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:03.531977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc874635-b7a6-475e-b592-de8fbec17805 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:03.532269 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc874635-b7a6-475e-b592-de8fbec17805 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:03.532553 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc874635-b7a6-475e-b592-de8fbec17805 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:03.533353 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc874635-b7a6-475e-b592-de8fbec17805 None admin] RBAC: Adding query filter params (group.id=5144b06cc24d4ac1adebf28e5854fef5, role.id=267b3ef4524c42bb90a7002ee1639b74, scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:03.533669 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc874635-b7a6-475e-b592-de8fbec17805 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:03.535224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc874635-b7a6-475e-b592-de8fbec17805 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:03.541886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 213/427] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jul 27 22:36:03 2022] GET /identity/v3/role_assignments?group.id=5144b06cc24d4ac1adebf28e5854fef5&scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0&role.id=267b3ef4524c42bb90a7002ee1639b74 => generated 611 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:03.582441 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cecb61-bd60-43ba-9581-5d370870db0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:03.582441 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cecb61-bd60-43ba-9581-5d370870db0f None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:03.752222 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 215/428] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 22:36:03.757424 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc874635-b7a6-475e-b592-de8fbec17805 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:03.876425 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc874635-b7a6-475e-b592-de8fbec17805 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:03.923603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615c93b-9f04-4f7c-8f5f-091027f6ee98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:03.924275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615c93b-9f04-4f7c-8f5f-091027f6ee98 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:03.924564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615c93b-9f04-4f7c-8f5f-091027f6ee98 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:03.924844 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615c93b-9f04-4f7c-8f5f-091027f6ee98 None admin] PATH_INFO: `/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:03.926702 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615c93b-9f04-4f7c-8f5f-091027f6ee98 None admin] RBAC: Authorizing `identity:get_project(project_id=bed1abbcdf7b4207893b683a5d6c0eb0)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:03.928153 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615c93b-9f04-4f7c-8f5f-091027f6ee98 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:03.930128 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 214/429] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:36:03 2022] GET /identity/v3/projects/bed1abbcdf7b4207893b683a5d6c0eb0 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:03.935834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cecb61-bd60-43ba-9581-5d370870db0f None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:03.962148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:04.058161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cecb61-bd60-43ba-9581-5d370870db0f None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:04.075603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1472789-c6a3-4f72-9b89-d54b9ae1033d None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:04.075905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1472789-c6a3-4f72-9b89-d54b9ae1033d None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:04.076420 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1472789-c6a3-4f72-9b89-d54b9ae1033d None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:04.077894 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 215/430] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:36:04.084348 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359fa85-4d10-44b2-ae2d-089189373d92 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:04.084716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359fa85-4d10-44b2-ae2d-089189373d92 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:04.085068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2359fa85-4d10-44b2-ae2d-089189373d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:04.101744 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:04.104107 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af6c8f-b0e2-4d2d-ad59-1a59febb06a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:04.104763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af6c8f-b0e2-4d2d-ad59-1a59febb06a1 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:04.105509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af6c8f-b0e2-4d2d-ad59-1a59febb06a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:04.105509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af6c8f-b0e2-4d2d-ad59-1a59febb06a1 None admin] PATH_INFO: `/v3/groups/5144b06cc24d4ac1adebf28e5854fef5` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:04.106554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af6c8f-b0e2-4d2d-ad59-1a59febb06a1 None admin] RBAC: Authorizing `identity:get_group(group_id=5144b06cc24d4ac1adebf28e5854fef5)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:04.108019 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af6c8f-b0e2-4d2d-ad59-1a59febb06a1 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:04.109980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-2359fa85-4d10-44b2-ae2d-089189373d92 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:04.110091 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 216/431] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 22:36:03 2022] GET /identity/v3/groups/5144b06cc24d4ac1adebf28e5854fef5 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:04.115069 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-2359fa85-4d10-44b2-ae2d-089189373d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:04.118815 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af6c8f-b0e2-4d2d-ad59-1a59febb06a1 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:04.210989 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 216/432] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:36:04.227182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:04.241869 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359fa85-4d10-44b2-ae2d-089189373d92 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:04.247175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af6c8f-b0e2-4d2d-ad59-1a59febb06a1 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:04.294829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efa3c2-202e-4067-b9f0-3a57d5fc404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:04.295831 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efa3c2-202e-4067-b9f0-3a57d5fc404a None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:04.296763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efa3c2-202e-4067-b9f0-3a57d5fc404a None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:04.297216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efa3c2-202e-4067-b9f0-3a57d5fc404a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:04.298792 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efa3c2-202e-4067-b9f0-3a57d5fc404a None admin] RBAC: Adding query filter params (group.id=5144b06cc24d4ac1adebf28e5854fef5, role.id=d4ee54c077084dcea38d7476927b61df, scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:04.299377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efa3c2-202e-4067-b9f0-3a57d5fc404a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:04.302197 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0efa3c2-202e-4067-b9f0-3a57d5fc404a None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:04.311469 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 217/433] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jul 27 22:36:04 2022] GET /identity/v3/role_assignments?group.id=5144b06cc24d4ac1adebf28e5854fef5&scope.project.id=bed1abbcdf7b4207893b683a5d6c0eb0&role.id=d4ee54c077084dcea38d7476927b61df => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:04.341380 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd952bd6-6850-4d6c-951b-fc3b30acb6c5 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:04.342004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd952bd6-6850-4d6c-951b-fc3b30acb6c5 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:04.342533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd952bd6-6850-4d6c-951b-fc3b30acb6c5 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:04.344477 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 218/434] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:36:04.349686 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec257fbb-1eee-4334-8974-4eebc7b34902 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:04.349972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec257fbb-1eee-4334-8974-4eebc7b34902 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:04.350245 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec257fbb-1eee-4334-8974-4eebc7b34902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:04.370292 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-ec257fbb-1eee-4334-8974-4eebc7b34902 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:04.371514 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ec257fbb-1eee-4334-8974-4eebc7b34902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:04.374378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2359fa85-4d10-44b2-ae2d-089189373d92 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:04.424258 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f97f6-f13b-4de0-aa87-3192d83fd53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:04.428082 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f97f6-f13b-4de0-aa87-3192d83fd53a None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:04.428951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f97f6-f13b-4de0-aa87-3192d83fd53a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:04.429428 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610f97f6-f13b-4de0-aa87-3192d83fd53a None admin] PATH_INFO: `/v3/roles/member` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:04.434131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:04.445038 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610f97f6-f13b-4de0-aa87-3192d83fd53a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:04.455816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-610f97f6-f13b-4de0-aa87-3192d83fd53a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:36:04.455816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:04.455816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:04.455816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:04.455816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:04.455816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:04.455816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:04.455816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:04.455816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:04.455816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:04.455816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:04.455816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:04.455816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:04.455816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:04.455816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:04.455816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:04.456812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:04.456812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:04.456812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:04.456812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:04.456812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:04.456812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:04.456812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:04.456812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:04.456812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:04.456812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:04.456812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:04.456812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:04.456812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:04.456812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:04.456812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:04.456812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:04.457640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:04.457640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:04.457640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:04.457640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:04.457640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:04.457640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:04.457640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:04.457640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:04.457640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:04.457640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:04.457640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 22:36:04.457640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:04.462682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 217/435] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:36:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:04.462868 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 219/436] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:36:04.469906 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f97f6-f13b-4de0-aa87-3192d83fd53a None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:04.489265 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec257fbb-1eee-4334-8974-4eebc7b34902 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:04.605195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:04.620555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610f97f6-f13b-4de0-aa87-3192d83fd53a None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:04.633988 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec257fbb-1eee-4334-8974-4eebc7b34902 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:04.659622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d8dfe-3868-4aff-a87a-cb092cbbcac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:04.660255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d8dfe-3868-4aff-a87a-cb092cbbcac2 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:04.660538 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d8dfe-3868-4aff-a87a-cb092cbbcac2 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:04.660815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d8dfe-3868-4aff-a87a-cb092cbbcac2 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:04.661534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d8dfe-3868-4aff-a87a-cb092cbbcac2 None admin] RBAC: Adding query filter params (name=member) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:04.662199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d8dfe-3868-4aff-a87a-cb092cbbcac2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:04.663410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d8dfe-3868-4aff-a87a-cb092cbbcac2 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:04.673410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 218/437] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:36:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:04.674706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb65eef-84dd-47b7-b70f-ff9262af606d None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:04.674954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb65eef-84dd-47b7-b70f-ff9262af606d None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:04.676148 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb65eef-84dd-47b7-b70f-ff9262af606d None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:04.676713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 219/438] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:04.678515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8a2d7a-6f33-4653-af90-43ccb5a36f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:04.679418 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a2d7a-6f33-4653-af90-43ccb5a36f74 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:04.679705 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a2d7a-6f33-4653-af90-43ccb5a36f74 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:04.679984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8a2d7a-6f33-4653-af90-43ccb5a36f74 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:04.681066 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb65eef-84dd-47b7-b70f-ff9262af606d None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:04.694435 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8a2d7a-6f33-4653-af90-43ccb5a36f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:04.699554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-0a8a2d7a-6f33-4653-af90-43ccb5a36f74 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:36:04.699554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:04.699554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:04.699554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:04.699554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:04.699554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:04.699554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:04.699554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:04.699554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:04.699554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:04.699554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:04.699554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:04.699554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:04.699554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:04.699554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:04.699554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:04.700462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:04.700462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:04.700462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:04.700462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:04.700462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:04.700462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:04.700462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:04.700462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:04.700462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:04.700462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:04.700462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:04.700462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:04.700462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:04.700462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:04.700462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:04.700462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:04.701709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:04.701709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:04.701709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:04.701709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:04.701709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:04.701709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:04.701709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:04.701709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:04.701709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:04.701709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:04.701709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:36:04.701709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:04.701709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 220/439] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:36:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:04.702928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ad041-f0ea-456d-8445-6c61e0179f1f None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:04.702928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ad041-f0ea-456d-8445-6c61e0179f1f None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:04.702928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647ad041-f0ea-456d-8445-6c61e0179f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:04.724035 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-647ad041-f0ea-456d-8445-6c61e0179f1f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:04.725209 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-647ad041-f0ea-456d-8445-6c61e0179f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:04.755740 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:04.797464 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 221/440] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:04.798310 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ad041-f0ea-456d-8445-6c61e0179f1f None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:04.799704 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb65eef-84dd-47b7-b70f-ff9262af606d None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:04.835988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ececf0-b0d1-4e8b-9e22-635310cf042a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:04.836616 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ececf0-b0d1-4e8b-9e22-635310cf042a None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:04.837596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ececf0-b0d1-4e8b-9e22-635310cf042a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:04.837878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ececf0-b0d1-4e8b-9e22-635310cf042a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:04.868143 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:04.901768 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647ad041-f0ea-456d-8445-6c61e0179f1f None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:04.905777 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ececf0-b0d1-4e8b-9e22-635310cf042a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:04.907264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ececf0-b0d1-4e8b-9e22-635310cf042a None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:04.935310 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734d1c5-b045-4ec9-9c39-ba73b4570dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:04.935931 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734d1c5-b045-4ec9-9c39-ba73b4570dbf None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:04.936217 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734d1c5-b045-4ec9-9c39-ba73b4570dbf None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:04.936498 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734d1c5-b045-4ec9-9c39-ba73b4570dbf None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:04.937213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734d1c5-b045-4ec9-9c39-ba73b4570dbf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:04.937520 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734d1c5-b045-4ec9-9c39-ba73b4570dbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:04.938919 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c734d1c5-b045-4ec9-9c39-ba73b4570dbf None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:04.947271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 222/441] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:04.947878 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734d1c5-b045-4ec9-9c39-ba73b4570dbf None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:04.967741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:05.014479 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 220/442] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:36:05.014479 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ececf0-b0d1-4e8b-9e22-635310cf042a None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:05.050894 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c734d1c5-b045-4ec9-9c39-ba73b4570dbf None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:05.078945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:05.088377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28509bbd-2075-4d7d-964c-7fc2d4f3c892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:05.089018 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28509bbd-2075-4d7d-964c-7fc2d4f3c892 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:05.089303 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28509bbd-2075-4d7d-964c-7fc2d4f3c892 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:05.089577 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28509bbd-2075-4d7d-964c-7fc2d4f3c892 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:05.099500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28509bbd-2075-4d7d-964c-7fc2d4f3c892 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:05.104820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-28509bbd-2075-4d7d-964c-7fc2d4f3c892 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:36:05.104820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:05.104820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:05.104820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:05.104820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:05.104820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:05.104820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:05.104820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:05.104820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:05.104820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:05.104820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:05.104820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:05.104820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:05.104820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:05.104820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:05.104820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:05.105763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:05.105763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:05.105763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:05.105763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:05.105763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:05.105763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:05.105763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:05.105763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:05.105763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:05.105763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:05.105763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:05.105763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:05.105763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:05.105763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:05.105763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:05.105763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:05.111753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:05.111753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:05.111753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:05.111753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:05.111753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:05.111753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:05.111753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:05.111753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:05.111753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:05.111753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:05.111753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:36:05.111753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:05.111753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 223/443] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:36:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:05.111753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28509bbd-2075-4d7d-964c-7fc2d4f3c892 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:05.112481 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ececf0-b0d1-4e8b-9e22-635310cf042a None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:05.141516 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda0d68-cc3c-4f27-b2f1-c7021086f476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:05.142129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda0d68-cc3c-4f27-b2f1-c7021086f476 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:05.142437 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda0d68-cc3c-4f27-b2f1-c7021086f476 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:05.142712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dda0d68-cc3c-4f27-b2f1-c7021086f476 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:05.168658 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:05.209085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28509bbd-2075-4d7d-964c-7fc2d4f3c892 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:05.209243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda0d68-cc3c-4f27-b2f1-c7021086f476 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:05.210635 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dda0d68-cc3c-4f27-b2f1-c7021086f476 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:05.241301 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205cbd8-3c28-49f3-9e03-b134ad9131d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:05.241933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205cbd8-3c28-49f3-9e03-b134ad9131d6 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:05.242213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205cbd8-3c28-49f3-9e03-b134ad9131d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:05.242538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205cbd8-3c28-49f3-9e03-b134ad9131d6 None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:05.244256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205cbd8-3c28-49f3-9e03-b134ad9131d6 None admin] RBAC: Authorizing `identity:get_project(project_id=4e0a8c4e892848b4a8d4fea9a731c82c)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:05.245701 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205cbd8-3c28-49f3-9e03-b134ad9131d6 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:05.247639 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 224/444] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:36:05 2022] GET /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:05.248277 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205cbd8-3c28-49f3-9e03-b134ad9131d6 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:05.307529 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:05.308072 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 221/445] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:36:05.312538 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda0d68-cc3c-4f27-b2f1-c7021086f476 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:05.357220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205cbd8-3c28-49f3-9e03-b134ad9131d6 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:05.376501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:05.390579 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d88152-1b8e-40e2-a5cf-10d5525555cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:05.391192 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88152-1b8e-40e2-a5cf-10d5525555cc None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:05.391479 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88152-1b8e-40e2-a5cf-10d5525555cc None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:05.391809 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d88152-1b8e-40e2-a5cf-10d5525555cc None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:05.392474 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d88152-1b8e-40e2-a5cf-10d5525555cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:05.392781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d88152-1b8e-40e2-a5cf-10d5525555cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:05.394152 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d88152-1b8e-40e2-a5cf-10d5525555cc None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:05.402133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 225/446] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:36:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:05.402940 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d88152-1b8e-40e2-a5cf-10d5525555cc None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:05.422486 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dda0d68-cc3c-4f27-b2f1-c7021086f476 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:05.458751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a8671-243a-4b58-b7de-aca56359de63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:05.459389 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a8671-243a-4b58-b7de-aca56359de63 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:05.459670 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a8671-243a-4b58-b7de-aca56359de63 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:05.459947 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443a8671-243a-4b58-b7de-aca56359de63 None admin] PATH_INFO: `/v3/groups/5144b06cc24d4ac1adebf28e5854fef5` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:05.461115 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a8671-243a-4b58-b7de-aca56359de63 None admin] RBAC: Authorizing `identity:get_group(group_id=5144b06cc24d4ac1adebf28e5854fef5)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:05.462573 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443a8671-243a-4b58-b7de-aca56359de63 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:05.464287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 222/447] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 22:36:05 2022] GET /identity/v3/groups/5144b06cc24d4ac1adebf28e5854fef5 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:05.464877 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a8671-243a-4b58-b7de-aca56359de63 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:05.499178 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d88152-1b8e-40e2-a5cf-10d5525555cc None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:05.517632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:05.531671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068f80b-abf3-443a-abd0-8b7da5f1d112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:05.532303 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068f80b-abf3-443a-abd0-8b7da5f1d112 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:05.532588 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068f80b-abf3-443a-abd0-8b7da5f1d112 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:05.532865 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068f80b-abf3-443a-abd0-8b7da5f1d112 None admin] PATH_INFO: `/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:05.534006 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068f80b-abf3-443a-abd0-8b7da5f1d112 None admin] RBAC: Authorizing `identity:get_project(project_id=4e0a8c4e892848b4a8d4fea9a731c82c)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:05.535484 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068f80b-abf3-443a-abd0-8b7da5f1d112 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:05.537111 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 226/448] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:36:05 2022] GET /identity/v3/projects/4e0a8c4e892848b4a8d4fea9a731c82c => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:05.537866 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068f80b-abf3-443a-abd0-8b7da5f1d112 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:05.569462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443a8671-243a-4b58-b7de-aca56359de63 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:05.595083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:05.611139 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305cbfb-cc5c-49e6-9b11-49f9ec923f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:05.611767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305cbfb-cc5c-49e6-9b11-49f9ec923f17 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:05.612050 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305cbfb-cc5c-49e6-9b11-49f9ec923f17 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:05.612329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305cbfb-cc5c-49e6-9b11-49f9ec923f17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:05.643730 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068f80b-abf3-443a-abd0-8b7da5f1d112 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:05.675949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e459f-9e88-474e-ad0c-82c76745e68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:05.676561 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e459f-9e88-474e-ad0c-82c76745e68a None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:05.676868 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e459f-9e88-474e-ad0c-82c76745e68a None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:05.677144 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e459f-9e88-474e-ad0c-82c76745e68a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:05.677933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e459f-9e88-474e-ad0c-82c76745e68a None admin] RBAC: Adding query filter params (group.id=5144b06cc24d4ac1adebf28e5854fef5, role.id=267b3ef4524c42bb90a7002ee1639b74, scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:05.678244 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e459f-9e88-474e-ad0c-82c76745e68a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:05.678335 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305cbfb-cc5c-49e6-9b11-49f9ec923f17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:05.679708 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e459f-9e88-474e-ad0c-82c76745e68a None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:05.679801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305cbfb-cc5c-49e6-9b11-49f9ec923f17 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:05.685908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 227/449] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jul 27 22:36:05 2022] GET /identity/v3/role_assignments?group.id=5144b06cc24d4ac1adebf28e5854fef5&scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c&role.id=267b3ef4524c42bb90a7002ee1639b74 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:05.686718 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e459f-9e88-474e-ad0c-82c76745e68a None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:05.748782 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:05.800108 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e459f-9e88-474e-ad0c-82c76745e68a None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:05.815038 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 223/450] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:36:05.816232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305cbfb-cc5c-49e6-9b11-49f9ec923f17 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:05.845299 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:05.847843 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1c80c-bb5a-4473-baee-3e2756ffb2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:05.848574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1c80c-bb5a-4473-baee-3e2756ffb2d8 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:05.848869 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1c80c-bb5a-4473-baee-3e2756ffb2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:05.849146 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e1c80c-bb5a-4473-baee-3e2756ffb2d8 None admin] PATH_INFO: `/v3/groups/5144b06cc24d4ac1adebf28e5854fef5` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:05.850584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1c80c-bb5a-4473-baee-3e2756ffb2d8 None admin] RBAC: Authorizing `identity:get_group(group_id=5144b06cc24d4ac1adebf28e5854fef5)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:05.851893 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e1c80c-bb5a-4473-baee-3e2756ffb2d8 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:05.854243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 228/451] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 22:36:05 2022] GET /identity/v3/groups/5144b06cc24d4ac1adebf28e5854fef5 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:05.860096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1c80c-bb5a-4473-baee-3e2756ffb2d8 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:05.930022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305cbfb-cc5c-49e6-9b11-49f9ec923f17 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:05.972009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e1c80c-bb5a-4473-baee-3e2756ffb2d8 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:05.978050 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b1d41-0f61-4858-abd9-1706941c08e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:05.979002 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b1d41-0f61-4858-abd9-1706941c08e0 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:05.979470 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b1d41-0f61-4858-abd9-1706941c08e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:05.979743 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2b1d41-0f61-4858-abd9-1706941c08e0 None admin] PATH_INFO: `/v3/projects/a383910370a74720956232cbcc0a7762` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:05.980925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b1d41-0f61-4858-abd9-1706941c08e0 None admin] RBAC: Authorizing `identity:get_project(project_id=a383910370a74720956232cbcc0a7762)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:05.982362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2b1d41-0f61-4858-abd9-1706941c08e0 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:05.984044 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 224/452] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:36:05 2022] GET /identity/v3/projects/a383910370a74720956232cbcc0a7762 => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:05.989744 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b1d41-0f61-4858-abd9-1706941c08e0 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:05.994400 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:06.009734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bae32-8b8a-4965-828f-acc1afef0c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:06.010654 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bae32-8b8a-4965-828f-acc1afef0c3d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:06.010940 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bae32-8b8a-4965-828f-acc1afef0c3d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:06.011216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bae32-8b8a-4965-828f-acc1afef0c3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:06.012009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bae32-8b8a-4965-828f-acc1afef0c3d None admin] RBAC: Adding query filter params (group.id=5144b06cc24d4ac1adebf28e5854fef5, role.id=d4ee54c077084dcea38d7476927b61df, scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:06.012352 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bae32-8b8a-4965-828f-acc1afef0c3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:06.013799 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bae32-8b8a-4965-828f-acc1afef0c3d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:06.021057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 229/453] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jul 27 22:36:05 2022] GET /identity/v3/role_assignments?group.id=5144b06cc24d4ac1adebf28e5854fef5&scope.project.id=4e0a8c4e892848b4a8d4fea9a731c82c&role.id=d4ee54c077084dcea38d7476927b61df => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:06.099337 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:06.107522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2b1d41-0f61-4858-abd9-1706941c08e0 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:06.141555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33cefd-e736-423a-83a7-72ceb1e95037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:06.142204 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33cefd-e736-423a-83a7-72ceb1e95037 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:06.142525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33cefd-e736-423a-83a7-72ceb1e95037 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:06.142804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33cefd-e736-423a-83a7-72ceb1e95037 None admin] PATH_INFO: `/v3/groups/910f84889034407e9c4b772d821c0e1b` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:06.143971 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33cefd-e736-423a-83a7-72ceb1e95037 None admin] RBAC: Authorizing `identity:get_group(group_id=910f84889034407e9c4b772d821c0e1b)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:06.145428 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33cefd-e736-423a-83a7-72ceb1e95037 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:06.147193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 225/454] 10.222.0.48 () {56 vars in 1180 bytes} [Wed Jul 27 22:36:05 2022] GET /identity/v3/groups/910f84889034407e9c4b772d821c0e1b => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:06.153736 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bae32-8b8a-4965-828f-acc1afef0c3d None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:06.255760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bae32-8b8a-4965-828f-acc1afef0c3d None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:06.295893 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b724a95-cccf-4216-ac00-242383873e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:06.296514 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b724a95-cccf-4216-ac00-242383873e95 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:06.296794 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b724a95-cccf-4216-ac00-242383873e95 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:06.297065 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b724a95-cccf-4216-ac00-242383873e95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:06.297847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b724a95-cccf-4216-ac00-242383873e95 None admin] RBAC: Adding query filter params (group.id=910f84889034407e9c4b772d821c0e1b, role.id=49e0ba8d8c9f4824892b61f05d0036e8, scope.project.id=a383910370a74720956232cbcc0a7762) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:06.298152 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b724a95-cccf-4216-ac00-242383873e95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:06.299624 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b724a95-cccf-4216-ac00-242383873e95 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:06.306172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 230/455] 10.222.0.48 () {56 vars in 1376 bytes} [Wed Jul 27 22:36:06 2022] GET /identity/v3/role_assignments?group.id=910f84889034407e9c4b772d821c0e1b&scope.project.id=a383910370a74720956232cbcc0a7762&role.id=49e0ba8d8c9f4824892b61f05d0036e8 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:08.833234 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83cbbb-a1c2-4940-b484-f53aa52c1993 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:08.834228 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83cbbb-a1c2-4940-b484-f53aa52c1993 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:08.834755 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83cbbb-a1c2-4940-b484-f53aa52c1993 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:08.836738 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 226/456] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:08.842229 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be46af2-6b9f-410b-afdc-3bc73a857120 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:08.843068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be46af2-6b9f-410b-afdc-3bc73a857120 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:08.843542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be46af2-6b9f-410b-afdc-3bc73a857120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:08.867373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-7be46af2-6b9f-410b-afdc-3bc73a857120 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:08.869374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-7be46af2-6b9f-410b-afdc-3bc73a857120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:08.923334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:08.951437 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8bb9a-f03e-4dc3-8ff1-ba50b334e525 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:08.951779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8bb9a-f03e-4dc3-8ff1-ba50b334e525 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:08.954362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8bb9a-f03e-4dc3-8ff1-ba50b334e525 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:08.954362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 227/457] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:08.955334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 231/458] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:08.960404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380ae1a-1fbd-4713-85c3-ca99ef232cee None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:08.960700 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380ae1a-1fbd-4713-85c3-ca99ef232cee None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:08.960985 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380ae1a-1fbd-4713-85c3-ca99ef232cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:08.980954 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be46af2-6b9f-410b-afdc-3bc73a857120 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:08.985351 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-e380ae1a-1fbd-4713-85c3-ca99ef232cee None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:08.986742 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e380ae1a-1fbd-4713-85c3-ca99ef232cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:09.056741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 228/459] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:09.058361 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98ad2c-cc3f-4803-a4bf-a4148f373cc0 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:09.058807 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98ad2c-cc3f-4803-a4bf-a4148f373cc0 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:09.059081 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a98ad2c-cc3f-4803-a4bf-a4148f373cc0 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:09.060488 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 229/460] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:09.066227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e2738-deb0-4ce0-be53-e261ad9870ea None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:09.067401 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e2738-deb0-4ce0-be53-e261ad9870ea None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:09.067990 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e2738-deb0-4ce0-be53-e261ad9870ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:09.094144 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-255e2738-deb0-4ce0-be53-e261ad9870ea None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:09.095575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-255e2738-deb0-4ce0-be53-e261ad9870ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:09.125195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be46af2-6b9f-410b-afdc-3bc73a857120 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:09.160757 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e916f-65b3-4807-b1a4-f509c0ee6863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:09.161553 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e916f-65b3-4807-b1a4-f509c0ee6863 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:09.161952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e916f-65b3-4807-b1a4-f509c0ee6863 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:09.162294 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e916f-65b3-4807-b1a4-f509c0ee6863 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:09.172874 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e916f-65b3-4807-b1a4-f509c0ee6863 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:09.174500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e916f-65b3-4807-b1a4-f509c0ee6863 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:09.186959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 230/461] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:36:09.194393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e2738-deb0-4ce0-be53-e261ad9870ea None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:09.194583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-665e916f-65b3-4807-b1a4-f509c0ee6863 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:09.194583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:09.194583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:09.194583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:09.194583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:09.194583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:09.194583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:09.194583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:09.194583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:09.194583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:09.194583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:09.194583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:09.194583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:09.194583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:09.194583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:09.195407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:09.195407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:09.195407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:09.195407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:09.195407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:09.195407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:09.195407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:09.195407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:09.195407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:09.195407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:09.195407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:09.195407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:09.195407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:09.195407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:09.195407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:09.195407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:09.195407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:09.196957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:09.196957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:09.196957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:09.196957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:09.196957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 232/462] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:09.203541 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e916f-65b3-4807-b1a4-f509c0ee6863 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:09.237240 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:09.251902 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:09.332301 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e2738-deb0-4ce0-be53-e261ad9870ea None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:09.335637 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e916f-65b3-4807-b1a4-f509c0ee6863 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:09.373954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b980a7-57cf-4f87-bae5-726993e27630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:09.374900 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b980a7-57cf-4f87-bae5-726993e27630 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:09.375315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b980a7-57cf-4f87-bae5-726993e27630 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:09.375600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b980a7-57cf-4f87-bae5-726993e27630 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:09.379222 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baca18b-8fdd-4ee5-a3f6-f8256d8e7199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:09.380041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baca18b-8fdd-4ee5-a3f6-f8256d8e7199 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:09.380506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baca18b-8fdd-4ee5-a3f6-f8256d8e7199 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:09.380957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baca18b-8fdd-4ee5-a3f6-f8256d8e7199 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:09.381894 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baca18b-8fdd-4ee5-a3f6-f8256d8e7199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:09.382409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baca18b-8fdd-4ee5-a3f6-f8256d8e7199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:09.384979 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baca18b-8fdd-4ee5-a3f6-f8256d8e7199 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:09.387213 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b980a7-57cf-4f87-bae5-726993e27630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:09.389587 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b980a7-57cf-4f87-bae5-726993e27630 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:09.400417 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 233/463] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:09.401472 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baca18b-8fdd-4ee5-a3f6-f8256d8e7199 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:09.405886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-f8b980a7-57cf-4f87-bae5-726993e27630 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:09.405886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:09.405886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:09.405886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:09.405886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:09.405886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:09.405886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:09.405886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:09.405886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:09.405886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:09.405886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:09.405886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:09.405886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:09.405886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:09.405886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:09.406781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:09.406781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:09.406781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:09.406781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:09.406781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:09.406781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:09.406781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:09.406781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:09.406781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:09.406781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:09.406781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:09.406781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:09.406781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:09.406781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:09.406781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:09.406781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:09.406781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:09.407762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:09.407762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:09.407762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:09.407762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:09.407762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 231/464] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:09.407762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b980a7-57cf-4f87-bae5-726993e27630 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:09.494976 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:09.507213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:09.518273 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baca18b-8fdd-4ee5-a3f6-f8256d8e7199 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:09.522795 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b980a7-57cf-4f87-bae5-726993e27630 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:09.556803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b230e7-a5f4-4852-adb0-3f93f6d41484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:09.557445 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b230e7-a5f4-4852-adb0-3f93f6d41484 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:09.557732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b230e7-a5f4-4852-adb0-3f93f6d41484 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:09.557841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c977538-2b98-40e1-b121-83fd06087949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:09.558050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b230e7-a5f4-4852-adb0-3f93f6d41484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:09.558436 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c977538-2b98-40e1-b121-83fd06087949 None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:09.558724 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c977538-2b98-40e1-b121-83fd06087949 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:09.559003 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c977538-2b98-40e1-b121-83fd06087949 None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:09.559684 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c977538-2b98-40e1-b121-83fd06087949 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:09.561117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c977538-2b98-40e1-b121-83fd06087949 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:09.569086 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b230e7-a5f4-4852-adb0-3f93f6d41484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:09.570578 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b230e7-a5f4-4852-adb0-3f93f6d41484 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:09.592876 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 232/465] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 22:36:09 2022] POST /identity/v3/users => generated 248 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:36:09.592876 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c977538-2b98-40e1-b121-83fd06087949 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:09.593157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-a2b230e7-a5f4-4852-adb0-3f93f6d41484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:09.593157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:09.593157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:09.593157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:09.593157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:09.593157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:09.593157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:09.593157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:09.593157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:09.593157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:09.593157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:09.593157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:09.593157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:09.593157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:09.593157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:09.593967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:09.593967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:09.593967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:09.593967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:09.593967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:09.593967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:09.593967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:09.593967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:09.593967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:09.593967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:09.593967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:09.593967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:09.593967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:09.593967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:09.593967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:09.593967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:09.593967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:09.595759 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:09.595759 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:09.595759 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:09.595759 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:09.595759 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 234/466] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:09.595759 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ffed0-e6dc-4c93-9ae9-247b751fef13 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:09.595759 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ffed0-e6dc-4c93-9ae9-247b751fef13 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:09.595759 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ffed0-e6dc-4c93-9ae9-247b751fef13 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:09.595759 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 235/467] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:09.602903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ffed0-e6dc-4c93-9ae9-247b751fef13 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:09.742281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ffed0-e6dc-4c93-9ae9-247b751fef13 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:09.746941 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c977538-2b98-40e1-b121-83fd06087949 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:09.781044 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:09.787535 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030c6e9-c458-4cc6-af4d-f35a70ec9140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:09.787690 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84497655-25fc-4423-a105-58f2a468839d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:09.788166 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030c6e9-c458-4cc6-af4d-f35a70ec9140 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:09.788274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84497655-25fc-4423-a105-58f2a468839d None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:09.788450 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030c6e9-c458-4cc6-af4d-f35a70ec9140 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:09.788542 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84497655-25fc-4423-a105-58f2a468839d None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:09.788730 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030c6e9-c458-4cc6-af4d-f35a70ec9140 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:09.788827 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84497655-25fc-4423-a105-58f2a468839d None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:09.789422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030c6e9-c458-4cc6-af4d-f35a70ec9140 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:09.789531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84497655-25fc-4423-a105-58f2a468839d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:09.789790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030c6e9-c458-4cc6-af4d-f35a70ec9140 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:09.790395 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84497655-25fc-4423-a105-58f2a468839d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:09.791744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030c6e9-c458-4cc6-af4d-f35a70ec9140 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:09.792042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84497655-25fc-4423-a105-58f2a468839d None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:09.806880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 236/468] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:09.808235 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e540cd-c489-44cf-9ebb-c68ac352b5f5 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:09.808531 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e540cd-c489-44cf-9ebb-c68ac352b5f5 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:09.808808 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e540cd-c489-44cf-9ebb-c68ac352b5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:09.811664 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 233/469] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:09.812519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84497655-25fc-4423-a105-58f2a468839d None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:09.815944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:09.834276 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-e4e540cd-c489-44cf-9ebb-c68ac352b5f5 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:09.835983 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e4e540cd-c489-44cf-9ebb-c68ac352b5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:09.921461 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 237/470] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:09.922310 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e540cd-c489-44cf-9ebb-c68ac352b5f5 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:09.967672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84497655-25fc-4423-a105-58f2a468839d None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:10.016107 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1e711-dd31-4225-94c1-6ed2325cdd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:10.016709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1e711-dd31-4225-94c1-6ed2325cdd36 None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:10.017245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1e711-dd31-4225-94c1-6ed2325cdd36 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:10.017524 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1e711-dd31-4225-94c1-6ed2325cdd36 None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:10.018627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1e711-dd31-4225-94c1-6ed2325cdd36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:10.020087 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1e711-dd31-4225-94c1-6ed2325cdd36 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:10.034217 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e540cd-c489-44cf-9ebb-c68ac352b5f5 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:10.050174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 234/471] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 22:36:09 2022] POST /identity/v3/users => generated 248 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:36:10.051286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1e711-dd31-4225-94c1-6ed2325cdd36 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:10.095977 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:10.110949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00824779-a8f9-4b73-87c6-eeb4dd7afaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:10.111594 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00824779-a8f9-4b73-87c6-eeb4dd7afaef None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:10.111884 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00824779-a8f9-4b73-87c6-eeb4dd7afaef None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:10.112168 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00824779-a8f9-4b73-87c6-eeb4dd7afaef None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:10.112866 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00824779-a8f9-4b73-87c6-eeb4dd7afaef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:10.114330 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00824779-a8f9-4b73-87c6-eeb4dd7afaef None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:10.114999 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:10.148407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 238/472] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 22:36:09 2022] POST /identity/v3/users => generated 246 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:36:10.150444 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87febc-d0b3-4f80-8d05-07228d3e70b2 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:10.150783 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87febc-d0b3-4f80-8d05-07228d3e70b2 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:10.151126 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c87febc-d0b3-4f80-8d05-07228d3e70b2 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:10.153074 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 239/473] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:10.158266 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984286d-7a0b-4f8e-a2b9-5e890ee4472d None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:10.158572 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984286d-7a0b-4f8e-a2b9-5e890ee4472d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:10.158849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984286d-7a0b-4f8e-a2b9-5e890ee4472d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:10.179124 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-7984286d-7a0b-4f8e-a2b9-5e890ee4472d None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:10.180678 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-7984286d-7a0b-4f8e-a2b9-5e890ee4472d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:10.215373 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1e711-dd31-4225-94c1-6ed2325cdd36 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:10.259091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d36f2-8543-4419-bb8a-9f62249fbbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:10.259770 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d36f2-8543-4419-bb8a-9f62249fbbcd None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:10.260062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d36f2-8543-4419-bb8a-9f62249fbbcd None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:10.260373 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d36f2-8543-4419-bb8a-9f62249fbbcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:10.272896 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d36f2-8543-4419-bb8a-9f62249fbbcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:10.274911 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d36f2-8543-4419-bb8a-9f62249fbbcd None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:10.291110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-689d36f2-8543-4419-bb8a-9f62249fbbcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:10.291110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:10.291110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:10.291110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:10.291110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:10.291110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:10.291110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:10.291110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:10.291110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:10.291110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:10.291110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:10.291110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:10.291110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:10.291110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:10.291110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:10.292068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:10.292068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:10.292068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:10.292068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:10.292068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:10.292068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:10.292068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:10.292068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:10.292068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:10.292068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:10.292068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:10.292068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:10.292068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:10.292068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:10.292068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:10.292068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:10.292068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:10.292928 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:10.292928 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:10.292928 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:10.292928 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:10.296007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 235/474] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:10.299681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d36f2-8543-4419-bb8a-9f62249fbbcd None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:10.303106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 240/475] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:36:10.328753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984286d-7a0b-4f8e-a2b9-5e890ee4472d None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:10.422277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:10.426556 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d36f2-8543-4419-bb8a-9f62249fbbcd None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:10.455742 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984286d-7a0b-4f8e-a2b9-5e890ee4472d None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:10.475058 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437f1fb-1f07-4688-a4ee-ed4d407e71de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:10.478510 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437f1fb-1f07-4688-a4ee-ed4d407e71de None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:10.478510 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437f1fb-1f07-4688-a4ee-ed4d407e71de None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:10.478510 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437f1fb-1f07-4688-a4ee-ed4d407e71de None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:10.478510 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437f1fb-1f07-4688-a4ee-ed4d407e71de None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:10.478510 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437f1fb-1f07-4688-a4ee-ed4d407e71de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:10.480806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437f1fb-1f07-4688-a4ee-ed4d407e71de None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:10.481748 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:10.502362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 236/476] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:10.504819 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437f1fb-1f07-4688-a4ee-ed4d407e71de None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:10.518772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261ebf0-180f-4a9a-8ea5-cee5d7c3b2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:10.519407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261ebf0-180f-4a9a-8ea5-cee5d7c3b2cc None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:10.519688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261ebf0-180f-4a9a-8ea5-cee5d7c3b2cc None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:10.519960 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0261ebf0-180f-4a9a-8ea5-cee5d7c3b2cc None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:10.520673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261ebf0-180f-4a9a-8ea5-cee5d7c3b2cc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:10.522060 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0261ebf0-180f-4a9a-8ea5-cee5d7c3b2cc None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:10.533694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.sql.core [None req-0261ebf0-180f-4a9a-8ea5-cee5d7c3b2cc None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 22:36:10.533694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 22:36:10.533694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [parameters: {'id': 'b94da9decaab45d0b65ba56f8bd9ed60', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 22:36:10.533694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86595) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 22:36:10.554838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-0261ebf0-180f-4a9a-8ea5-cee5d7c3b2cc None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 22:36:10.554838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:10.554838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 22:36:10.554838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 22:36:10.554838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 22:36:10.554838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 22:36:10.554838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 22:36:10.554838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 22:36:10.554838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 22:36:10.554838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application conn.query(q) Jul 27 22:36:10.554838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 22:36:10.554838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 22:36:10.554838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 22:36:10.554838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application result.read() Jul 27 22:36:10.554838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 22:36:10.556329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 22:36:10.556329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 22:36:10.556329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 22:36:10.556329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 22:36:10.556329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 22:36:10.556329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 22:36:10.556329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 22:36:10.556329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 22:36:10.556329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:10.556329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 22:36:10.556329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:10.556329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:10.556329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 22:36:10.556329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 22:36:10.556329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 27 22:36:10.556329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return ref.to_dict() Jul 27 22:36:10.556329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 22:36:10.556329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application next(self.gen) Jul 27 22:36:10.557777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 22:36:10.557777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application yield resource Jul 27 22:36:10.557777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 22:36:10.557777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application next(self.gen) Jul 27 22:36:10.557777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 22:36:10.557777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 22:36:10.557777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 22:36:10.557777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 22:36:10.557777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 22:36:10.557777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise self.value Jul 27 22:36:10.557777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 22:36:10.557777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 22:36:10.557777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 22:36:10.557777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application session.commit() Jul 27 22:36:10.557777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 22:36:10.557777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 22:36:10.557777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 22:36:10.558995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 22:36:10.558995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 22:36:10.558995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self.session.flush() Jul 27 22:36:10.558995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 22:36:10.558995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 22:36:10.558995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 22:36:10.558995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 22:36:10.558995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 22:36:10.558995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application compat.raise_( Jul 27 22:36:10.558995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 22:36:10.558995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception Jul 27 22:36:10.558995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 22:36:10.558995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 22:36:10.558995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 22:36:10.558995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 22:36:10.558995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 22:36:10.558995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 22:36:10.559886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 22:36:10.559886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 22:36:10.559886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 22:36:10.559886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 22:36:10.559886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 22:36:10.559886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 22:36:10.559886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 22:36:10.559886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 22:36:10.559886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 22:36:10.559886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 22:36:10.559886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 22:36:10.559886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 22:36:10.559886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 22:36:10.559886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 22:36:10.559886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 22:36:10.559886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception Jul 27 22:36:10.560713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 22:36:10.560713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 22:36:10.560713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 22:36:10.560713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 22:36:10.560713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 22:36:10.560713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 22:36:10.560713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 22:36:10.560713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application conn.query(q) Jul 27 22:36:10.560713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 22:36:10.560713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 22:36:10.560713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 22:36:10.560713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application result.read() Jul 27 22:36:10.560713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 22:36:10.560713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 22:36:10.560713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 22:36:10.560713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 22:36:10.562307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 22:36:10.562307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 22:36:10.562307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 22:36:10.562307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 22:36:10.562307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 22:36:10.562307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 22:36:10.562307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [parameters: {'id': 'b94da9decaab45d0b65ba56f8bd9ed60', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 22:36:10.562307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 22:36:10.562307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:10.562307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:36:10.562307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:10.562307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:10.562307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:10.562307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:10.562307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:10.562307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:10.563398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:10.563398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:10.563398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:10.563398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:10.563398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:10.563398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:10.563398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 27 22:36:10.563398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 27 22:36:10.563398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:10.563398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:10.563398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 27 22:36:10.563398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 27 22:36:10.563398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 22:36:10.563398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 22:36:10.563398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 22:36:10.563398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:10.564446 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 241/477] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Jul 27 22:36:10 2022] POST /identity/v3/roles => generated 144 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:10.565629 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261ebf0-180f-4a9a-8ea5-cee5d7c3b2cc None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:10.653492 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437f1fb-1f07-4688-a4ee-ed4d407e71de None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:10.689511 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63596f38-e1dd-4a9f-8de6-25a5066bc754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:10.690135 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63596f38-e1dd-4a9f-8de6-25a5066bc754 None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:10.690443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63596f38-e1dd-4a9f-8de6-25a5066bc754 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:10.690723 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63596f38-e1dd-4a9f-8de6-25a5066bc754 None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:10.691457 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63596f38-e1dd-4a9f-8de6-25a5066bc754 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:10.692899 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63596f38-e1dd-4a9f-8de6-25a5066bc754 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:10.714757 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0261ebf0-180f-4a9a-8ea5-cee5d7c3b2cc None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:10.722532 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 237/478] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 22:36:10 2022] POST /identity/v3/users => generated 249 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:36:10.797423 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547cac9-4162-4cac-8e2d-8299cbcac624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:10.798591 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547cac9-4162-4cac-8e2d-8299cbcac624 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:10.799132 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547cac9-4162-4cac-8e2d-8299cbcac624 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:10.799600 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547cac9-4162-4cac-8e2d-8299cbcac624 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:10.814208 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547cac9-4162-4cac-8e2d-8299cbcac624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:10.825122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-e547cac9-4162-4cac-8e2d-8299cbcac624 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:36:10.825122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:10.825122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:10.825122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:10.825122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:10.825122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:10.825122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:10.825122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:10.825122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:10.825122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:10.825122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:10.825122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:10.825122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:10.825122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:10.825122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:10.825122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:10.826093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:10.826093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:10.826093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:10.826093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:10.826093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:10.826093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:10.826093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:10.826093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:10.826093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:10.826093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:10.826093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:10.826093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:10.826093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:10.826093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:10.826093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:10.826093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:10.827196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:10.827196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:10.827196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:10.827196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:10.827196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:10.827196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:10.827196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:10.827196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:10.827196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:10.827196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:10.827196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 22:36:10.827196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:10.827196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 242/479] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:36:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:10.834159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63596f38-e1dd-4a9f-8de6-25a5066bc754 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:10.866732 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:10.953758 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63596f38-e1dd-4a9f-8de6-25a5066bc754 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:11.002250 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04859c8f-22a6-4ac2-8794-60688a90725f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:11.003036 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04859c8f-22a6-4ac2-8794-60688a90725f None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:11.003255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04859c8f-22a6-4ac2-8794-60688a90725f None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:11.003535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04859c8f-22a6-4ac2-8794-60688a90725f None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:11.004261 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04859c8f-22a6-4ac2-8794-60688a90725f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:11.004566 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04859c8f-22a6-4ac2-8794-60688a90725f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:11.005946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04859c8f-22a6-4ac2-8794-60688a90725f None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:11.014979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 238/480] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:12.050822 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa3b06-b5b1-4b88-973e-5f46906b8555 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:12.051366 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa3b06-b5b1-4b88-973e-5f46906b8555 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:12.051366 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa3b06-b5b1-4b88-973e-5f46906b8555 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:12.053024 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 243/481] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:12.057975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42b238-6e94-4f87-8238-bb458bae4b85 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:12.058381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42b238-6e94-4f87-8238-bb458bae4b85 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:12.058573 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42b238-6e94-4f87-8238-bb458bae4b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:12.076961 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-1f42b238-6e94-4f87-8238-bb458bae4b85 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:12.078149 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-1f42b238-6e94-4f87-8238-bb458bae4b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:12.147529 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 239/482] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:12.183223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa3b06-b5b1-4b88-973e-5f46906b8555 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:12.229831 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:12.306017 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa3b06-b5b1-4b88-973e-5f46906b8555 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:12.354483 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf6899-9738-49e6-8aa0-fd148a324694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:12.355134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf6899-9738-49e6-8aa0-fd148a324694 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:12.355419 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf6899-9738-49e6-8aa0-fd148a324694 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:12.355701 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf6899-9738-49e6-8aa0-fd148a324694 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:12.377853 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bf6899-9738-49e6-8aa0-fd148a324694 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:12.382829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-c6bf6899-9738-49e6-8aa0-fd148a324694 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:12.382829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:12.382829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:12.382829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:12.382829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:12.382829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:12.382829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:12.382829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:12.382829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:12.382829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:12.382829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:12.382829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:12.382829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:12.382829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:12.382829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:12.382829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:12.384317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:12.384317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:12.384317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:12.384317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:12.384317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:12.384317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:12.384317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:12.384317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:12.384317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:12.384317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:12.384317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:12.384317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:12.384317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:12.384317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:12.384317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:12.384317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:12.385134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:12.385134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:12.385134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:12.385134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:12.385134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:12.385134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:12.385134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:12.385134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:12.385134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:12.385134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:12.385134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:12.385134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:12.385134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 244/483] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:12.390534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42b238-6e94-4f87-8238-bb458bae4b85 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:12.403913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:12.512065 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb44e0-574f-414f-9dcb-838729642f45 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:12.512723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb44e0-574f-414f-9dcb-838729642f45 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:12.513209 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecb44e0-574f-414f-9dcb-838729642f45 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:12.515043 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 245/484] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:12.520220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a130f32-272a-4bb4-860f-0a009cfc9bb9 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:12.520751 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a130f32-272a-4bb4-860f-0a009cfc9bb9 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:12.521228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a130f32-272a-4bb4-860f-0a009cfc9bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:12.534462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42b238-6e94-4f87-8238-bb458bae4b85 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:12.564810 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-1a130f32-272a-4bb4-860f-0a009cfc9bb9 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:12.566644 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-1a130f32-272a-4bb4-860f-0a009cfc9bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:12.567990 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6628e-8728-42ef-9c45-c1997666cf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:12.570625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6628e-8728-42ef-9c45-c1997666cf41 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:12.571641 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6628e-8728-42ef-9c45-c1997666cf41 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:12.572118 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6628e-8728-42ef-9c45-c1997666cf41 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:12.573284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6628e-8728-42ef-9c45-c1997666cf41 None admin] RBAC: Adding query filter params (name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:12.574653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6628e-8728-42ef-9c45-c1997666cf41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:12.576505 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6628e-8728-42ef-9c45-c1997666cf41 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:12.593519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 240/485] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:36:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:12.599123 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6628e-8728-42ef-9c45-c1997666cf41 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:12.698682 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 246/486] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:36:12.709989 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:12.730093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a130f32-272a-4bb4-860f-0a009cfc9bb9 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:12.768376 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6628e-8728-42ef-9c45-c1997666cf41 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:12.780871 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:12.817783 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e880ada1-23ea-499c-939f-58a8abc79d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:12.818463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880ada1-23ea-499c-939f-58a8abc79d4f None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:12.818756 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880ada1-23ea-499c-939f-58a8abc79d4f None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:12.819041 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e880ada1-23ea-499c-939f-58a8abc79d4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:12.835087 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880ada1-23ea-499c-939f-58a8abc79d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:12.836852 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e880ada1-23ea-499c-939f-58a8abc79d4f None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:12.852014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-e880ada1-23ea-499c-939f-58a8abc79d4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:12.852014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:12.852014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:12.852014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:12.852014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:12.852014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:12.852014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:12.852014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:12.852014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:12.852014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:12.852014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:12.852014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:12.852014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:12.852014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:12.852014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:12.852954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:12.852954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:12.852954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:12.852954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:12.852954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:12.852954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:12.852954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:12.852954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:12.852954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:12.852954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:12.852954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:12.852954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:12.852954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:12.852954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:12.852954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:12.852954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:12.852954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:12.853811 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:12.853811 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:12.853811 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:12.853811 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:12.853811 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 241/487] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:12.859204 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e0cb4-4af0-4507-ac8a-7e7a8af253f5 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:12.859605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e0cb4-4af0-4507-ac8a-7e7a8af253f5 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:12.859952 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11e0cb4-4af0-4507-ac8a-7e7a8af253f5 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:12.861555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 242/488] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:12.865880 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e0cb4-4af0-4507-ac8a-7e7a8af253f5 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:12.874646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a130f32-272a-4bb4-860f-0a009cfc9bb9 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:12.917570 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336db29-7d75-4ff5-9d2c-311dcc470962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:12.918708 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336db29-7d75-4ff5-9d2c-311dcc470962 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:12.919206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336db29-7d75-4ff5-9d2c-311dcc470962 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:12.919718 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336db29-7d75-4ff5-9d2c-311dcc470962 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:12.932944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336db29-7d75-4ff5-9d2c-311dcc470962 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:12.940559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-0336db29-7d75-4ff5-9d2c-311dcc470962 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:12.940559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:12.940559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:12.940559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:12.940559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:12.940559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:12.940559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:12.940559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:12.940559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:12.940559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:12.940559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:12.940559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:12.940559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:12.940559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:12.940559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:12.940559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:12.941491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:12.941491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:12.941491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:12.941491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:12.941491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:12.941491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:12.941491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:12.941491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:12.941491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:12.941491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:12.941491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:12.941491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:12.941491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:12.941491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:12.941491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:12.941491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:12.942304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:12.942304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:12.942304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:12.942304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:12.942304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:12.942304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:12.942304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:12.942304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:12.942304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:12.942304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:12.942304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:12.942304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:12.945215 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 247/489] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:12.947170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464ec63-1bb2-480c-9605-135fe137586a None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:12.947644 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464ec63-1bb2-480c-9605-135fe137586a None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:12.948097 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1464ec63-1bb2-480c-9605-135fe137586a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:12.967492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-1464ec63-1bb2-480c-9605-135fe137586a None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:12.969038 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-1464ec63-1bb2-480c-9605-135fe137586a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:12.978940 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11e0cb4-4af0-4507-ac8a-7e7a8af253f5 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:13.001393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:13.017338 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8c818-90b4-46a2-bd7b-e0dd7b41160d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:13.017975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8c818-90b4-46a2-bd7b-e0dd7b41160d None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:13.018624 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8c818-90b4-46a2-bd7b-e0dd7b41160d None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:13.018758 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8c818-90b4-46a2-bd7b-e0dd7b41160d None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:13.019411 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8c818-90b4-46a2-bd7b-e0dd7b41160d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:13.019769 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8c818-90b4-46a2-bd7b-e0dd7b41160d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:13.021264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8c818-90b4-46a2-bd7b-e0dd7b41160d None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:13.035138 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 243/490] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:13.035812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8c818-90b4-46a2-bd7b-e0dd7b41160d None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:13.053489 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 248/491] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:13.055004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464ec63-1bb2-480c-9605-135fe137586a None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:13.081327 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:13.160980 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1464ec63-1bb2-480c-9605-135fe137586a None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:13.165835 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8c818-90b4-46a2-bd7b-e0dd7b41160d None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:13.198754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdb2d3-9c44-45f5-a3d7-6d17363b6374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:13.199769 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdb2d3-9c44-45f5-a3d7-6d17363b6374 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:13.200291 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdb2d3-9c44-45f5-a3d7-6d17363b6374 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:13.200810 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdb2d3-9c44-45f5-a3d7-6d17363b6374 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:13.202597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee4012-d7a6-40ef-aeb4-40343d7c4ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:13.203337 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee4012-d7a6-40ef-aeb4-40343d7c4ff8 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:13.203706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee4012-d7a6-40ef-aeb4-40343d7c4ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:13.204086 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee4012-d7a6-40ef-aeb4-40343d7c4ff8 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:13.205035 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee4012-d7a6-40ef-aeb4-40343d7c4ff8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:13.205322 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee4012-d7a6-40ef-aeb4-40343d7c4ff8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:13.206836 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee4012-d7a6-40ef-aeb4-40343d7c4ff8 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:13.210138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdb2d3-9c44-45f5-a3d7-6d17363b6374 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:13.211805 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdb2d3-9c44-45f5-a3d7-6d17363b6374 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:13.215888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 244/492] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:36:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:13.216808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee4012-d7a6-40ef-aeb4-40343d7c4ff8 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:13.226687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-2dcdb2d3-9c44-45f5-a3d7-6d17363b6374 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 22:36:13.226687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:13.226687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:13.226687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:13.226687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:13.226687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:13.226687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:13.226687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:13.226687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:13.226687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:13.226687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:13.226687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:13.226687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:13.226687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:13.226687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:13.226687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:13.228186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:13.228186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:13.228186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:13.228186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:13.228186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:13.228186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:13.228186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:13.228186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:13.228186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:13.228186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:13.228186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:13.228186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:13.228186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:13.228186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:13.228186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:13.228186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:13.228186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:13.228186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:13.229077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:13.229077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:13.229077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:13.229077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:13.229077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:13.229077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:13.229077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:13.229077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:13.229077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 22:36:13.229077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:13.231894 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 249/493] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:36:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:13.237297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdb2d3-9c44-45f5-a3d7-6d17363b6374 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:13.263391 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:13.326174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee4012-d7a6-40ef-aeb4-40343d7c4ff8 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:13.327028 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:13.348075 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdb2d3-9c44-45f5-a3d7-6d17363b6374 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:13.366234 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7678b-4aa3-4b26-a699-2d87581d554f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:13.367147 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7678b-4aa3-4b26-a699-2d87581d554f None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:13.367605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7678b-4aa3-4b26-a699-2d87581d554f None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:13.368707 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7678b-4aa3-4b26-a699-2d87581d554f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:13.379339 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa7678b-4aa3-4b26-a699-2d87581d554f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:13.382002 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bfe4d-e366-48ab-8aaa-515205150444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:13.382677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bfe4d-e366-48ab-8aaa-515205150444 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:13.382960 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bfe4d-e366-48ab-8aaa-515205150444 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:13.383234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bfe4d-e366-48ab-8aaa-515205150444 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:13.385913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-2aa7678b-4aa3-4b26-a699-2d87581d554f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:13.385913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:13.385913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:13.385913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:13.385913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:13.385913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:13.385913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:13.385913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:13.385913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:13.385913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:13.385913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:13.385913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:13.385913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:13.385913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:13.385913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:13.385913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:13.386848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:13.386848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:13.386848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:13.386848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:13.386848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:13.386848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:13.386848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:13.386848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:13.386848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:13.386848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:13.386848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:13.386848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:13.386848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:13.386848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:13.386848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:13.386848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:13.387689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:13.387689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:13.387689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:13.387689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:13.387689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:13.387689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:13.387689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:13.387689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:13.387689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:13.387689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:13.387689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:13.387689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:13.387689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 245/494] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:13.388374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7678b-4aa3-4b26-a699-2d87581d554f None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:13.402170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bfe4d-e366-48ab-8aaa-515205150444 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:13.403658 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bfe4d-e366-48ab-8aaa-515205150444 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:13.418138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-816bfe4d-e366-48ab-8aaa-515205150444 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:13.418138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:13.418138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:13.418138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:13.418138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:13.418138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:13.418138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:13.418138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:13.418138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:13.418138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:13.418138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:13.418138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:13.418138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:13.418138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:13.418138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:13.419193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:13.419193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:13.419193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:13.419193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:13.419193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:13.419193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:13.419193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:13.419193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:13.419193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:13.419193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:13.419193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:13.419193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:13.419193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:13.419193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:13.419193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:13.419193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:13.419193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:13.420094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:13.420094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:13.420094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:13.420094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:13.420094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 250/495] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:13.420909 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d6d07-df8d-4c8e-9535-6af634354882 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:13.421193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d6d07-df8d-4c8e-9535-6af634354882 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:13.421467 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d6d07-df8d-4c8e-9535-6af634354882 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:13.426376 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 251/496] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:13.426376 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d6d07-df8d-4c8e-9535-6af634354882 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:13.499779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7678b-4aa3-4b26-a699-2d87581d554f None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:13.501272 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:13.534721 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d6d07-df8d-4c8e-9535-6af634354882 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:13.535610 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcdc45-4d1a-4d7f-9f02-7debb0b23ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:13.536228 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcdc45-4d1a-4d7f-9f02-7debb0b23ada None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:13.536510 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcdc45-4d1a-4d7f-9f02-7debb0b23ada None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:13.536789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcdc45-4d1a-4d7f-9f02-7debb0b23ada None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:13.537576 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fcdc45-4d1a-4d7f-9f02-7debb0b23ada None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:13.537881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fcdc45-4d1a-4d7f-9f02-7debb0b23ada None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:13.539341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fcdc45-4d1a-4d7f-9f02-7debb0b23ada None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:13.572607 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dec11b-0317-4bc1-94dc-ba7cb173fbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:13.573533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dec11b-0317-4bc1-94dc-ba7cb173fbca None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:13.574000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dec11b-0317-4bc1-94dc-ba7cb173fbca None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:13.574285 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dec11b-0317-4bc1-94dc-ba7cb173fbca None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:13.575554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dec11b-0317-4bc1-94dc-ba7cb173fbca None admin] RBAC: Adding query filter params (name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:13.575867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dec11b-0317-4bc1-94dc-ba7cb173fbca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:13.577518 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dec11b-0317-4bc1-94dc-ba7cb173fbca None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:13.578996 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:13.580997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 246/497] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Jul 27 22:36:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:13.581978 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcdc45-4d1a-4d7f-9f02-7debb0b23ada None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:13.595738 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 252/498] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:36:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:13.595738 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a819a-34fb-4399-89a5-9cb44c33b039 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:13.595738 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a819a-34fb-4399-89a5-9cb44c33b039 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:13.595738 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924a819a-34fb-4399-89a5-9cb44c33b039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:13.614455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-924a819a-34fb-4399-89a5-9cb44c33b039 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:13.615647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-924a819a-34fb-4399-89a5-9cb44c33b039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:13.686208 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fcdc45-4d1a-4d7f-9f02-7debb0b23ada None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:13.686667 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 253/499] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:13.687514 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a819a-34fb-4399-89a5-9cb44c33b039 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:13.723904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8dc6c-1f79-411c-b0bc-a12a1586896c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:13.724801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8dc6c-1f79-411c-b0bc-a12a1586896c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:13.725279 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8dc6c-1f79-411c-b0bc-a12a1586896c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:13.725690 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab8dc6c-1f79-411c-b0bc-a12a1586896c None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:13.726549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8dc6c-1f79-411c-b0bc-a12a1586896c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:13.727005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8dc6c-1f79-411c-b0bc-a12a1586896c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:13.729033 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab8dc6c-1f79-411c-b0bc-a12a1586896c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:13.741025 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 247/500] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:13.741994 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8dc6c-1f79-411c-b0bc-a12a1586896c None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:13.768198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:13.800912 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924a819a-34fb-4399-89a5-9cb44c33b039 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:13.828094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:13.838157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa409274-3a80-471d-8eae-c4d63682a369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:13.838810 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa409274-3a80-471d-8eae-c4d63682a369 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:13.839092 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa409274-3a80-471d-8eae-c4d63682a369 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:13.839366 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa409274-3a80-471d-8eae-c4d63682a369 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:13.852056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab8dc6c-1f79-411c-b0bc-a12a1586896c None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:13.885153 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c5967-b7dc-446f-8f11-702fbdd9c67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:13.885789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c5967-b7dc-446f-8f11-702fbdd9c67a None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:13.886072 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c5967-b7dc-446f-8f11-702fbdd9c67a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:13.886360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c5967-b7dc-446f-8f11-702fbdd9c67a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:13.897916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c5967-b7dc-446f-8f11-702fbdd9c67a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:13.899437 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c5967-b7dc-446f-8f11-702fbdd9c67a None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:13.905226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa409274-3a80-471d-8eae-c4d63682a369 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:13.906684 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa409274-3a80-471d-8eae-c4d63682a369 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:13.913312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-938c5967-b7dc-446f-8f11-702fbdd9c67a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:13.913312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:13.913312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:13.913312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:13.913312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:13.913312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:13.913312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:13.913312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:13.913312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:13.913312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:13.913312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:13.913312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:13.913312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:13.913312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:13.913312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:13.914232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:13.914232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:13.914232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:13.914232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:13.914232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:13.914232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:13.914232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:13.914232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:13.914232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:13.914232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:13.914232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:13.914232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:13.914232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:13.914232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:13.914232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:13.914232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:13.914232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:13.915677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:13.915677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:13.915677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:13.915677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:13.915677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 248/501] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:13.915954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c5967-b7dc-446f-8f11-702fbdd9c67a None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:13.986996 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:14.005562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 254/502] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:36:14.006449 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa409274-3a80-471d-8eae-c4d63682a369 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:14.018281 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c5967-b7dc-446f-8f11-702fbdd9c67a None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:14.032385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:14.052140 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a90cea-b5f8-41c3-a004-40639b3602c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:14.052776 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a90cea-b5f8-41c3-a004-40639b3602c5 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:14.053055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a90cea-b5f8-41c3-a004-40639b3602c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:14.053330 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a90cea-b5f8-41c3-a004-40639b3602c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:14.065074 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a90cea-b5f8-41c3-a004-40639b3602c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:14.066545 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a90cea-b5f8-41c3-a004-40639b3602c5 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:14.080693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-43a90cea-b5f8-41c3-a004-40639b3602c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:14.080693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:14.080693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:14.080693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:14.080693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:14.080693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:14.080693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:14.080693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:14.080693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:14.080693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:14.080693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:14.080693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:14.080693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:14.080693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:14.080693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:14.081639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:14.081639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:14.081639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:14.081639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:14.081639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:14.081639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:14.081639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:14.081639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:14.081639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:14.081639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:14.081639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:14.081639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:14.081639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:14.081639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:14.081639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:14.081639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:14.081639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:14.082946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:14.082946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:14.082946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:14.082946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:14.082946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 249/503] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:14.083224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be84eaa-30c4-4ad7-9630-e8b2eb2f3546 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:14.083457 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be84eaa-30c4-4ad7-9630-e8b2eb2f3546 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:14.083689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be84eaa-30c4-4ad7-9630-e8b2eb2f3546 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:14.084923 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 250/504] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:14.085611 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be84eaa-30c4-4ad7-9630-e8b2eb2f3546 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:14.111470 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa409274-3a80-471d-8eae-c4d63682a369 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:14.143461 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f5d89-9ce1-4f0b-8fca-67a63ea33859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:14.144031 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f5d89-9ce1-4f0b-8fca-67a63ea33859 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:14.144320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f5d89-9ce1-4f0b-8fca-67a63ea33859 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:14.144582 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f5d89-9ce1-4f0b-8fca-67a63ea33859 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:14.151816 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f5d89-9ce1-4f0b-8fca-67a63ea33859 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:14.153243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f5d89-9ce1-4f0b-8fca-67a63ea33859 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:14.164468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-9d4f5d89-9ce1-4f0b-8fca-67a63ea33859 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 22:36:14.164468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:14.164468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:14.164468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:14.164468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:14.164468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:14.164468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:14.164468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:14.164468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:14.164468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:14.164468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:14.164468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:14.164468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:14.164468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:14.164468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:14.164468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:14.166171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:14.166171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:14.166171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:14.166171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:14.166171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:14.166171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:14.166171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:14.166171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:14.166171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:14.166171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:14.166171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:14.166171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:14.166171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:14.166171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:14.166171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:14.166171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:14.166171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:14.166171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:14.167385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:14.167385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:14.167385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:14.167385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:14.167385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:14.167385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:14.167385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:14.167385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:14.167385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 22:36:14.167385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:14.167385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 255/505] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:36:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:14.167385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f5d89-9ce1-4f0b-8fca-67a63ea33859 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:14.188442 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be84eaa-30c4-4ad7-9630-e8b2eb2f3546 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:14.211253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:14.222967 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71171c88-a298-4e6e-a148-8ad7dcba9d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:14.223581 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71171c88-a298-4e6e-a148-8ad7dcba9d6e None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:14.223866 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71171c88-a298-4e6e-a148-8ad7dcba9d6e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:14.224142 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71171c88-a298-4e6e-a148-8ad7dcba9d6e None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:14.224826 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71171c88-a298-4e6e-a148-8ad7dcba9d6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:14.225134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71171c88-a298-4e6e-a148-8ad7dcba9d6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:14.226650 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71171c88-a298-4e6e-a148-8ad7dcba9d6e None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:14.238674 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 251/506] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:14.239387 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71171c88-a298-4e6e-a148-8ad7dcba9d6e None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:14.259527 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:14.276005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f5d89-9ce1-4f0b-8fca-67a63ea33859 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:14.310985 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee2c2d-eb7b-4e1c-8819-da5971cec138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:14.311626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee2c2d-eb7b-4e1c-8819-da5971cec138 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:14.311915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee2c2d-eb7b-4e1c-8819-da5971cec138 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:14.312193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee2c2d-eb7b-4e1c-8819-da5971cec138 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:14.323245 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee2c2d-eb7b-4e1c-8819-da5971cec138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:14.324702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee2c2d-eb7b-4e1c-8819-da5971cec138 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:14.334863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71171c88-a298-4e6e-a148-8ad7dcba9d6e None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:14.339820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-f3ee2c2d-eb7b-4e1c-8819-da5971cec138 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:14.339820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:14.339820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:14.339820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:14.339820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:14.339820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:14.339820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:14.339820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:14.339820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:14.339820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:14.339820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:14.339820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:14.339820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:14.339820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:14.339820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:14.340685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:14.340685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:14.340685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:14.340685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:14.340685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:14.340685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:14.340685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:14.340685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:14.340685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:14.340685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:14.340685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:14.340685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:14.340685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:14.340685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:14.340685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:14.340685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:14.340685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:14.341535 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:14.341535 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:14.341535 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:14.341535 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:14.341535 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 256/507] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:14.342076 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945417b8-0621-4173-a7ab-d82ec3aefe9d None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:14.342387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945417b8-0621-4173-a7ab-d82ec3aefe9d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:14.342672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945417b8-0621-4173-a7ab-d82ec3aefe9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:14.363874 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-945417b8-0621-4173-a7ab-d82ec3aefe9d None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:14.365083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-945417b8-0621-4173-a7ab-d82ec3aefe9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:14.372802 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c9066-bea7-4c3c-9a73-d866ef9b011e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:14.373418 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c9066-bea7-4c3c-9a73-d866ef9b011e None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:14.373703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c9066-bea7-4c3c-9a73-d866ef9b011e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:14.373982 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c9066-bea7-4c3c-9a73-d866ef9b011e None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:14.374706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c9066-bea7-4c3c-9a73-d866ef9b011e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:14.375014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c9066-bea7-4c3c-9a73-d866ef9b011e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:14.376382 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c9066-bea7-4c3c-9a73-d866ef9b011e None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:14.387919 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 252/508] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:14.388738 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c9066-bea7-4c3c-9a73-d866ef9b011e None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:14.438624 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:14.445732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 257/509] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:14.447280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945417b8-0621-4173-a7ab-d82ec3aefe9d None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:14.502975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c9066-bea7-4c3c-9a73-d866ef9b011e None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:14.514267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:14.536923 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f0651-f92b-43ca-93e7-93492bbcb372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:14.537548 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f0651-f92b-43ca-93e7-93492bbcb372 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:14.537828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f0651-f92b-43ca-93e7-93492bbcb372 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:14.538105 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f0651-f92b-43ca-93e7-93492bbcb372 None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:14.538938 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f0651-f92b-43ca-93e7-93492bbcb372 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:14.539253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f0651-f92b-43ca-93e7-93492bbcb372 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:14.540730 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f0651-f92b-43ca-93e7-93492bbcb372 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:14.549044 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945417b8-0621-4173-a7ab-d82ec3aefe9d None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:14.557304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 253/510] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Jul 27 22:36:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:14.558091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f0651-f92b-43ca-93e7-93492bbcb372 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:14.588397 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07541c9-d723-45b0-a7da-dbc61a7a89ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:14.589047 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07541c9-d723-45b0-a7da-dbc61a7a89ca None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:14.589335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07541c9-d723-45b0-a7da-dbc61a7a89ca None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:14.589614 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07541c9-d723-45b0-a7da-dbc61a7a89ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:14.596567 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07541c9-d723-45b0-a7da-dbc61a7a89ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:14.598014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07541c9-d723-45b0-a7da-dbc61a7a89ca None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:14.610525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-e07541c9-d723-45b0-a7da-dbc61a7a89ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 22:36:14.610525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:14.610525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:14.610525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:14.610525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:14.610525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:14.610525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:14.610525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:14.610525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:14.610525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:14.610525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:14.610525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:14.610525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:14.610525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:14.610525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:14.610525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:14.611466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:14.611466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:14.611466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:14.611466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:14.611466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:14.611466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:14.611466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:14.611466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:14.611466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:14.611466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:14.611466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:14.611466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:14.611466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:14.611466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:14.611466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:14.611466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:14.611466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:14.611466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:14.613156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:14.613156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:14.613156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:14.613156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:14.613156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:14.613156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:14.613156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:14.613156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:14.613156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 22:36:14.613156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:14.613156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 258/511] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jul 27 22:36:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:14.613156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07541c9-d723-45b0-a7da-dbc61a7a89ca None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:14.660709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f0651-f92b-43ca-93e7-93492bbcb372 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:14.663017 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:14.694361 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba148dc3-544d-49eb-97de-a42c4b27dca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:14.694904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba148dc3-544d-49eb-97de-a42c4b27dca6 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:14.695186 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba148dc3-544d-49eb-97de-a42c4b27dca6 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:14.695460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba148dc3-544d-49eb-97de-a42c4b27dca6 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:14.696656 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba148dc3-544d-49eb-97de-a42c4b27dca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:14.696959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba148dc3-544d-49eb-97de-a42c4b27dca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:14.698316 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba148dc3-544d-49eb-97de-a42c4b27dca6 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:14.709942 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 254/512] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:14.710692 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba148dc3-544d-49eb-97de-a42c4b27dca6 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:14.712873 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07541c9-d723-45b0-a7da-dbc61a7a89ca None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:14.739137 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:14.747837 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7135a-eaa9-41c3-84e7-3115e958b780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:14.748459 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7135a-eaa9-41c3-84e7-3115e958b780 None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:14.748743 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7135a-eaa9-41c3-84e7-3115e958b780 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:14.749020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7135a-eaa9-41c3-84e7-3115e958b780 None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:14.749701 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7135a-eaa9-41c3-84e7-3115e958b780 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:14.751186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf7135a-eaa9-41c3-84e7-3115e958b780 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:14.777239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 259/513] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 22:36:14 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:36:14.777239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7135a-eaa9-41c3-84e7-3115e958b780 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:14.829091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba148dc3-544d-49eb-97de-a42c4b27dca6 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:14.865639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1279ac-40da-4029-83ac-500d7fc650c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:14.866303 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1279ac-40da-4029-83ac-500d7fc650c6 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:14.866653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1279ac-40da-4029-83ac-500d7fc650c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:14.866938 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1279ac-40da-4029-83ac-500d7fc650c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:14.878963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1279ac-40da-4029-83ac-500d7fc650c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:14.885268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-6b1279ac-40da-4029-83ac-500d7fc650c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:14.885268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:14.885268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:14.885268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:14.885268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:14.885268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:14.885268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:14.885268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:14.885268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:14.885268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:14.885268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:14.885268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:14.885268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:14.885268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:14.885268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:14.885268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:14.886233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:14.886233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:14.886233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:14.886233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:14.886233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:14.886233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:14.886233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:14.886233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:14.886233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:14.886233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:14.886233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:14.886233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:14.886233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:14.886233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:14.886233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:14.886233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:14.887443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:14.887443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:14.887443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:14.887443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:14.887443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:14.887443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:14.887443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:14.887443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:14.887443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:14.887443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:14.887443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:14.887443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:14.887443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 255/514] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:14.887443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1279ac-40da-4029-83ac-500d7fc650c6 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:14.897863 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7135a-eaa9-41c3-84e7-3115e958b780 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:14.914421 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:14.941221 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bc275-4aac-4645-8fa3-061589611be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:14.942269 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bc275-4aac-4645-8fa3-061589611be9 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:14.942629 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bc275-4aac-4645-8fa3-061589611be9 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:14.942918 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bc275-4aac-4645-8fa3-061589611be9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:15.001954 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:15.014788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1279ac-40da-4029-83ac-500d7fc650c6 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:15.018872 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bc275-4aac-4645-8fa3-061589611be9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:15.020326 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bc275-4aac-4645-8fa3-061589611be9 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:15.050122 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea9789-c458-418a-90d9-38d09f14bf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:15.050834 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea9789-c458-418a-90d9-38d09f14bf50 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:15.051084 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea9789-c458-418a-90d9-38d09f14bf50 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:15.051364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ea9789-c458-418a-90d9-38d09f14bf50 None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:15.052164 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea9789-c458-418a-90d9-38d09f14bf50 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:15.052626 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea9789-c458-418a-90d9-38d09f14bf50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:15.053917 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ea9789-c458-418a-90d9-38d09f14bf50 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:15.080380 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 256/515] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jul 27 22:36:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:15.081620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea9789-c458-418a-90d9-38d09f14bf50 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:15.145134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 260/516] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:36:15.146208 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bc275-4aac-4645-8fa3-061589611be9 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:15.164221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:15.188043 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ea9789-c458-418a-90d9-38d09f14bf50 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:15.224685 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa041de5-9db5-4cec-8ee1-88ade67127c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:15.225436 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa041de5-9db5-4cec-8ee1-88ade67127c4 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:15.225623 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa041de5-9db5-4cec-8ee1-88ade67127c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:15.225890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa041de5-9db5-4cec-8ee1-88ade67127c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:15.233379 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa041de5-9db5-4cec-8ee1-88ade67127c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:15.234888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa041de5-9db5-4cec-8ee1-88ade67127c4 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:15.237716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:15.248237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-fa041de5-9db5-4cec-8ee1-88ade67127c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:15.248237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:15.248237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:15.248237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:15.248237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:15.248237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:15.248237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:15.248237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:15.248237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:15.248237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:15.248237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:15.248237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:15.248237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:15.248237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:15.248237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:15.249129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:15.249129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:15.249129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:15.249129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:15.249129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:15.249129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:15.249129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:15.249129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:15.249129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:15.249129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:15.249129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:15.249129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:15.249129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:15.249129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:15.249129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:15.249129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:15.249129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:15.250013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:15.250013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:15.250013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:15.250013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:15.250013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:15.250013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:15.250013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:15.250013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:15.250013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 257/517] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:15.250531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa041de5-9db5-4cec-8ee1-88ade67127c4 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:15.260023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bc275-4aac-4645-8fa3-061589611be9 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:15.297107 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e13de-c3af-4f5e-ad26-7526159ca6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:15.297727 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e13de-c3af-4f5e-ad26-7526159ca6c7 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:15.298025 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e13de-c3af-4f5e-ad26-7526159ca6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:15.298444 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3e13de-c3af-4f5e-ad26-7526159ca6c7 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:15.299163 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e13de-c3af-4f5e-ad26-7526159ca6c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:15.299472 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e13de-c3af-4f5e-ad26-7526159ca6c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:15.300990 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3e13de-c3af-4f5e-ad26-7526159ca6c7 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:15.314713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 261/518] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:36:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:15.314713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e13de-c3af-4f5e-ad26-7526159ca6c7 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:15.373518 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa041de5-9db5-4cec-8ee1-88ade67127c4 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:15.415848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc299e-23f9-4569-b399-ad44f4bb8b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:15.416321 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc299e-23f9-4569-b399-ad44f4bb8b9a None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:15.416564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc299e-23f9-4569-b399-ad44f4bb8b9a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:15.416801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdc299e-23f9-4569-b399-ad44f4bb8b9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:15.417036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3e13de-c3af-4f5e-ad26-7526159ca6c7 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:15.433761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:15.455964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b045cd-70e3-47a6-8887-898d7480d8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:15.456713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b045cd-70e3-47a6-8887-898d7480d8ed None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:15.457063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b045cd-70e3-47a6-8887-898d7480d8ed None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:15.457345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b045cd-70e3-47a6-8887-898d7480d8ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:15.469127 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b045cd-70e3-47a6-8887-898d7480d8ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:15.470595 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b045cd-70e3-47a6-8887-898d7480d8ed None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:15.478022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:15.488039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-b9b045cd-70e3-47a6-8887-898d7480d8ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:15.488039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:15.488039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:15.488039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:15.488039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:15.488039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:15.488039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:15.488039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:15.488039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:15.488039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:15.488039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:15.488039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:15.488039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:15.488039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:15.488039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:15.489066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:15.489066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:15.489066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:15.489066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:15.489066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:15.489066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:15.489066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:15.489066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:15.489066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:15.489066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:15.489066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:15.489066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:15.489066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:15.489066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:15.489066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:15.489066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:15.489066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:15.490077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:15.490077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:15.490077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:15.490077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:15.490077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 262/519] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:15.490565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b045cd-70e3-47a6-8887-898d7480d8ed None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:15.509869 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc299e-23f9-4569-b399-ad44f4bb8b9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:15.511538 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdc299e-23f9-4569-b399-ad44f4bb8b9a None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:15.606801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b045cd-70e3-47a6-8887-898d7480d8ed None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:15.617955 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 258/520] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:36:15.618822 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc299e-23f9-4569-b399-ad44f4bb8b9a None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:15.647510 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10fef5-3fff-44bf-934c-a1f46aee120d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:15.648328 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10fef5-3fff-44bf-934c-a1f46aee120d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:15.648786 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10fef5-3fff-44bf-934c-a1f46aee120d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:15.649838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a10fef5-3fff-44bf-934c-a1f46aee120d None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:15.650878 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10fef5-3fff-44bf-934c-a1f46aee120d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:15.651339 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10fef5-3fff-44bf-934c-a1f46aee120d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:15.652911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a10fef5-3fff-44bf-934c-a1f46aee120d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:15.660810 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:15.672887 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 263/521] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:15.673976 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10fef5-3fff-44bf-934c-a1f46aee120d None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:15.724425 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdc299e-23f9-4569-b399-ad44f4bb8b9a None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:15.745132 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:15.773001 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53435c9-3ab5-4f19-9422-53f733559290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:15.773568 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53435c9-3ab5-4f19-9422-53f733559290 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:15.773853 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53435c9-3ab5-4f19-9422-53f733559290 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:15.774152 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53435c9-3ab5-4f19-9422-53f733559290 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:15.785617 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53435c9-3ab5-4f19-9422-53f733559290 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:15.787126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53435c9-3ab5-4f19-9422-53f733559290 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:15.803509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-b53435c9-3ab5-4f19-9422-53f733559290 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:15.803509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:15.803509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:15.803509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:15.803509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:15.803509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:15.803509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:15.803509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:15.803509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:15.803509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:15.803509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:15.803509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:15.803509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:15.803509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:15.803509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:15.804398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:15.804398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:15.804398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:15.804398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:15.804398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:15.804398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:15.804398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:15.804398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:15.804398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:15.804398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:15.804398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:15.804398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:15.804398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:15.804398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:15.804398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:15.804398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:15.804398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:15.805751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:15.805751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:15.805751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:15.805751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:15.805751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 259/522] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:15.806007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53435c9-3ab5-4f19-9422-53f733559290 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:15.811719 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a10fef5-3fff-44bf-934c-a1f46aee120d None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:15.850433 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57631d66-873b-43a2-b99e-f9163a144bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:15.851059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57631d66-873b-43a2-b99e-f9163a144bf3 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:15.851347 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57631d66-873b-43a2-b99e-f9163a144bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:15.851629 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57631d66-873b-43a2-b99e-f9163a144bf3 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:15.852344 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57631d66-873b-43a2-b99e-f9163a144bf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:15.852656 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57631d66-873b-43a2-b99e-f9163a144bf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:15.854040 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57631d66-873b-43a2-b99e-f9163a144bf3 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:15.870082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 264/523] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:15.870082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57631d66-873b-43a2-b99e-f9163a144bf3 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:15.907798 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:15.917367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53435c9-3ab5-4f19-9422-53f733559290 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:15.953685 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a160e-78a8-433b-89ec-9c34e0be5c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:15.954362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a160e-78a8-433b-89ec-9c34e0be5c50 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:15.954654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a160e-78a8-433b-89ec-9c34e0be5c50 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:15.954934 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a160e-78a8-433b-89ec-9c34e0be5c50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:15.965675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a160e-78a8-433b-89ec-9c34e0be5c50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:15.967165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a160e-78a8-433b-89ec-9c34e0be5c50 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:15.980435 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57631d66-873b-43a2-b99e-f9163a144bf3 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:15.982111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-071a160e-78a8-433b-89ec-9c34e0be5c50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:15.982111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:15.982111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:15.982111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:15.982111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:15.982111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:15.982111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:15.982111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:15.982111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:15.982111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:15.982111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:15.982111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:15.982111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:15.982111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:15.982111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:15.983134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:15.983134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:15.983134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:15.983134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:15.983134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:15.983134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:15.983134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:15.983134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:15.983134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:15.983134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:15.983134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:15.983134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:15.983134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:15.983134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:15.983134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:15.983134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:15.983134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:15.984149 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:15.984149 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:15.984149 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:15.984149 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:15.984149 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 260/524] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:15.984149 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a160e-78a8-433b-89ec-9c34e0be5c50 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:16.004378 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:16.022739 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25dfd7-e880-4d3a-ba6d-4917f1075b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:16.023410 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25dfd7-e880-4d3a-ba6d-4917f1075b7b None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:16.023754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25dfd7-e880-4d3a-ba6d-4917f1075b7b None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:16.024073 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e25dfd7-e880-4d3a-ba6d-4917f1075b7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:16.024855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25dfd7-e880-4d3a-ba6d-4917f1075b7b None admin] RBAC: Adding query filter params (role.id=7b21a72e7f9348d28d60c78cb0853af7, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=b26c60d08b9f47aca8404e4173290908) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:16.025165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25dfd7-e880-4d3a-ba6d-4917f1075b7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:16.026743 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e25dfd7-e880-4d3a-ba6d-4917f1075b7b None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:16.041092 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 265/525] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:36:15 2022] GET /identity/v3/role_assignments?user.id=b26c60d08b9f47aca8404e4173290908&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=7b21a72e7f9348d28d60c78cb0853af7 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:16.041092 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25dfd7-e880-4d3a-ba6d-4917f1075b7b None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:16.119185 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a160e-78a8-433b-89ec-9c34e0be5c50 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:16.160413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218117e-bda9-4f1a-9357-e19f42ddf71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:16.161230 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218117e-bda9-4f1a-9357-e19f42ddf71c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:16.161620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218117e-bda9-4f1a-9357-e19f42ddf71c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:16.162040 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218117e-bda9-4f1a-9357-e19f42ddf71c None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:16.162935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218117e-bda9-4f1a-9357-e19f42ddf71c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:16.163354 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218117e-bda9-4f1a-9357-e19f42ddf71c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:16.165561 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218117e-bda9-4f1a-9357-e19f42ddf71c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:16.175588 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e25dfd7-e880-4d3a-ba6d-4917f1075b7b None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:16.184802 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 261/526] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:16.184802 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218117e-bda9-4f1a-9357-e19f42ddf71c None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:16.191912 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:16.231525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe7be2-2cf4-4787-9709-bcd9831361d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:16.233266 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe7be2-2cf4-4787-9709-bcd9831361d8 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:16.233653 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe7be2-2cf4-4787-9709-bcd9831361d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:16.234030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe7be2-2cf4-4787-9709-bcd9831361d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:16.243558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe7be2-2cf4-4787-9709-bcd9831361d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:16.245912 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe7be2-2cf4-4787-9709-bcd9831361d8 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:16.262924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-ffbe7be2-2cf4-4787-9709-bcd9831361d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:16.262924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:16.262924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:16.262924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:16.262924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:16.262924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:16.262924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:16.262924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:16.262924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:16.262924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:16.262924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:16.262924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:16.262924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:16.262924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:16.262924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:16.263969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:16.263969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:16.263969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:16.263969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:16.263969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:16.263969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:16.263969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:16.263969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:16.263969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:16.263969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:16.263969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:16.263969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:16.263969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:16.263969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:16.263969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:16.263969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:16.263969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:16.264821 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:16.264821 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:16.264821 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:16.264821 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:16.264821 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:16.264821 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:16.264821 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:16.264821 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:16.264821 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 266/527] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:16.266210 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe7be2-2cf4-4787-9709-bcd9831361d8 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:16.307598 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218117e-bda9-4f1a-9357-e19f42ddf71c None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:16.323698 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:16.356550 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31862908-2c0c-4393-b3cf-4b4d4d098fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:16.357291 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31862908-2c0c-4393-b3cf-4b4d4d098fb3 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:16.357643 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31862908-2c0c-4393-b3cf-4b4d4d098fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:16.357998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31862908-2c0c-4393-b3cf-4b4d4d098fb3 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:16.358798 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31862908-2c0c-4393-b3cf-4b4d4d098fb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:16.359690 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31862908-2c0c-4393-b3cf-4b4d4d098fb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:16.361158 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31862908-2c0c-4393-b3cf-4b4d4d098fb3 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:16.379169 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 262/528] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:16.381076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31862908-2c0c-4393-b3cf-4b4d4d098fb3 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:16.386304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe7be2-2cf4-4787-9709-bcd9831361d8 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:16.425077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e42775-e4f9-4073-a466-bfae2d6e2082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:16.426459 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e42775-e4f9-4073-a466-bfae2d6e2082 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:16.427081 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e42775-e4f9-4073-a466-bfae2d6e2082 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:16.427684 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e42775-e4f9-4073-a466-bfae2d6e2082 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:16.437619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e42775-e4f9-4073-a466-bfae2d6e2082 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:16.438834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e42775-e4f9-4073-a466-bfae2d6e2082 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:16.452402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-b9e42775-e4f9-4073-a466-bfae2d6e2082 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 22:36:16.452402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:16.452402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:16.452402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:16.452402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:16.452402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:16.452402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:16.452402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:16.452402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:16.452402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:16.452402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:16.452402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:16.452402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:16.452402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:16.452402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:16.452402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:16.454387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:16.454387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:16.454387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:16.454387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:16.454387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:16.454387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:16.454387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:16.454387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:16.454387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:16.454387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:16.454387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:16.454387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:16.454387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:16.454387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:16.454387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:16.454387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:16.454387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:16.454387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:16.456340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:16.456340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:16.456340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:16.456340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:16.456340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:16.456340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:16.456340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:16.456340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:16.456340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 22:36:16.456340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:16.456340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 267/529] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:16.457526 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e42775-e4f9-4073-a466-bfae2d6e2082 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:16.476946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:16.518190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31862908-2c0c-4393-b3cf-4b4d4d098fb3 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:16.562417 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da85066-be3b-46cc-9008-0ab1add92b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:16.563257 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da85066-be3b-46cc-9008-0ab1add92b19 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:16.563667 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da85066-be3b-46cc-9008-0ab1add92b19 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:16.564093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da85066-be3b-46cc-9008-0ab1add92b19 None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:16.564856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da85066-be3b-46cc-9008-0ab1add92b19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:16.565321 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da85066-be3b-46cc-9008-0ab1add92b19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:16.567405 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da85066-be3b-46cc-9008-0ab1add92b19 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:16.568766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e42775-e4f9-4073-a466-bfae2d6e2082 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:16.570327 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:16.590388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 263/530] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:16.591440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da85066-be3b-46cc-9008-0ab1add92b19 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:16.613127 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1213588-ef70-4a2b-a063-a863b0cdf20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:16.613848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1213588-ef70-4a2b-a063-a863b0cdf20a None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:16.614201 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1213588-ef70-4a2b-a063-a863b0cdf20a None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:16.614659 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1213588-ef70-4a2b-a063-a863b0cdf20a None admin] PATH_INFO: `/v3/projects/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:16.622090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1213588-ef70-4a2b-a063-a863b0cdf20a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:16.624087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1213588-ef70-4a2b-a063-a863b0cdf20a None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:16.635903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-a1213588-ef70-4a2b-a063-a863b0cdf20a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:16.635903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:16.635903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:16.635903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:16.635903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:16.635903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:16.635903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:16.635903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:16.635903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:16.635903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:16.635903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:16.635903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:16.635903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:16.635903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:16.635903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:16.636804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:16.636804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:16.636804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:16.636804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:16.636804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:16.636804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:16.636804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:16.636804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:16.636804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:16.636804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:16.636804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:16.636804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:16.636804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:16.636804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:16.636804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:16.636804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:16.636804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:16.637661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:16.637661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:16.637661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:16.637661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:16.637661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:16.637661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:16.637661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:16.637661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:16.637661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 268/531] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:16.638798 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1213588-ef70-4a2b-a063-a863b0cdf20a None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:16.715586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da85066-be3b-46cc-9008-0ab1add92b19 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:16.745975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:16.747478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1213588-ef70-4a2b-a063-a863b0cdf20a None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:16.760086 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb84dc-796b-4dd5-b79d-4597d75b4542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:16.761255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb84dc-796b-4dd5-b79d-4597d75b4542 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:16.761749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb84dc-796b-4dd5-b79d-4597d75b4542 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:16.762229 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb84dc-796b-4dd5-b79d-4597d75b4542 None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:16.763394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb84dc-796b-4dd5-b79d-4597d75b4542 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:16.764233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb84dc-796b-4dd5-b79d-4597d75b4542 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:16.766372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb84dc-796b-4dd5-b79d-4597d75b4542 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:16.788066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24b48f-08c4-4239-b3eb-f52b3c705f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:16.788772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24b48f-08c4-4239-b3eb-f52b3c705f48 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:16.789124 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24b48f-08c4-4239-b3eb-f52b3c705f48 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:16.789468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24b48f-08c4-4239-b3eb-f52b3c705f48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:16.790579 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24b48f-08c4-4239-b3eb-f52b3c705f48 None admin] RBAC: Adding query filter params (role.id=7b21a72e7f9348d28d60c78cb0853af7, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=9ac8dcdbe57646f79593e7f39dc60900) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:16.790957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24b48f-08c4-4239-b3eb-f52b3c705f48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:16.791160 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 264/532] 10.222.0.48 () {56 vars in 1139 bytes} [Wed Jul 27 22:36:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:16.792165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb84dc-796b-4dd5-b79d-4597d75b4542 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:16.792577 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24b48f-08c4-4239-b3eb-f52b3c705f48 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:16.799441 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 269/533] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:36:16 2022] GET /identity/v3/role_assignments?user.id=9ac8dcdbe57646f79593e7f39dc60900&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=7b21a72e7f9348d28d60c78cb0853af7 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:16.807965 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24b48f-08c4-4239-b3eb-f52b3c705f48 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:16.855040 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:16.926167 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb84dc-796b-4dd5-b79d-4597d75b4542 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:16.947535 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24b48f-08c4-4239-b3eb-f52b3c705f48 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:16.979098 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7dd71c-cf6a-4fa2-bef7-a2805db4699e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:16.979740 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dd71c-cf6a-4fa2-bef7-a2805db4699e None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:16.980176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dd71c-cf6a-4fa2-bef7-a2805db4699e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:16.980574 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7dd71c-cf6a-4fa2-bef7-a2805db4699e None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:16.981348 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7dd71c-cf6a-4fa2-bef7-a2805db4699e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:16.981905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7dd71c-cf6a-4fa2-bef7-a2805db4699e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:16.984079 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7dd71c-cf6a-4fa2-bef7-a2805db4699e None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:16.988648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e6db5-c26a-4cac-b7a4-e063e1280f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:16.989283 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e6db5-c26a-4cac-b7a4-e063e1280f56 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:16.989569 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e6db5-c26a-4cac-b7a4-e063e1280f56 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:16.989847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e6db5-c26a-4cac-b7a4-e063e1280f56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:16.998265 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 265/534] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:17.000727 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a0ad3-7435-45f6-b0c4-364a7a6786d2 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:17.001023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a0ad3-7435-45f6-b0c4-364a7a6786d2 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:17.001305 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a0ad3-7435-45f6-b0c4-364a7a6786d2 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:17.002559 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 266/535] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:17.007500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a0ad3-7435-45f6-b0c4-364a7a6786d2 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:17.063120 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:17.096578 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e6db5-c26a-4cac-b7a4-e063e1280f56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:17.098271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e6db5-c26a-4cac-b7a4-e063e1280f56 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:17.127029 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a0ad3-7435-45f6-b0c4-364a7a6786d2 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:17.132706 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:17.163200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d150cfc9-756d-4a80-bc36-b98a4787bcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:17.163969 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150cfc9-756d-4a80-bc36-b98a4787bcfb None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:17.164357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150cfc9-756d-4a80-bc36-b98a4787bcfb None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:17.164772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d150cfc9-756d-4a80-bc36-b98a4787bcfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:17.165682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150cfc9-756d-4a80-bc36-b98a4787bcfb None admin] RBAC: Adding query filter params (role.id=7b21a72e7f9348d28d60c78cb0853af7, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=c621601261e44ca8a7938862d6578639) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:17.166100 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150cfc9-756d-4a80-bc36-b98a4787bcfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:17.167673 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d150cfc9-756d-4a80-bc36-b98a4787bcfb None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:17.173673 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 267/536] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:36:17 2022] GET /identity/v3/role_assignments?user.id=c621601261e44ca8a7938862d6578639&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=7b21a72e7f9348d28d60c78cb0853af7 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:17.175027 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b503079-b543-4090-bd38-7aff1985f353 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:17.175395 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b503079-b543-4090-bd38-7aff1985f353 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:17.175775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b503079-b543-4090-bd38-7aff1985f353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:17.197812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-6b503079-b543-4090-bd38-7aff1985f353 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:17.200034 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6b503079-b543-4090-bd38-7aff1985f353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:17.233441 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 270/537] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:36:17.238823 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e6db5-c26a-4cac-b7a4-e063e1280f56 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:17.287649 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 268/538] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:17.323328 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b503079-b543-4090-bd38-7aff1985f353 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:17.374217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:17.384128 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e6db5-c26a-4cac-b7a4-e063e1280f56 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:17.408036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:17.417124 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc349e2c-7cab-4da3-acc3-98537c16ff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:17.417779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc349e2c-7cab-4da3-acc3-98537c16ff42 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:17.418065 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc349e2c-7cab-4da3-acc3-98537c16ff42 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:17.418365 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc349e2c-7cab-4da3-acc3-98537c16ff42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:17.444688 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b503079-b543-4090-bd38-7aff1985f353 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:17.447503 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc349e2c-7cab-4da3-acc3-98537c16ff42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:17.448999 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc349e2c-7cab-4da3-acc3-98537c16ff42 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:17.473945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-cc349e2c-7cab-4da3-acc3-98537c16ff42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:17.473945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:17.473945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:17.473945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:17.473945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:17.473945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:17.473945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:17.473945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:17.473945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:17.473945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:17.473945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:17.473945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:17.473945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:17.473945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:17.473945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:17.474857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:17.474857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:17.474857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:17.474857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:17.474857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:17.474857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:17.474857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:17.474857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:17.474857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:17.474857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:17.474857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:17.474857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:17.474857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:17.474857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:17.474857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:17.474857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:17.474857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:17.475714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:17.475714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:17.475714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:17.475714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:17.483019 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d7e31-c4c9-4f11-aff8-dbd9e30f51bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:17.483575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 271/539] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:17.484135 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d7e31-c4c9-4f11-aff8-dbd9e30f51bf None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:17.484734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d7e31-c4c9-4f11-aff8-dbd9e30f51bf None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:17.485209 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d7e31-c4c9-4f11-aff8-dbd9e30f51bf None admin] PATH_INFO: `/v3/roles/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:17.491313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc349e2c-7cab-4da3-acc3-98537c16ff42 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:17.496990 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d7e31-c4c9-4f11-aff8-dbd9e30f51bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:17.502440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-434d7e31-c4c9-4f11-aff8-dbd9e30f51bf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:17.502440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:17.502440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:17.502440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:17.502440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:17.502440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:17.502440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:17.502440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:17.502440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:17.502440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:17.502440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:17.502440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:17.502440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:17.502440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:17.502440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:17.502440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:17.503326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:17.503326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:17.503326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:17.503326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:17.503326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:17.503326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:17.503326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:17.503326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:17.503326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:17.503326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:17.503326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:17.503326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:17.503326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:17.503326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:17.503326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:17.503326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:17.504125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:17.504125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:17.504125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:17.504125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:17.504125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:17.504125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:17.504125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:17.504125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:17.504125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:17.504125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:17.504125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:17.504125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:17.506434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 269/540] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:17.519854 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d7e31-c4c9-4f11-aff8-dbd9e30f51bf None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:17.626682 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc349e2c-7cab-4da3-acc3-98537c16ff42 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:17.681126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:17.689684 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d7e31-c4c9-4f11-aff8-dbd9e30f51bf None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:17.693236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c73f37-7860-41c4-ac0e-6c149d1ad47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:17.693865 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c73f37-7860-41c4-ac0e-6c149d1ad47f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:17.694148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c73f37-7860-41c4-ac0e-6c149d1ad47f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:17.694455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c73f37-7860-41c4-ac0e-6c149d1ad47f None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:17.695157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c73f37-7860-41c4-ac0e-6c149d1ad47f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:17.695464 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c73f37-7860-41c4-ac0e-6c149d1ad47f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:17.696880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c73f37-7860-41c4-ac0e-6c149d1ad47f None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:17.720415 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 272/541] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:17.724949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c73f37-7860-41c4-ac0e-6c149d1ad47f None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:17.753911 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fef490-1b01-4cd3-8179-eb57695abc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:17.754564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fef490-1b01-4cd3-8179-eb57695abc29 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:17.754842 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fef490-1b01-4cd3-8179-eb57695abc29 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:17.755122 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fef490-1b01-4cd3-8179-eb57695abc29 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:17.756120 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fef490-1b01-4cd3-8179-eb57695abc29 None admin] RBAC: Adding query filter params (name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:17.756429 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fef490-1b01-4cd3-8179-eb57695abc29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:17.758051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fef490-1b01-4cd3-8179-eb57695abc29 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:17.769801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 270/542] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:36:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:17.773143 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fef490-1b01-4cd3-8179-eb57695abc29 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:17.791064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:17.856995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c73f37-7860-41c4-ac0e-6c149d1ad47f None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:17.894748 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd64fd-ce2b-42da-87e2-1f42b9d666eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:17.895763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd64fd-ce2b-42da-87e2-1f42b9d666eb None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:17.896562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd64fd-ce2b-42da-87e2-1f42b9d666eb None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:17.897061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd64fd-ce2b-42da-87e2-1f42b9d666eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:17.905011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd64fd-ce2b-42da-87e2-1f42b9d666eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:17.906748 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd64fd-ce2b-42da-87e2-1f42b9d666eb None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:17.920761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-7acd64fd-ce2b-42da-87e2-1f42b9d666eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:17.920761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:17.920761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:17.920761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:17.920761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:17.920761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:17.920761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:17.920761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:17.920761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:17.920761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:17.920761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:17.920761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:17.920761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:17.920761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:17.920761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:17.921647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:17.921647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:17.921647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:17.921647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:17.921647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:17.921647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:17.921647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:17.921647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:17.921647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:17.921647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:17.921647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:17.921647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:17.921647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:17.921647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:17.921647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:17.921647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:17.921647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:17.923398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:17.923398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:17.923398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:17.923398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:17.923398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:17.923398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:17.923398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:17.923398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:17.925710 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 273/543] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:17.930996 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd64fd-ce2b-42da-87e2-1f42b9d666eb None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:18.025864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fef490-1b01-4cd3-8179-eb57695abc29 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:18.084143 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:18.089422 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e6a4c-1164-4761-a5f4-4d4a291f74fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:18.090427 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e6a4c-1164-4761-a5f4-4d4a291f74fe None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:18.090936 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e6a4c-1164-4761-a5f4-4d4a291f74fe None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:18.091493 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e6a4c-1164-4761-a5f4-4d4a291f74fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:18.092808 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd64fd-ce2b-42da-87e2-1f42b9d666eb None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:18.105441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e6a4c-1164-4761-a5f4-4d4a291f74fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:18.107308 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e6a4c-1164-4761-a5f4-4d4a291f74fe None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:18.128444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-986e6a4c-1164-4761-a5f4-4d4a291f74fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:18.128444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:18.128444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:18.128444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:18.128444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:18.128444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:18.128444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:18.128444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:18.128444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:18.128444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:18.128444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:18.128444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:18.128444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:18.128444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:18.128444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:18.129341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:18.129341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:18.129341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:18.129341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:18.129341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:18.129341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:18.129341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:18.129341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:18.129341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:18.129341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:18.129341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:18.129341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:18.129341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:18.129341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:18.129341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:18.129341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:18.129341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:18.130220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:18.130220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:18.130220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:18.130220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:18.137075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 271/544] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:18.138560 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e6a4c-1164-4761-a5f4-4d4a291f74fe None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:18.158755 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:18.247063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4c0a2-d3d0-414b-bcca-ca9804e00bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:18.247769 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4c0a2-d3d0-414b-bcca-ca9804e00bb3 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:18.247996 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4c0a2-d3d0-414b-bcca-ca9804e00bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:18.248281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4c0a2-d3d0-414b-bcca-ca9804e00bb3 None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:18.249055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4c0a2-d3d0-414b-bcca-ca9804e00bb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:18.249369 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4c0a2-d3d0-414b-bcca-ca9804e00bb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:18.250171 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e6a4c-1164-4761-a5f4-4d4a291f74fe None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:18.250857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4c0a2-d3d0-414b-bcca-ca9804e00bb3 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:18.288353 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c309a-650a-444c-a075-24a2f13e355a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:18.289225 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 274/545] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:18.289643 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c309a-650a-444c-a075-24a2f13e355a None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:18.290136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c309a-650a-444c-a075-24a2f13e355a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:18.290780 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c309a-650a-444c-a075-24a2f13e355a None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:18.291688 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c309a-650a-444c-a075-24a2f13e355a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:18.292246 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c309a-650a-444c-a075-24a2f13e355a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:18.293882 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59c309a-650a-444c-a075-24a2f13e355a None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:18.299335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4c0a2-d3d0-414b-bcca-ca9804e00bb3 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:18.312775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 272/546] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:18.314271 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c309a-650a-444c-a075-24a2f13e355a None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:18.392196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:18.428291 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c309a-650a-444c-a075-24a2f13e355a None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:18.467285 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4819c6ae-00ed-4e71-a2fe-77bf142a52af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:18.468321 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819c6ae-00ed-4e71-a2fe-77bf142a52af None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:18.468802 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819c6ae-00ed-4e71-a2fe-77bf142a52af None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:18.469273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4819c6ae-00ed-4e71-a2fe-77bf142a52af None admin] PATH_INFO: `/v3/users/swift` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:18.476650 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4c0a2-d3d0-414b-bcca-ca9804e00bb3 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:18.477943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819c6ae-00ed-4e71-a2fe-77bf142a52af None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:18.479640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4819c6ae-00ed-4e71-a2fe-77bf142a52af None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:18.493464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-4819c6ae-00ed-4e71-a2fe-77bf142a52af None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 22:36:18.493464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:18.493464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:18.493464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:18.493464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:18.493464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:18.493464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:18.493464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:18.493464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:18.493464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:18.493464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:18.493464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:18.493464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:18.493464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:18.493464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:18.493464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:18.494683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:18.494683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:18.494683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:18.494683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:18.494683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:18.494683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:18.494683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:18.494683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:18.494683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:18.494683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:18.494683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:18.494683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:18.494683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:18.494683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:18.494683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:18.494683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:18.494683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:18.494683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:18.496049 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:18.496049 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:18.496049 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:18.496049 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:18.496049 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:18.496049 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:18.496049 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:18.496049 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:18.496049 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 22:36:18.496049 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:18.502447 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 273/547] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:36:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:18.504060 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de8437-fc66-4177-80bf-29ca4e6a66f4 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:18.504548 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de8437-fc66-4177-80bf-29ca4e6a66f4 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:18.505032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de8437-fc66-4177-80bf-29ca4e6a66f4 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:18.507771 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 274/548] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:18.509314 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de8437-fc66-4177-80bf-29ca4e6a66f4 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:18.519486 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7f842-04d7-4629-a9fd-5fa8e64fee8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:18.520687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7f842-04d7-4629-a9fd-5fa8e64fee8a None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:18.520984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7f842-04d7-4629-a9fd-5fa8e64fee8a None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:18.521266 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7f842-04d7-4629-a9fd-5fa8e64fee8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:18.522068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7f842-04d7-4629-a9fd-5fa8e64fee8a None admin] RBAC: Adding query filter params (role.id=7b21a72e7f9348d28d60c78cb0853af7, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=c266721767004428b9b54dd200f3cd6b) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:18.522400 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7f842-04d7-4629-a9fd-5fa8e64fee8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:18.524929 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7f842-04d7-4629-a9fd-5fa8e64fee8a None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:18.538593 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 275/549] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:36:18 2022] GET /identity/v3/role_assignments?user.id=c266721767004428b9b54dd200f3cd6b&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=7b21a72e7f9348d28d60c78cb0853af7 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:18.541894 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7b876-5c38-4cd1-a36e-23d0a36a4c88 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:18.542549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7b876-5c38-4cd1-a36e-23d0a36a4c88 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:18.543238 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7b876-5c38-4cd1-a36e-23d0a36a4c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:18.588226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-bfa7b876-5c38-4cd1-a36e-23d0a36a4c88 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:18.593353 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-bfa7b876-5c38-4cd1-a36e-23d0a36a4c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:18.635743 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:18.721843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de8437-fc66-4177-80bf-29ca4e6a66f4 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:18.739499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 276/550] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:18.767117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:18.772800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7b876-5c38-4cd1-a36e-23d0a36a4c88 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:18.783202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98556512-c8ba-4e0e-a4dd-04803d8b14e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:18.783790 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98556512-c8ba-4e0e-a4dd-04803d8b14e6 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:18.784079 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98556512-c8ba-4e0e-a4dd-04803d8b14e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:18.784360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98556512-c8ba-4e0e-a4dd-04803d8b14e6 None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:18.785174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98556512-c8ba-4e0e-a4dd-04803d8b14e6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:18.785490 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98556512-c8ba-4e0e-a4dd-04803d8b14e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:18.787103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98556512-c8ba-4e0e-a4dd-04803d8b14e6 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:18.820359 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 275/551] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Jul 27 22:36:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:18.826743 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98556512-c8ba-4e0e-a4dd-04803d8b14e6 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:18.983494 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98556512-c8ba-4e0e-a4dd-04803d8b14e6 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:18.984268 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7b876-5c38-4cd1-a36e-23d0a36a4c88 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:19.030673 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309801b5-4773-4707-bcbf-196dda45179d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:19.031703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309801b5-4773-4707-bcbf-196dda45179d None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:19.032258 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309801b5-4773-4707-bcbf-196dda45179d None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:19.032737 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309801b5-4773-4707-bcbf-196dda45179d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:19.059562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f6c15-95da-4df6-8cdc-db2aef8fecf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:19.061160 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f6c15-95da-4df6-8cdc-db2aef8fecf0 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:19.061452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f6c15-95da-4df6-8cdc-db2aef8fecf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:19.061735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f6c15-95da-4df6-8cdc-db2aef8fecf0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:19.078152 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f6c15-95da-4df6-8cdc-db2aef8fecf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:19.085972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-838f6c15-95da-4df6-8cdc-db2aef8fecf0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:19.085972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:19.085972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:19.085972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:19.085972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:19.085972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:19.085972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:19.085972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:19.085972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:19.085972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:19.085972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:19.085972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:19.085972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:19.085972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:19.085972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:19.085972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:19.086978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:19.086978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:19.086978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:19.086978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:19.086978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:19.086978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:19.086978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:19.086978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:19.086978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:19.086978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:19.086978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:19.086978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:19.086978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:19.086978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:19.086978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:19.086978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:19.087989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:19.087989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:19.087989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:19.087989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:19.087989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:19.087989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:19.087989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:19.087989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:19.087989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:19.087989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:19.087989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:19.087989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:19.091091 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 277/552] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:19.093029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2635d5-fec9-4fee-a31b-58db3b6426c1 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:19.093476 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2635d5-fec9-4fee-a31b-58db3b6426c1 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:19.093886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2635d5-fec9-4fee-a31b-58db3b6426c1 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:19.099433 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 278/553] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:19.099433 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2635d5-fec9-4fee-a31b-58db3b6426c1 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:19.117161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:19.132286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:19.149575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309801b5-4773-4707-bcbf-196dda45179d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:19.152205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309801b5-4773-4707-bcbf-196dda45179d None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:19.214828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2635d5-fec9-4fee-a31b-58db3b6426c1 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:19.255870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd5c1f-44a7-48f2-a9ba-2f2c93c68e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:19.256642 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd5c1f-44a7-48f2-a9ba-2f2c93c68e51 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:19.257060 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd5c1f-44a7-48f2-a9ba-2f2c93c68e51 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:19.257419 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd5c1f-44a7-48f2-a9ba-2f2c93c68e51 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:19.258474 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd5c1f-44a7-48f2-a9ba-2f2c93c68e51 None admin] RBAC: Adding query filter params (name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:19.258830 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd5c1f-44a7-48f2-a9ba-2f2c93c68e51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:19.260311 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd5c1f-44a7-48f2-a9ba-2f2c93c68e51 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:19.274046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 279/554] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:36:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:19.275494 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58cf93-bea8-4c55-abd1-b33f78954b83 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:19.275889 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58cf93-bea8-4c55-abd1-b33f78954b83 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:19.276272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58cf93-bea8-4c55-abd1-b33f78954b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:19.289072 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 276/555] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 22:36:19.290741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309801b5-4773-4707-bcbf-196dda45179d None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:19.302750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-ad58cf93-bea8-4c55-abd1-b33f78954b83 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:19.304122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ad58cf93-bea8-4c55-abd1-b33f78954b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:19.378242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 280/556] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:19.379248 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58cf93-bea8-4c55-abd1-b33f78954b83 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:19.382534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:19.392485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:19.414092 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309801b5-4773-4707-bcbf-196dda45179d None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:19.453203 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfb87e-56d5-477d-af7d-fc092e0496ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:19.453854 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfb87e-56d5-477d-af7d-fc092e0496ee None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:19.454139 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfb87e-56d5-477d-af7d-fc092e0496ee None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:19.454460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bfb87e-56d5-477d-af7d-fc092e0496ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:19.465655 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfb87e-56d5-477d-af7d-fc092e0496ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:19.467159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bfb87e-56d5-477d-af7d-fc092e0496ee None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:19.486715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-88bfb87e-56d5-477d-af7d-fc092e0496ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:19.486715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:19.486715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:19.486715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:19.486715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:19.486715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:19.486715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:19.486715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:19.486715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:19.486715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:19.486715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:19.486715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:19.486715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:19.486715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:19.486715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:19.487632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:19.487632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:19.487632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:19.487632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:19.487632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:19.487632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:19.487632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:19.487632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:19.487632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:19.487632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:19.487632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:19.487632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:19.487632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:19.487632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:19.487632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:19.487632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:19.487632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:19.488528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:19.488528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:19.488528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:19.488528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:19.493421 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 277/557] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:19.494407 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfb87e-56d5-477d-af7d-fc092e0496ee None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:19.498566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58cf93-bea8-4c55-abd1-b33f78954b83 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:19.534644 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386e417-d76b-45ab-8c0f-3253f548e686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:19.535290 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386e417-d76b-45ab-8c0f-3253f548e686 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:19.535573 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386e417-d76b-45ab-8c0f-3253f548e686 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:19.535856 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386e417-d76b-45ab-8c0f-3253f548e686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:19.546215 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386e417-d76b-45ab-8c0f-3253f548e686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:19.547703 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386e417-d76b-45ab-8c0f-3253f548e686 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:19.561876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-2386e417-d76b-45ab-8c0f-3253f548e686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:19.561876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:19.561876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:19.561876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:19.561876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:19.561876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:19.561876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:19.561876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:19.561876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:19.561876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:19.561876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:19.561876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:19.561876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:19.561876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:19.561876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:19.563337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:19.563337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:19.563337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:19.563337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:19.563337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:19.563337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:19.563337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:19.563337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:19.563337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:19.563337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:19.563337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:19.563337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:19.563337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:19.563337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:19.563337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:19.563337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:19.563337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:19.564641 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:19.564641 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:19.564641 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:19.564641 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:19.564641 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 281/558] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:19.564641 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386e417-d76b-45ab-8c0f-3253f548e686 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:19.609432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bfb87e-56d5-477d-af7d-fc092e0496ee None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:19.630034 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:19.644275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba8e07-d99d-4942-95ba-079a158a0ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:19.644916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba8e07-d99d-4942-95ba-079a158a0ffb None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:19.645199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba8e07-d99d-4942-95ba-079a158a0ffb None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:19.645482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba8e07-d99d-4942-95ba-079a158a0ffb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:19.653877 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:19.656869 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba8e07-d99d-4942-95ba-079a158a0ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:19.663091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-d3ba8e07-d99d-4942-95ba-079a158a0ffb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:19.663091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:19.663091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:19.663091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:19.663091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:19.663091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:19.663091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:19.663091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:19.663091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:19.663091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:19.663091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:19.663091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:19.663091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:19.663091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:19.663091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:19.663091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:19.664202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:19.664202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:19.664202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:19.664202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:19.664202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:19.664202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:19.664202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:19.664202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:19.664202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:19.664202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:19.664202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:19.664202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:19.664202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:19.664202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:19.664202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:19.664202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:19.665820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:19.665820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:19.665820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:19.665820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:19.665820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:19.665820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:19.665820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:19.665820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:19.665820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:19.665820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:19.665820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:19.665820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:19.665820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 278/559] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:19.666713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b8363-ffd5-4df0-b76b-a63739101c4c None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:19.666713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b8363-ffd5-4df0-b76b-a63739101c4c None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:19.666837 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b8363-ffd5-4df0-b76b-a63739101c4c None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:19.668326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 279/560] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:19.669440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b8363-ffd5-4df0-b76b-a63739101c4c None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:19.687695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386e417-d76b-45ab-8c0f-3253f548e686 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:19.722015 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faafc2d-9296-4b28-ad27-7b56b75cebfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:19.722766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faafc2d-9296-4b28-ad27-7b56b75cebfc None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:19.723123 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faafc2d-9296-4b28-ad27-7b56b75cebfc None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:19.723499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faafc2d-9296-4b28-ad27-7b56b75cebfc None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:19.724364 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faafc2d-9296-4b28-ad27-7b56b75cebfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:19.724686 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faafc2d-9296-4b28-ad27-7b56b75cebfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:19.726108 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faafc2d-9296-4b28-ad27-7b56b75cebfc None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:19.739544 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 282/561] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:19.740416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faafc2d-9296-4b28-ad27-7b56b75cebfc None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:19.788682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b8363-ffd5-4df0-b76b-a63739101c4c None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:19.824559 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4832b93-b57d-45c6-9884-f6d816240c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:19.825196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4832b93-b57d-45c6-9884-f6d816240c92 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:19.825533 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4832b93-b57d-45c6-9884-f6d816240c92 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:19.825817 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4832b93-b57d-45c6-9884-f6d816240c92 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:19.826799 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4832b93-b57d-45c6-9884-f6d816240c92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:19.827163 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4832b93-b57d-45c6-9884-f6d816240c92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:19.828643 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4832b93-b57d-45c6-9884-f6d816240c92 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:19.840713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faafc2d-9296-4b28-ad27-7b56b75cebfc None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:19.845945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 280/562] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:19.847219 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca25507-42d4-4bb5-a803-ce9d9576610f None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:19.847516 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca25507-42d4-4bb5-a803-ce9d9576610f None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:19.847792 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca25507-42d4-4bb5-a803-ce9d9576610f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:19.857298 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:19.867318 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-dca25507-42d4-4bb5-a803-ce9d9576610f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:19.868540 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-dca25507-42d4-4bb5-a803-ce9d9576610f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:19.875817 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde64635-63dd-4f24-a3b7-e4d747d28fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:19.876443 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde64635-63dd-4f24-a3b7-e4d747d28fc9 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:19.876731 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde64635-63dd-4f24-a3b7-e4d747d28fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:19.877004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde64635-63dd-4f24-a3b7-e4d747d28fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:19.877720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde64635-63dd-4f24-a3b7-e4d747d28fc9 None admin] RBAC: Adding query filter params (name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:19.878031 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde64635-63dd-4f24-a3b7-e4d747d28fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:19.879441 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde64635-63dd-4f24-a3b7-e4d747d28fc9 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:19.892455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 283/563] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:36:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:19.892455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde64635-63dd-4f24-a3b7-e4d747d28fc9 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:19.928676 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:19.947827 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 281/564] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:19.947827 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca25507-42d4-4bb5-a803-ce9d9576610f None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:20.001073 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde64635-63dd-4f24-a3b7-e4d747d28fc9 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:20.035900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52794aa5-c916-4381-94ab-c1a2d3fab8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:20.036549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52794aa5-c916-4381-94ab-c1a2d3fab8cd None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:20.036837 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52794aa5-c916-4381-94ab-c1a2d3fab8cd None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:20.037114 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52794aa5-c916-4381-94ab-c1a2d3fab8cd None admin] PATH_INFO: `/v3/users/glance` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:20.045406 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52794aa5-c916-4381-94ab-c1a2d3fab8cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:20.046903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52794aa5-c916-4381-94ab-c1a2d3fab8cd None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:20.052246 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca25507-42d4-4bb5-a803-ce9d9576610f None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:20.058071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-52794aa5-c916-4381-94ab-c1a2d3fab8cd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 22:36:20.058071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:20.058071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:20.058071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:20.058071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:20.058071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:20.058071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:20.058071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:20.058071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:20.058071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:20.058071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:20.058071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:20.058071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:20.058071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:20.058071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:20.058071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:20.059236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:20.059236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:20.059236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:20.059236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:20.059236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:20.059236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:20.059236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:20.059236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:20.059236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:20.059236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:20.059236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:20.059236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:20.059236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:20.059236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:20.059236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:20.059236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:20.059236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:20.059236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:20.060371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:20.060371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:20.060371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:20.060371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:20.060371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:20.060371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:20.060371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:20.060371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:20.060371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 22:36:20.060371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:20.062839 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 284/565] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:36:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:20.063559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52794aa5-c916-4381-94ab-c1a2d3fab8cd None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:20.096788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93a2fa-2809-4e5e-8388-8a361a1174f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:20.097502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93a2fa-2809-4e5e-8388-8a361a1174f6 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:20.098055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93a2fa-2809-4e5e-8388-8a361a1174f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:20.098171 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c93a2fa-2809-4e5e-8388-8a361a1174f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:20.105162 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93a2fa-2809-4e5e-8388-8a361a1174f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:20.106859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c93a2fa-2809-4e5e-8388-8a361a1174f6 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:20.107266 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:20.119211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-1c93a2fa-2809-4e5e-8388-8a361a1174f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:20.119211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:20.119211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:20.119211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:20.119211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:20.119211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:20.119211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:20.119211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:20.119211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:20.119211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:20.119211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:20.119211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:20.119211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:20.119211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:20.119211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:20.120290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:20.120290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:20.120290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:20.120290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:20.120290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:20.120290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:20.120290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:20.120290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:20.120290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:20.120290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:20.120290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:20.120290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:20.120290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:20.120290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:20.120290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:20.120290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:20.120290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:20.121396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:20.121396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:20.121396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:20.121396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:20.121396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:20.121396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:20.121396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:20.121396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:20.127165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 282/566] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:20.127165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93a2fa-2809-4e5e-8388-8a361a1174f6 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:20.179732 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:20.180859 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52794aa5-c916-4381-94ab-c1a2d3fab8cd None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:20.217443 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d33aa-44ef-4567-ac23-de27fc062124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:20.218096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d33aa-44ef-4567-ac23-de27fc062124 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:20.218466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d33aa-44ef-4567-ac23-de27fc062124 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:20.218744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025d33aa-44ef-4567-ac23-de27fc062124 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:20.230665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d33aa-44ef-4567-ac23-de27fc062124 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:20.232129 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025d33aa-44ef-4567-ac23-de27fc062124 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:20.235957 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c93a2fa-2809-4e5e-8388-8a361a1174f6 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:20.247061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-025d33aa-44ef-4567-ac23-de27fc062124 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:20.247061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:20.247061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:20.247061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:20.247061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:20.247061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:20.247061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:20.247061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:20.247061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:20.247061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:20.247061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:20.247061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:20.247061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:20.247061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:20.247061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:20.247981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:20.247981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:20.247981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:20.247981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:20.247981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:20.247981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:20.247981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:20.247981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:20.247981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:20.247981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:20.247981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:20.247981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:20.247981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:20.247981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:20.247981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:20.247981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:20.247981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:20.248879 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:20.248879 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:20.248879 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:20.248879 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:20.248879 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 285/567] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:20.249194 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d33aa-44ef-4567-ac23-de27fc062124 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:20.278660 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368659b-427c-4e1e-8052-e3d33917a252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:20.279325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368659b-427c-4e1e-8052-e3d33917a252 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:20.279616 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368659b-427c-4e1e-8052-e3d33917a252 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:20.279891 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368659b-427c-4e1e-8052-e3d33917a252 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:20.291032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368659b-427c-4e1e-8052-e3d33917a252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:20.296440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-4368659b-427c-4e1e-8052-e3d33917a252 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:20.296440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:20.296440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:20.296440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:20.296440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:20.296440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:20.296440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:20.296440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:20.296440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:20.296440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:20.296440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:20.296440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:20.296440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:20.296440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:20.296440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:20.296440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:20.297378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:20.297378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:20.297378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:20.297378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:20.297378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:20.297378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:20.297378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:20.297378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:20.297378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:20.297378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:20.297378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:20.297378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:20.297378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:20.297378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:20.297378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:20.297378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:20.298221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:20.298221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:20.298221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:20.298221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:20.298221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:20.298221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:20.298221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:20.298221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:20.298221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:20.298221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:20.298221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:20.298221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:20.298221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 283/568] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:20.299513 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368659b-427c-4e1e-8052-e3d33917a252 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:20.350098 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:20.363396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025d33aa-44ef-4567-ac23-de27fc062124 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:20.400138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133497d-afd3-4844-900c-1af07ee7731b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:20.400836 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133497d-afd3-4844-900c-1af07ee7731b None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:20.401068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133497d-afd3-4844-900c-1af07ee7731b None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:20.401344 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8133497d-afd3-4844-900c-1af07ee7731b None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:20.402136 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133497d-afd3-4844-900c-1af07ee7731b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:20.402472 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133497d-afd3-4844-900c-1af07ee7731b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:20.403897 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8133497d-afd3-4844-900c-1af07ee7731b None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:20.411534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368659b-427c-4e1e-8052-e3d33917a252 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:20.426127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:20.441998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 286/569] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Jul 27 22:36:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:20.443089 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133497d-afd3-4844-900c-1af07ee7731b None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:20.454243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b9a63-1b39-466a-92a4-a26f1d590f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:20.454911 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b9a63-1b39-466a-92a4-a26f1d590f99 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:20.455198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b9a63-1b39-466a-92a4-a26f1d590f99 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:20.455503 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608b9a63-1b39-466a-92a4-a26f1d590f99 None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:20.456257 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b9a63-1b39-466a-92a4-a26f1d590f99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:20.456570 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b9a63-1b39-466a-92a4-a26f1d590f99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:20.457998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608b9a63-1b39-466a-92a4-a26f1d590f99 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:20.470420 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 284/570] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:20.471220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b9a63-1b39-466a-92a4-a26f1d590f99 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:20.563289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8133497d-afd3-4844-900c-1af07ee7731b None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:20.586709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608b9a63-1b39-466a-92a4-a26f1d590f99 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:20.605586 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47c009-c3ad-42b7-88a9-e5e38af64e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:20.606219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47c009-c3ad-42b7-88a9-e5e38af64e17 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:20.606552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47c009-c3ad-42b7-88a9-e5e38af64e17 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:20.606825 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47c009-c3ad-42b7-88a9-e5e38af64e17 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:20.607520 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47c009-c3ad-42b7-88a9-e5e38af64e17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:20.607827 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47c009-c3ad-42b7-88a9-e5e38af64e17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:20.609204 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47c009-c3ad-42b7-88a9-e5e38af64e17 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:20.625247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 287/571] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:20.625247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47c009-c3ad-42b7-88a9-e5e38af64e17 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:20.630093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6a611-2232-405b-b93f-25a99e997ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:20.630748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6a611-2232-405b-b93f-25a99e997ae4 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:20.631039 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6a611-2232-405b-b93f-25a99e997ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:20.631318 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6a611-2232-405b-b93f-25a99e997ae4 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:20.632101 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6a611-2232-405b-b93f-25a99e997ae4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:20.632412 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6a611-2232-405b-b93f-25a99e997ae4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:20.633855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6a611-2232-405b-b93f-25a99e997ae4 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:20.634268 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:20.642586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 285/572] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:36:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:20.643383 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6a611-2232-405b-b93f-25a99e997ae4 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:20.673658 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:20.726140 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47c009-c3ad-42b7-88a9-e5e38af64e17 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:20.742089 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6a611-2232-405b-b93f-25a99e997ae4 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:20.759853 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e6fc4-940f-40ae-bc79-4d13109d6cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:20.763823 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e6fc4-940f-40ae-bc79-4d13109d6cd7 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:20.763823 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e6fc4-940f-40ae-bc79-4d13109d6cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:20.763823 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e6fc4-940f-40ae-bc79-4d13109d6cd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:20.774256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e6fc4-940f-40ae-bc79-4d13109d6cd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:20.775797 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285e6fc4-940f-40ae-bc79-4d13109d6cd7 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:20.779495 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc5bcc-3a58-46d5-b7ca-3ac27fc0da2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:20.780117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc5bcc-3a58-46d5-b7ca-3ac27fc0da2a None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:20.780399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc5bcc-3a58-46d5-b7ca-3ac27fc0da2a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:20.780674 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc5bcc-3a58-46d5-b7ca-3ac27fc0da2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:20.781458 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc5bcc-3a58-46d5-b7ca-3ac27fc0da2a None admin] RBAC: Adding query filter params (role.id=7b21a72e7f9348d28d60c78cb0853af7, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=baf405258b9d413fae1192e10250b6a3) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:20.781765 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc5bcc-3a58-46d5-b7ca-3ac27fc0da2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:20.783218 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dc5bcc-3a58-46d5-b7ca-3ac27fc0da2a None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:20.788737 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 286/573] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:36:20 2022] GET /identity/v3/role_assignments?user.id=baf405258b9d413fae1192e10250b6a3&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=7b21a72e7f9348d28d60c78cb0853af7 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:20.790002 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc5bcc-3a58-46d5-b7ca-3ac27fc0da2a None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:20.794064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-285e6fc4-940f-40ae-bc79-4d13109d6cd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:20.794064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:20.794064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:20.794064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:20.794064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:20.794064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:20.794064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:20.794064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:20.794064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:20.794064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:20.794064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:20.794064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:20.794064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:20.794064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:20.794064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:20.795191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:20.795191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:20.795191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:20.795191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:20.795191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:20.795191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:20.795191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:20.795191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:20.795191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:20.795191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:20.795191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:20.795191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:20.795191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:20.795191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:20.795191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:20.795191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:20.795191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:20.796302 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:20.796302 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:20.796302 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:20.796302 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:20.796958 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 288/574] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:20.798270 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e80bc-3187-4668-afa8-12f695e9487c None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:20.798699 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e80bc-3187-4668-afa8-12f695e9487c None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:20.798869 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e80bc-3187-4668-afa8-12f695e9487c None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:20.802510 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 289/575] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:20.802510 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e80bc-3187-4668-afa8-12f695e9487c None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:20.872446 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:20.910870 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:20.919456 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc5bcc-3a58-46d5-b7ca-3ac27fc0da2a None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:20.921493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e80bc-3187-4668-afa8-12f695e9487c None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:20.956268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9165fb-8987-4b18-a5f8-053638f38f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:20.956916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9165fb-8987-4b18-a5f8-053638f38f32 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:20.957201 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9165fb-8987-4b18-a5f8-053638f38f32 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:20.957481 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9165fb-8987-4b18-a5f8-053638f38f32 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:20.961861 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa02eb82-be48-4f55-8b20-a7d5bae07ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:20.962544 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02eb82-be48-4f55-8b20-a7d5bae07ba3 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:20.962831 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02eb82-be48-4f55-8b20-a7d5bae07ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:20.963109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa02eb82-be48-4f55-8b20-a7d5bae07ba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:20.966193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9165fb-8987-4b18-a5f8-053638f38f32 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:20.967689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9165fb-8987-4b18-a5f8-053638f38f32 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:20.973760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02eb82-be48-4f55-8b20-a7d5bae07ba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:20.975219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa02eb82-be48-4f55-8b20-a7d5bae07ba3 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:20.981432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-3f9165fb-8987-4b18-a5f8-053638f38f32 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 22:36:20.981432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:20.981432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:20.981432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:20.981432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:20.981432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:20.981432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:20.981432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:20.981432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:20.981432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:20.981432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:20.981432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:20.981432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:20.981432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:20.981432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:20.981432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:20.982549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:20.982549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:20.982549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:20.982549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:20.982549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:20.982549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:20.982549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:20.982549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:20.982549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:20.982549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:20.982549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:20.982549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:20.982549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:20.982549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:20.982549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:20.982549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:20.982549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:20.982549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:20.983601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:20.983601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:20.983601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:20.983601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:20.983601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:20.983601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:20.983601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:20.983601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:20.983601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 22:36:20.983601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:20.983601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 287/576] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:36:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:20.984225 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9165fb-8987-4b18-a5f8-053638f38f32 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:20.996173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-fa02eb82-be48-4f55-8b20-a7d5bae07ba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:20.996173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:20.996173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:20.996173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:20.996173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:20.996173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:20.996173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:20.996173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:20.996173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:20.996173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:20.996173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:20.996173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:20.996173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:20.996173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:20.996173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:20.997186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:20.997186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:20.997186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:20.997186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:20.997186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:20.997186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:20.997186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:20.997186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:20.997186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:20.997186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:20.997186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:20.997186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:20.997186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:20.997186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:20.997186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:20.997186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:20.997186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:20.998287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:20.998287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:20.998287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:20.998287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:21.002473 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 290/577] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:21.004061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27410a40-f75b-45fd-ba87-9caf6d99b684 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:21.004352 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27410a40-f75b-45fd-ba87-9caf6d99b684 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:21.004635 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27410a40-f75b-45fd-ba87-9caf6d99b684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:21.022281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-27410a40-f75b-45fd-ba87-9caf6d99b684 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:21.023500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-27410a40-f75b-45fd-ba87-9caf6d99b684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:21.095897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9165fb-8987-4b18-a5f8-053638f38f32 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:21.110382 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 291/578] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:21.110382 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27410a40-f75b-45fd-ba87-9caf6d99b684 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:21.130616 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4018d-cf21-4e67-b1d7-9e78eeff95df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:21.131233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4018d-cf21-4e67-b1d7-9e78eeff95df None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:21.131508 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4018d-cf21-4e67-b1d7-9e78eeff95df None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:21.131781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b4018d-cf21-4e67-b1d7-9e78eeff95df None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:21.132503 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4018d-cf21-4e67-b1d7-9e78eeff95df None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:21.132807 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4018d-cf21-4e67-b1d7-9e78eeff95df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:21.134212 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b4018d-cf21-4e67-b1d7-9e78eeff95df None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:21.150977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 288/579] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:21.150977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4018d-cf21-4e67-b1d7-9e78eeff95df None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:21.167916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:21.168328 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:21.232853 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27410a40-f75b-45fd-ba87-9caf6d99b684 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:21.260383 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b4018d-cf21-4e67-b1d7-9e78eeff95df None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:21.267928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac980d0-4188-4908-905d-68ff68b755b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:21.268673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac980d0-4188-4908-905d-68ff68b755b1 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:21.269060 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac980d0-4188-4908-905d-68ff68b755b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:21.269440 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac980d0-4188-4908-905d-68ff68b755b1 None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:21.270380 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac980d0-4188-4908-905d-68ff68b755b1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:21.270799 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac980d0-4188-4908-905d-68ff68b755b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:21.272328 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac980d0-4188-4908-905d-68ff68b755b1 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:21.295080 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 292/580] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Jul 27 22:36:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:21.295080 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac980d0-4188-4908-905d-68ff68b755b1 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:21.300317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beca5a7-5d9c-48ed-ba94-8b46d0379fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:21.301051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beca5a7-5d9c-48ed-ba94-8b46d0379fba None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:21.301435 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beca5a7-5d9c-48ed-ba94-8b46d0379fba None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:21.301717 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beca5a7-5d9c-48ed-ba94-8b46d0379fba None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:21.302440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beca5a7-5d9c-48ed-ba94-8b46d0379fba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:21.302751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beca5a7-5d9c-48ed-ba94-8b46d0379fba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:21.304110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beca5a7-5d9c-48ed-ba94-8b46d0379fba None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:21.316217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 289/581] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:21.322946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beca5a7-5d9c-48ed-ba94-8b46d0379fba None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:21.400602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:21.404010 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac980d0-4188-4908-905d-68ff68b755b1 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:21.411934 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:21.437569 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beca5a7-5d9c-48ed-ba94-8b46d0379fba None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:21.439241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c39575-dd21-44f6-8245-034b2099d0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:21.439914 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c39575-dd21-44f6-8245-034b2099d0f9 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:21.440182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c39575-dd21-44f6-8245-034b2099d0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:21.440464 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c39575-dd21-44f6-8245-034b2099d0f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:21.451767 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c39575-dd21-44f6-8245-034b2099d0f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:21.456677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-f3c39575-dd21-44f6-8245-034b2099d0f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:21.456677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:21.456677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:21.456677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:21.456677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:21.456677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:21.456677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:21.456677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:21.456677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:21.456677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:21.456677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:21.456677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:21.456677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:21.456677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:21.456677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:21.456677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:21.457679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:21.457679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:21.457679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:21.457679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:21.457679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:21.457679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:21.457679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:21.457679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:21.457679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:21.457679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:21.457679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:21.457679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:21.457679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:21.457679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:21.457679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:21.457679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:21.458558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:21.458558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:21.458558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:21.458558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:21.458558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:21.458558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:21.458558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:21.458558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:21.458558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:21.458558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:21.458558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:21.458558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:21.463168 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 293/582] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:21.463989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c39575-dd21-44f6-8245-034b2099d0f9 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:21.474108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbdd2a-36f2-40fc-b881-6e3b3b473ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:21.474784 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbdd2a-36f2-40fc-b881-6e3b3b473ec9 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:21.475337 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbdd2a-36f2-40fc-b881-6e3b3b473ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:21.475446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbdd2a-36f2-40fc-b881-6e3b3b473ec9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:21.482943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbdd2a-36f2-40fc-b881-6e3b3b473ec9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:21.484282 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbdd2a-36f2-40fc-b881-6e3b3b473ec9 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:21.495988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-fbdbdd2a-36f2-40fc-b881-6e3b3b473ec9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:21.495988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:21.495988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:21.495988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:21.495988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:21.495988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:21.495988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:21.495988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:21.495988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:21.495988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:21.495988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:21.495988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:21.495988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:21.495988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:21.495988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:21.496887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:21.496887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:21.496887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:21.496887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:21.496887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:21.496887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:21.496887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:21.496887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:21.496887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:21.496887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:21.496887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:21.496887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:21.496887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:21.496887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:21.496887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:21.496887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:21.496887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:21.497787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:21.497787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:21.497787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:21.497787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:21.497787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:21.497787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:21.497787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:21.497787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:21.497787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 290/583] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:21.498953 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbdd2a-36f2-40fc-b881-6e3b3b473ec9 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:21.576986 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c39575-dd21-44f6-8245-034b2099d0f9 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:21.608309 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbdd2a-36f2-40fc-b881-6e3b3b473ec9 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:21.616047 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04429e32-497e-4b64-a41b-0d53263ed1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:21.616682 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04429e32-497e-4b64-a41b-0d53263ed1ae None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:21.616960 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04429e32-497e-4b64-a41b-0d53263ed1ae None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:21.617231 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04429e32-497e-4b64-a41b-0d53263ed1ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:21.628219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04429e32-497e-4b64-a41b-0d53263ed1ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:21.629667 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04429e32-497e-4b64-a41b-0d53263ed1ae None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:21.644280 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ad816-df67-42be-b99a-c705a62d1e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:21.644971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-04429e32-497e-4b64-a41b-0d53263ed1ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:21.644971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:21.644971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:21.644971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:21.644971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:21.644971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:21.644971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:21.644971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:21.644971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:21.644971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:21.644971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:21.644971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:21.644971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:21.644971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:21.644971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:21.645982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:21.645982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:21.645982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:21.645982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:21.645982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:21.645982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:21.645982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:21.645982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:21.645982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:21.645982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:21.645982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:21.645982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:21.645982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:21.645982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:21.645982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:21.645982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:21.645982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:21.647086 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:21.647086 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:21.647086 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:21.647086 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:21.647348 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ad816-df67-42be-b99a-c705a62d1e86 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:21.647348 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ad816-df67-42be-b99a-c705a62d1e86 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:21.647348 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ad816-df67-42be-b99a-c705a62d1e86 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:21.652301 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 294/584] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:21.652301 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04429e32-497e-4b64-a41b-0d53263ed1ae None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:21.655372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:21.660761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ad816-df67-42be-b99a-c705a62d1e86 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:21.663168 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ad816-df67-42be-b99a-c705a62d1e86 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:21.667618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:21.675601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-122ad816-df67-42be-b99a-c705a62d1e86 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 22:36:21.675601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:21.675601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:21.675601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:21.675601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:21.675601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:21.675601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:21.675601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:21.675601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:21.675601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:21.675601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:21.675601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:21.675601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:21.675601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:21.675601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:21.675601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:21.676703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:21.676703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:21.676703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:21.676703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:21.676703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:21.676703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:21.676703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:21.676703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:21.676703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:21.676703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:21.676703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:21.676703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:21.676703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:21.676703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:21.676703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:21.676703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:21.676703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:21.676703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:21.683399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:21.683399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:21.683399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:21.683399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:21.683399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:21.683399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:21.683399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:21.683399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:21.683399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 22:36:21.683399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:21.683399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 291/585] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jul 27 22:36:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:21.683399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ad816-df67-42be-b99a-c705a62d1e86 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:21.760654 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04429e32-497e-4b64-a41b-0d53263ed1ae None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:21.794840 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c62c2-aa17-44c0-aaf3-59359ffc5686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:21.795514 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c62c2-aa17-44c0-aaf3-59359ffc5686 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:21.795813 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c62c2-aa17-44c0-aaf3-59359ffc5686 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:21.796076 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c62c2-aa17-44c0-aaf3-59359ffc5686 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:21.796779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c62c2-aa17-44c0-aaf3-59359ffc5686 None admin] RBAC: Adding query filter params (name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:21.797083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c62c2-aa17-44c0-aaf3-59359ffc5686 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:21.797182 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ad816-df67-42be-b99a-c705a62d1e86 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:21.798481 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c62c2-aa17-44c0-aaf3-59359ffc5686 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:21.807033 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 295/586] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:36:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:21.807844 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c62c2-aa17-44c0-aaf3-59359ffc5686 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:21.839674 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f694da-60f4-4ab4-b2c5-3ac58fd4b614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:21.840291 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f694da-60f4-4ab4-b2c5-3ac58fd4b614 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:21.840573 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f694da-60f4-4ab4-b2c5-3ac58fd4b614 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:21.841032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f694da-60f4-4ab4-b2c5-3ac58fd4b614 None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:21.841590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f694da-60f4-4ab4-b2c5-3ac58fd4b614 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:21.841884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f694da-60f4-4ab4-b2c5-3ac58fd4b614 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:21.843329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f694da-60f4-4ab4-b2c5-3ac58fd4b614 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:21.861383 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 292/587] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:21.861383 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f694da-60f4-4ab4-b2c5-3ac58fd4b614 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:21.897740 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:21.925010 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:21.925205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c62c2-aa17-44c0-aaf3-59359ffc5686 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:21.964207 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014df769-9a9e-46d7-b944-03dbcf9581e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:21.965064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014df769-9a9e-46d7-b944-03dbcf9581e7 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:21.965494 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014df769-9a9e-46d7-b944-03dbcf9581e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:21.965954 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014df769-9a9e-46d7-b944-03dbcf9581e7 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:21.966670 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014df769-9a9e-46d7-b944-03dbcf9581e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:21.967129 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014df769-9a9e-46d7-b944-03dbcf9581e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:21.968361 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014df769-9a9e-46d7-b944-03dbcf9581e7 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:21.972555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f694da-60f4-4ab4-b2c5-3ac58fd4b614 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:21.986910 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 296/588] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:21.986910 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014df769-9a9e-46d7-b944-03dbcf9581e7 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:22.008026 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca38e2d-a97f-4f4b-a5cc-789014f55f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:22.008334 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca38e2d-a97f-4f4b-a5cc-789014f55f2a None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:22.008614 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca38e2d-a97f-4f4b-a5cc-789014f55f2a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:22.008888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca38e2d-a97f-4f4b-a5cc-789014f55f2a None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:22.009671 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca38e2d-a97f-4f4b-a5cc-789014f55f2a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:22.009976 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca38e2d-a97f-4f4b-a5cc-789014f55f2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:22.011505 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca38e2d-a97f-4f4b-a5cc-789014f55f2a None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:22.028887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 293/589] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jul 27 22:36:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:22.029652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca38e2d-a97f-4f4b-a5cc-789014f55f2a None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:22.092323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014df769-9a9e-46d7-b944-03dbcf9581e7 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:22.129054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653d14a-1ceb-47a2-b2b9-01912c042585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:22.129696 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653d14a-1ceb-47a2-b2b9-01912c042585 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:22.129988 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653d14a-1ceb-47a2-b2b9-01912c042585 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:22.130270 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653d14a-1ceb-47a2-b2b9-01912c042585 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:22.132251 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:22.137665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca38e2d-a97f-4f4b-a5cc-789014f55f2a None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:22.141952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653d14a-1ceb-47a2-b2b9-01912c042585 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:22.143422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2653d14a-1ceb-47a2-b2b9-01912c042585 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:22.151794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:22.161370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-2653d14a-1ceb-47a2-b2b9-01912c042585 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:22.161370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:22.161370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:22.161370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:22.161370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:22.161370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:22.161370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:22.161370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:22.161370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:22.161370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:22.161370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:22.161370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:22.161370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:22.161370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:22.161370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:22.162263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:22.162263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:22.162263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:22.162263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:22.162263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:22.162263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:22.162263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:22.162263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:22.162263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:22.162263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:22.162263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:22.162263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:22.162263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:22.162263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:22.162263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:22.162263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:22.162263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:22.163234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:22.163234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:22.163234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:22.163234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:22.165268 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 297/590] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:22.166173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653d14a-1ceb-47a2-b2b9-01912c042585 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:22.177016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32913247-87c7-4dbe-94e0-7269edea109e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:22.177700 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32913247-87c7-4dbe-94e0-7269edea109e None admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:22.177989 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32913247-87c7-4dbe-94e0-7269edea109e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:22.178270 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32913247-87c7-4dbe-94e0-7269edea109e None admin] PATH_INFO: `/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/b26c60d08b9f47aca8404e4173290908/roles/7b21a72e7f9348d28d60c78cb0853af7` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:22.193808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32913247-87c7-4dbe-94e0-7269edea109e None admin] RBAC: Authorizing `identity:create_grant(project_id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user_id=b26c60d08b9f47aca8404e4173290908, role_id=7b21a72e7f9348d28d60c78cb0853af7)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:22.195310 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32913247-87c7-4dbe-94e0-7269edea109e None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:22.209643 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 294/591] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:36:22 2022] PUT /identity/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/b26c60d08b9f47aca8404e4173290908/roles/7b21a72e7f9348d28d60c78cb0853af7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:36:22.210705 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32913247-87c7-4dbe-94e0-7269edea109e None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:22.301437 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2653d14a-1ceb-47a2-b2b9-01912c042585 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:22.330832 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32913247-87c7-4dbe-94e0-7269edea109e None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:22.349880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088f528-7292-4048-80e6-27180558b616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:22.351643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088f528-7292-4048-80e6-27180558b616 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:22.352704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088f528-7292-4048-80e6-27180558b616 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:22.353189 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088f528-7292-4048-80e6-27180558b616 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:22.364274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088f528-7292-4048-80e6-27180558b616 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:22.367086 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088f528-7292-4048-80e6-27180558b616 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:22.371781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f631d1-c2e2-4e3a-a07e-d08d6f39b9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:22.372439 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f631d1-c2e2-4e3a-a07e-d08d6f39b9d9 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:22.372720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f631d1-c2e2-4e3a-a07e-d08d6f39b9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:22.372992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f631d1-c2e2-4e3a-a07e-d08d6f39b9d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:22.384175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-3088f528-7292-4048-80e6-27180558b616 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:22.384175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:22.384175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:22.384175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:22.384175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:22.384175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:22.384175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:22.384175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:22.384175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:22.384175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:22.384175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:22.384175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:22.384175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:22.384175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:22.384175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:22.385157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:22.385157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:22.385157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:22.385157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:22.385157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:22.385157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:22.385157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:22.385157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:22.385157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:22.385157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:22.385157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:22.385157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:22.385157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:22.385157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:22.385157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:22.385157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:22.385157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:22.386090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:22.386090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:22.386090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:22.386090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:22.386090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:22.386090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:22.386090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:22.386090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:22.386605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f631d1-c2e2-4e3a-a07e-d08d6f39b9d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:22.386605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f631d1-c2e2-4e3a-a07e-d08d6f39b9d9 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:22.389048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 298/592] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:22.391004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088f528-7292-4048-80e6-27180558b616 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:22.407345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-50f631d1-c2e2-4e3a-a07e-d08d6f39b9d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:22.407345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:22.407345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:22.407345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:22.407345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:22.407345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:22.407345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:22.407345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:22.407345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:22.407345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:22.407345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:22.407345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:22.407345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:22.407345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:22.407345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:22.408329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:22.408329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:22.408329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:22.408329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:22.408329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:22.408329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:22.408329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:22.408329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:22.408329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:22.408329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:22.408329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:22.408329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:22.408329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:22.408329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:22.408329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:22.408329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:22.408329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:22.409247 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:22.409247 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:22.409247 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:22.409247 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:22.409247 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 295/593] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:22.410277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f631d1-c2e2-4e3a-a07e-d08d6f39b9d9 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:22.435197 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:22.450509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:22.514070 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088f528-7292-4048-80e6-27180558b616 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:22.547734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f631d1-c2e2-4e3a-a07e-d08d6f39b9d9 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:22.552066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5339d-ceef-4dd8-afa2-edf9094d4ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:22.552633 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5339d-ceef-4dd8-afa2-edf9094d4ebd None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:22.552920 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5339d-ceef-4dd8-afa2-edf9094d4ebd None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:22.553197 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c5339d-ceef-4dd8-afa2-edf9094d4ebd None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:22.553885 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5339d-ceef-4dd8-afa2-edf9094d4ebd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:22.554192 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5339d-ceef-4dd8-afa2-edf9094d4ebd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:22.555638 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c5339d-ceef-4dd8-afa2-edf9094d4ebd None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:22.568422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 299/594] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:22.572995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5339d-ceef-4dd8-afa2-edf9094d4ebd None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:22.597560 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662b5b4-7061-46ed-8b63-a6af83dcb693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:22.598606 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662b5b4-7061-46ed-8b63-a6af83dcb693 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:22.599089 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662b5b4-7061-46ed-8b63-a6af83dcb693 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:22.599584 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662b5b4-7061-46ed-8b63-a6af83dcb693 None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:22.600546 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662b5b4-7061-46ed-8b63-a6af83dcb693 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:22.601089 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662b5b4-7061-46ed-8b63-a6af83dcb693 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:22.603895 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662b5b4-7061-46ed-8b63-a6af83dcb693 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:22.622006 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 296/595] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:22.623245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662b5b4-7061-46ed-8b63-a6af83dcb693 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:22.688585 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c5339d-ceef-4dd8-afa2-edf9094d4ebd None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:22.714813 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:22.722979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:22.729044 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fd347-5772-4881-908b-a3ffd6ca65e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:22.730513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fd347-5772-4881-908b-a3ffd6ca65e9 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:22.731211 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fd347-5772-4881-908b-a3ffd6ca65e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:22.731664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fd347-5772-4881-908b-a3ffd6ca65e9 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:22.732781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fd347-5772-4881-908b-a3ffd6ca65e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:22.733647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fd347-5772-4881-908b-a3ffd6ca65e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:22.735241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3fd347-5772-4881-908b-a3ffd6ca65e9 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:22.749085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662b5b4-7061-46ed-8b63-a6af83dcb693 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:22.751456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 300/596] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:22.753259 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fd347-5772-4881-908b-a3ffd6ca65e9 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:22.787076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf01092-6289-4e0d-9bd6-cbebd43f2d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:22.787851 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf01092-6289-4e0d-9bd6-cbebd43f2d94 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:22.788205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf01092-6289-4e0d-9bd6-cbebd43f2d94 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:22.788619 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf01092-6289-4e0d-9bd6-cbebd43f2d94 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:22.796704 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf01092-6289-4e0d-9bd6-cbebd43f2d94 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:22.798851 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf01092-6289-4e0d-9bd6-cbebd43f2d94 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:22.811572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-faf01092-6289-4e0d-9bd6-cbebd43f2d94 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 22:36:22.811572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:22.811572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:22.811572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:22.811572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:22.811572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:22.811572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:22.811572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:22.811572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:22.811572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:22.811572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:22.811572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:22.811572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:22.811572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:22.811572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:22.811572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:22.812504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:22.812504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:22.812504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:22.812504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:22.812504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:22.812504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:22.812504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:22.812504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:22.812504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:22.812504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:22.812504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:22.812504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:22.812504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:22.812504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:22.812504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:22.812504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:22.812504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:22.812504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:22.813449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:22.813449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:22.813449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:22.813449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:22.813449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:22.813449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:22.813449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:22.813449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:22.813449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 22:36:22.813449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:22.817565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 297/597] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:22.818277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf01092-6289-4e0d-9bd6-cbebd43f2d94 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:22.874469 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fd347-5772-4881-908b-a3ffd6ca65e9 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:22.908993 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d844bc-9b32-41b5-8cdd-4f5491deff08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:22.909660 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d844bc-9b32-41b5-8cdd-4f5491deff08 None admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:22.909942 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d844bc-9b32-41b5-8cdd-4f5491deff08 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:22.910222 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d844bc-9b32-41b5-8cdd-4f5491deff08 None admin] PATH_INFO: `/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/9ac8dcdbe57646f79593e7f39dc60900/roles/7b21a72e7f9348d28d60c78cb0853af7` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:22.925287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d844bc-9b32-41b5-8cdd-4f5491deff08 None admin] RBAC: Authorizing `identity:create_grant(project_id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user_id=9ac8dcdbe57646f79593e7f39dc60900, role_id=7b21a72e7f9348d28d60c78cb0853af7)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:22.926117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf01092-6289-4e0d-9bd6-cbebd43f2d94 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:22.926764 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d844bc-9b32-41b5-8cdd-4f5491deff08 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:22.941681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 301/598] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:36:22 2022] PUT /identity/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/9ac8dcdbe57646f79593e7f39dc60900/roles/7b21a72e7f9348d28d60c78cb0853af7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:36:22.943088 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d844bc-9b32-41b5-8cdd-4f5491deff08 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:22.973345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4781d6-042e-4e00-9a42-ac7a19327ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:22.974022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4781d6-042e-4e00-9a42-ac7a19327ca4 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:22.974311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4781d6-042e-4e00-9a42-ac7a19327ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:22.974621 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4781d6-042e-4e00-9a42-ac7a19327ca4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:22.977446 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:22.980478 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:22.990801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4781d6-042e-4e00-9a42-ac7a19327ca4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:22.994297 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4781d6-042e-4e00-9a42-ac7a19327ca4 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:23.016761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-ac4781d6-042e-4e00-9a42-ac7a19327ca4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:23.016761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:23.016761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:23.016761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:23.016761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:23.016761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:23.016761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:23.016761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:23.016761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:23.016761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:23.016761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:23.016761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:23.016761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:23.016761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:23.016761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:23.017787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:23.017787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:23.017787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:23.017787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:23.017787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:23.017787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:23.017787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:23.017787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:23.017787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:23.017787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:23.017787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:23.017787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:23.017787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:23.017787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:23.017787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:23.017787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:23.017787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:23.018712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:23.018712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:23.018712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:23.018712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:23.018712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:23.018712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:23.018712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:23.018712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:23.020108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 298/599] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:23.021416 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238a3c9-80ac-444f-9af8-fa82f269c7c6 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:23.021705 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238a3c9-80ac-444f-9af8-fa82f269c7c6 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:23.022013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238a3c9-80ac-444f-9af8-fa82f269c7c6 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:23.028445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 299/600] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:23.029404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238a3c9-80ac-444f-9af8-fa82f269c7c6 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:23.101906 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d844bc-9b32-41b5-8cdd-4f5491deff08 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:23.141079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d725f42c-ba8a-4c31-89e5-2c29531af9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:23.142039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725f42c-ba8a-4c31-89e5-2c29531af9fd None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:23.142604 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725f42c-ba8a-4c31-89e5-2c29531af9fd None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:23.143076 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d725f42c-ba8a-4c31-89e5-2c29531af9fd None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:23.144074 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725f42c-ba8a-4c31-89e5-2c29531af9fd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:23.144575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725f42c-ba8a-4c31-89e5-2c29531af9fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:23.146321 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238a3c9-80ac-444f-9af8-fa82f269c7c6 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:23.146765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d725f42c-ba8a-4c31-89e5-2c29531af9fd None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:23.166104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 302/601] 10.222.0.48 () {56 vars in 1139 bytes} [Wed Jul 27 22:36:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:23.168083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c12a98-9574-4862-accd-be662229834c None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:23.168814 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c12a98-9574-4862-accd-be662229834c None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:23.169285 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c12a98-9574-4862-accd-be662229834c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:23.182779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f212b57-c454-4b9c-a187-a70264495f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:23.183841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f212b57-c454-4b9c-a187-a70264495f6b None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:23.184322 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f212b57-c454-4b9c-a187-a70264495f6b None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:23.184808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f212b57-c454-4b9c-a187-a70264495f6b None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:23.185907 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f212b57-c454-4b9c-a187-a70264495f6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:23.186225 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f212b57-c454-4b9c-a187-a70264495f6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:23.187719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f212b57-c454-4b9c-a187-a70264495f6b None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:23.192781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-a3c12a98-9574-4862-accd-be662229834c None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:23.194225 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a3c12a98-9574-4862-accd-be662229834c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:23.201600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 300/602] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:23.202470 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f212b57-c454-4b9c-a187-a70264495f6b None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:23.264368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:23.284008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 303/603] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:23.285154 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c12a98-9574-4862-accd-be662229834c None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:23.294250 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:23.338461 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f212b57-c454-4b9c-a187-a70264495f6b None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:23.375934 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d22283-83ff-4629-b289-4995dda34553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:23.376502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d22283-83ff-4629-b289-4995dda34553 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:23.376788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d22283-83ff-4629-b289-4995dda34553 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:23.377068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d22283-83ff-4629-b289-4995dda34553 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:23.389644 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d22283-83ff-4629-b289-4995dda34553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:23.391131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d22283-83ff-4629-b289-4995dda34553 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:23.406695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c12a98-9574-4862-accd-be662229834c None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:23.408672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-15d22283-83ff-4629-b289-4995dda34553 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:23.408672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:23.408672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:23.408672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:23.408672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:23.408672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:23.408672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:23.408672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:23.408672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:23.408672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:23.408672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:23.408672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:23.408672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:23.408672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:23.408672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:23.409543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:23.409543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:23.409543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:23.409543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:23.409543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:23.409543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:23.409543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:23.409543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:23.409543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:23.409543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:23.409543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:23.409543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:23.409543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:23.409543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:23.409543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:23.409543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:23.409543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:23.410452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:23.410452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:23.410452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:23.410452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:23.410452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 301/604] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:23.411134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d22283-83ff-4629-b289-4995dda34553 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:23.454588 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043419a-c8a5-44d5-beea-56451c4b3b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:23.456235 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043419a-c8a5-44d5-beea-56451c4b3b12 None admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:23.456716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043419a-c8a5-44d5-beea-56451c4b3b12 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:23.457222 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043419a-c8a5-44d5-beea-56451c4b3b12 None admin] PATH_INFO: `/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/c621601261e44ca8a7938862d6578639/roles/7b21a72e7f9348d28d60c78cb0853af7` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:23.476588 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043419a-c8a5-44d5-beea-56451c4b3b12 None admin] RBAC: Authorizing `identity:create_grant(project_id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user_id=c621601261e44ca8a7938862d6578639, role_id=7b21a72e7f9348d28d60c78cb0853af7)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:23.478907 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043419a-c8a5-44d5-beea-56451c4b3b12 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:23.497435 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 304/605] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:36:23 2022] PUT /identity/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/c621601261e44ca8a7938862d6578639/roles/7b21a72e7f9348d28d60c78cb0853af7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:36:23.498280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043419a-c8a5-44d5-beea-56451c4b3b12 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:23.543571 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d22283-83ff-4629-b289-4995dda34553 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:23.570778 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:23.609912 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2040f-0729-4f80-a0e8-baea73564e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:23.611706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2040f-0729-4f80-a0e8-baea73564e72 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:23.612670 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:23.614179 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2040f-0729-4f80-a0e8-baea73564e72 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:23.615781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc2040f-0729-4f80-a0e8-baea73564e72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:23.641732 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc2040f-0729-4f80-a0e8-baea73564e72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:23.655448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-fbc2040f-0729-4f80-a0e8-baea73564e72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:23.655448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:23.655448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:23.655448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:23.655448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:23.655448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:23.655448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:23.655448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:23.655448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:23.655448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:23.655448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:23.655448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:23.655448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:23.655448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:23.655448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:23.655448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:23.656455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:23.656455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:23.656455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:23.656455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:23.656455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:23.656455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:23.656455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:23.656455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:23.656455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:23.656455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:23.656455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:23.656455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:23.656455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:23.656455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:23.656455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:23.656455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:23.657320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:23.657320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:23.657320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:23.657320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:23.657320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:23.657320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:23.657320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:23.657320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:23.657320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:23.657320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:23.657320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:23.657320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:23.661396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 302/606] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:23.666377 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2040f-0729-4f80-a0e8-baea73564e72 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:23.716492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043419a-c8a5-44d5-beea-56451c4b3b12 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:23.759971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2ad48-49af-4560-bda1-db497cb7d3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:23.760600 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2ad48-49af-4560-bda1-db497cb7d3fe None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:23.760889 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2ad48-49af-4560-bda1-db497cb7d3fe None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:23.761172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2ad48-49af-4560-bda1-db497cb7d3fe None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:23.761869 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2ad48-49af-4560-bda1-db497cb7d3fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:23.762179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2ad48-49af-4560-bda1-db497cb7d3fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:23.763722 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2ad48-49af-4560-bda1-db497cb7d3fe None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:23.776235 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 305/607] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:23.782172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2ad48-49af-4560-bda1-db497cb7d3fe None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:23.807079 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc2040f-0729-4f80-a0e8-baea73564e72 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:23.854457 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5fefd-38a7-40f8-bc96-b59fb32bcf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:23.855448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5fefd-38a7-40f8-bc96-b59fb32bcf7e None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:23.855944 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5fefd-38a7-40f8-bc96-b59fb32bcf7e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:23.856658 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe5fefd-38a7-40f8-bc96-b59fb32bcf7e None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:23.858143 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5fefd-38a7-40f8-bc96-b59fb32bcf7e None admin] RBAC: Adding query filter params (name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:23.858677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5fefd-38a7-40f8-bc96-b59fb32bcf7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:23.860727 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe5fefd-38a7-40f8-bc96-b59fb32bcf7e None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:23.871786 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 303/608] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:36:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:23.879557 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5fefd-38a7-40f8-bc96-b59fb32bcf7e None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:23.916499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2ad48-49af-4560-bda1-db497cb7d3fe None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:23.939675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:23.941686 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:23.983467 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda5508-4439-4a98-ba79-be2de00012bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:23.984122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda5508-4439-4a98-ba79-be2de00012bf None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:23.984407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda5508-4439-4a98-ba79-be2de00012bf None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:23.984687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda5508-4439-4a98-ba79-be2de00012bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:23.999120 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda5508-4439-4a98-ba79-be2de00012bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:24.000574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda5508-4439-4a98-ba79-be2de00012bf None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:24.025714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-cbda5508-4439-4a98-ba79-be2de00012bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:24.025714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:24.025714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:24.025714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:24.025714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:24.025714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:24.025714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:24.025714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:24.025714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:24.025714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:24.025714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:24.025714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:24.025714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:24.025714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:24.025714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:24.026775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:24.026775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:24.026775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:24.026775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:24.026775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:24.026775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:24.026775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:24.026775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:24.026775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:24.026775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:24.026775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:24.026775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:24.026775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:24.026775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:24.026775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:24.026775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:24.026775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:24.027691 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:24.027691 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:24.027691 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:24.027691 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:24.027691 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:24.027691 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:24.027691 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:24.027691 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:24.029030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 306/609] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:24.032716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda5508-4439-4a98-ba79-be2de00012bf None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:24.072071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe5fefd-38a7-40f8-bc96-b59fb32bcf7e None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:24.133869 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70622d63-0e1b-4844-b3c4-cd462cf998be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:24.138451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70622d63-0e1b-4844-b3c4-cd462cf998be None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:24.138451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70622d63-0e1b-4844-b3c4-cd462cf998be None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:24.138451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70622d63-0e1b-4844-b3c4-cd462cf998be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:24.160413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70622d63-0e1b-4844-b3c4-cd462cf998be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:24.164206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70622d63-0e1b-4844-b3c4-cd462cf998be None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:24.193865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-70622d63-0e1b-4844-b3c4-cd462cf998be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:24.193865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:24.193865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:24.193865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:24.193865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:24.193865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:24.193865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:24.193865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:24.193865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:24.193865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:24.193865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:24.193865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:24.193865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:24.193865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:24.193865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:24.194973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:24.194973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:24.194973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:24.194973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:24.194973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:24.194973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:24.194973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:24.194973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:24.194973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:24.194973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:24.194973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:24.194973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:24.194973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:24.194973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:24.194973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:24.194973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:24.194973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:24.196112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:24.196112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:24.196112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:24.196112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:24.199344 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 304/610] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:24.205312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70622d63-0e1b-4844-b3c4-cd462cf998be None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:24.241756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda5508-4439-4a98-ba79-be2de00012bf None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:24.296520 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da073b76-759e-4fe1-a569-12d29dabbd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:24.297507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da073b76-759e-4fe1-a569-12d29dabbd64 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:24.299421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da073b76-759e-4fe1-a569-12d29dabbd64 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:24.299805 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da073b76-759e-4fe1-a569-12d29dabbd64 None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:24.301882 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da073b76-759e-4fe1-a569-12d29dabbd64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:24.302298 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da073b76-759e-4fe1-a569-12d29dabbd64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:24.303876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da073b76-759e-4fe1-a569-12d29dabbd64 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:24.325648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 307/611] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:24.333501 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da073b76-759e-4fe1-a569-12d29dabbd64 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:24.362748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:24.394212 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70622d63-0e1b-4844-b3c4-cd462cf998be None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:24.402418 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:24.443531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a3d51-48ce-4ed3-ad87-bb0c118795c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:24.444235 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a3d51-48ce-4ed3-ad87-bb0c118795c5 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:24.444471 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a3d51-48ce-4ed3-ad87-bb0c118795c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:24.444749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a3d51-48ce-4ed3-ad87-bb0c118795c5 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:24.445451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a3d51-48ce-4ed3-ad87-bb0c118795c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:24.446292 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a3d51-48ce-4ed3-ad87-bb0c118795c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:24.447878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a3d51-48ce-4ed3-ad87-bb0c118795c5 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:24.464252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 305/612] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:24.469771 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59bbff-0f83-4421-b909-8be98d5e62e1 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:24.470067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59bbff-0f83-4421-b909-8be98d5e62e1 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:24.470364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd59bbff-0f83-4421-b909-8be98d5e62e1 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:24.471878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 306/613] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:24.472599 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59bbff-0f83-4421-b909-8be98d5e62e1 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:24.511137 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da073b76-759e-4fe1-a569-12d29dabbd64 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:24.548843 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616cd3e-b7be-4cb6-9587-1a9f6922632b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:24.549621 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616cd3e-b7be-4cb6-9587-1a9f6922632b None admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:24.550046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616cd3e-b7be-4cb6-9587-1a9f6922632b None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:24.550356 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616cd3e-b7be-4cb6-9587-1a9f6922632b None admin] PATH_INFO: `/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/c266721767004428b9b54dd200f3cd6b/roles/7b21a72e7f9348d28d60c78cb0853af7` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:24.566074 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616cd3e-b7be-4cb6-9587-1a9f6922632b None admin] RBAC: Authorizing `identity:create_grant(project_id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user_id=c266721767004428b9b54dd200f3cd6b, role_id=7b21a72e7f9348d28d60c78cb0853af7)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:24.567549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616cd3e-b7be-4cb6-9587-1a9f6922632b None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:24.587374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 308/614] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:36:24 2022] PUT /identity/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/c266721767004428b9b54dd200f3cd6b/roles/7b21a72e7f9348d28d60c78cb0853af7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:36:24.588698 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef111418-6e76-4cc4-a976-fd6b32fb3b5e None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:24.589092 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef111418-6e76-4cc4-a976-fd6b32fb3b5e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:24.589429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef111418-6e76-4cc4-a976-fd6b32fb3b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:24.589703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd59bbff-0f83-4421-b909-8be98d5e62e1 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:24.616155 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-ef111418-6e76-4cc4-a976-fd6b32fb3b5e None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:24.618106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ef111418-6e76-4cc4-a976-fd6b32fb3b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:24.662766 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64d42d-6178-4263-86d8-d75b84e33b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:24.663695 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64d42d-6178-4263-86d8-d75b84e33b06 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:24.664152 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64d42d-6178-4263-86d8-d75b84e33b06 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:24.664670 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb64d42d-6178-4263-86d8-d75b84e33b06 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:24.681372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64d42d-6178-4263-86d8-d75b84e33b06 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:24.685165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb64d42d-6178-4263-86d8-d75b84e33b06 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:24.715262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-cb64d42d-6178-4263-86d8-d75b84e33b06 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 22:36:24.715262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:24.715262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:24.715262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:24.715262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:24.715262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:24.715262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:24.715262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:24.715262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:24.715262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:24.715262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:24.715262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:24.715262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:24.715262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:24.715262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:24.715262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:24.716482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:24.716482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:24.716482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:24.716482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:24.716482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:24.716482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:24.716482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:24.716482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:24.716482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:24.716482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:24.716482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:24.716482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:24.716482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:24.716482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:24.716482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:24.716482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:24.716482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:24.716482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:24.717686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:24.717686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:24.717686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:24.717686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:24.717686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:24.717686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:24.717686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:24.717686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:24.717686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 22:36:24.717686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:24.719858 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 307/615] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:36:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:24.725661 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64d42d-6178-4263-86d8-d75b84e33b06 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:24.730283 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:24.772213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 309/616] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:24.802783 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef111418-6e76-4cc4-a976-fd6b32fb3b5e None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:24.835677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:24.884495 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb64d42d-6178-4263-86d8-d75b84e33b06 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:24.947055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9b00a-6ac7-4d5e-929a-135b7771f76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:24.948086 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9b00a-6ac7-4d5e-929a-135b7771f76d None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:24.948607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9b00a-6ac7-4d5e-929a-135b7771f76d None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:24.949070 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec9b00a-6ac7-4d5e-929a-135b7771f76d None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:24.950055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9b00a-6ac7-4d5e-929a-135b7771f76d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:24.950569 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9b00a-6ac7-4d5e-929a-135b7771f76d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:24.952466 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec9b00a-6ac7-4d5e-929a-135b7771f76d None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:24.974442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef111418-6e76-4cc4-a976-fd6b32fb3b5e None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:24.980436 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 308/617] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Jul 27 22:36:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:24.985445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9b00a-6ac7-4d5e-929a-135b7771f76d None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:25.013034 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6748f-e283-403b-bda8-8688848d2be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:25.014124 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6748f-e283-403b-bda8-8688848d2be1 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:25.014813 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6748f-e283-403b-bda8-8688848d2be1 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:25.016203 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d6748f-e283-403b-bda8-8688848d2be1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:25.035254 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d6748f-e283-403b-bda8-8688848d2be1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:25.040713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-f9d6748f-e283-403b-bda8-8688848d2be1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:25.040713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:25.040713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:25.040713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:25.040713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:25.040713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:25.040713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:25.040713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:25.040713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:25.040713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:25.040713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:25.040713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:25.040713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:25.040713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:25.040713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:25.040713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:25.041643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:25.041643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:25.041643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:25.041643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:25.041643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:25.041643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:25.041643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:25.041643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:25.041643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:25.041643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:25.041643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:25.041643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:25.041643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:25.041643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:25.041643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:25.041643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:25.042538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:25.042538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:25.042538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:25.042538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:25.042538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:25.042538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:25.042538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:25.042538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:25.042538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:25.042538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:25.042538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:25.042538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:25.042538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 310/618] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:25.048156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6748f-e283-403b-bda8-8688848d2be1 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:25.094931 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:25.140968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:25.169812 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d6748f-e283-403b-bda8-8688848d2be1 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:25.182651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec9b00a-6ac7-4d5e-929a-135b7771f76d None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:25.207353 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb0e51-2d5b-4233-93a4-f90b0f254ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:25.208391 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb0e51-2d5b-4233-93a4-f90b0f254ed8 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:25.208878 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb0e51-2d5b-4233-93a4-f90b0f254ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:25.209426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb0e51-2d5b-4233-93a4-f90b0f254ed8 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:25.210418 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb0e51-2d5b-4233-93a4-f90b0f254ed8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:25.210979 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb0e51-2d5b-4233-93a4-f90b0f254ed8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:25.212589 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb0e51-2d5b-4233-93a4-f90b0f254ed8 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:25.221997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 311/619] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:36:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:25.228069 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb0e51-2d5b-4233-93a4-f90b0f254ed8 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:25.249757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c526e-0a89-4b43-b8ff-618d34e0166c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:25.250448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c526e-0a89-4b43-b8ff-618d34e0166c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:25.250737 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c526e-0a89-4b43-b8ff-618d34e0166c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:25.251016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c526e-0a89-4b43-b8ff-618d34e0166c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:25.261410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c526e-0a89-4b43-b8ff-618d34e0166c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:25.262900 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c526e-0a89-4b43-b8ff-618d34e0166c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:25.278045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-696c526e-0a89-4b43-b8ff-618d34e0166c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:25.278045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:25.278045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:25.278045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:25.278045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:25.278045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:25.278045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:25.278045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:25.278045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:25.278045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:25.278045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:25.278045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:25.278045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:25.278045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:25.278045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:25.279187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:25.279187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:25.279187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:25.279187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:25.279187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:25.279187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:25.279187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:25.279187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:25.279187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:25.279187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:25.279187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:25.279187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:25.279187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:25.279187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:25.279187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:25.279187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:25.279187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:25.280106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:25.280106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:25.280106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:25.280106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:25.280106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 309/620] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:25.280868 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2281523-059f-43fe-805f-32b126c3a116 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:25.281113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2281523-059f-43fe-805f-32b126c3a116 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:25.281399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2281523-059f-43fe-805f-32b126c3a116 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:25.282966 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 310/621] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:25.289069 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b548e-ae48-465c-905c-1a59193fb98f None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:25.289900 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b548e-ae48-465c-905c-1a59193fb98f None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:25.290177 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b548e-ae48-465c-905c-1a59193fb98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:25.309273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-467b548e-ae48-465c-905c-1a59193fb98f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:25.310874 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-467b548e-ae48-465c-905c-1a59193fb98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:25.347950 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb0e51-2d5b-4233-93a4-f90b0f254ed8 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:25.384805 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15c3bf-917d-4be8-be50-ed6ffa419d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:25.386024 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15c3bf-917d-4be8-be50-ed6ffa419d09 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:25.386551 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15c3bf-917d-4be8-be50-ed6ffa419d09 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:25.387087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d15c3bf-917d-4be8-be50-ed6ffa419d09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:25.390302 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:25.402423 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 311/622] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:25.403624 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b548e-ae48-465c-905c-1a59193fb98f None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:25.409208 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15c3bf-917d-4be8-be50-ed6ffa419d09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:25.410991 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d15c3bf-917d-4be8-be50-ed6ffa419d09 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:25.435945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-6d15c3bf-917d-4be8-be50-ed6ffa419d09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:25.435945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:25.435945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:25.435945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:25.435945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:25.435945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:25.435945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:25.435945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:25.435945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:25.435945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:25.435945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:25.435945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:25.435945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:25.435945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:25.435945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:25.436908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:25.436908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:25.436908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:25.436908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:25.436908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:25.436908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:25.436908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:25.436908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:25.436908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:25.436908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:25.436908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:25.436908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:25.436908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:25.436908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:25.436908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:25.436908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:25.436908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:25.437822 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:25.437822 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:25.437822 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:25.437822 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:25.440116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 312/623] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:25.441123 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15c3bf-917d-4be8-be50-ed6ffa419d09 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:25.467648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:25.535033 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b548e-ae48-465c-905c-1a59193fb98f None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:25.562271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d15c3bf-917d-4be8-be50-ed6ffa419d09 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:25.583937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ddcad-c240-45ad-bd41-c2bb103f64c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:25.584895 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ddcad-c240-45ad-bd41-c2bb103f64c4 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:25.585381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ddcad-c240-45ad-bd41-c2bb103f64c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:25.585858 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ddcad-c240-45ad-bd41-c2bb103f64c4 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:25.587715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ddcad-c240-45ad-bd41-c2bb103f64c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:25.588226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ddcad-c240-45ad-bd41-c2bb103f64c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:25.589784 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ddcad-c240-45ad-bd41-c2bb103f64c4 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:25.604646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d0fc6-afe2-48a3-8c39-2128220cb31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:25.605345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d0fc6-afe2-48a3-8c39-2128220cb31a None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:25.605630 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d0fc6-afe2-48a3-8c39-2128220cb31a None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:25.605905 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d0fc6-afe2-48a3-8c39-2128220cb31a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:25.607458 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 312/624] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:25.608508 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ddcad-c240-45ad-bd41-c2bb103f64c4 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:25.624397 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d0fc6-afe2-48a3-8c39-2128220cb31a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:25.631534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-974d0fc6-afe2-48a3-8c39-2128220cb31a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:25.631534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:25.631534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:25.631534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:25.631534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:25.631534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:25.631534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:25.631534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:25.631534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:25.631534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:25.631534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:25.631534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:25.631534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:25.631534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:25.631534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:25.631534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:25.632456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:25.632456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:25.632456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:25.632456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:25.632456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:25.632456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:25.632456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:25.632456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:25.632456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:25.632456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:25.632456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:25.632456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:25.632456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:25.632456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:25.632456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:25.632456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:25.633355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:25.633355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:25.633355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:25.633355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:25.633355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:25.633355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:25.633355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:25.633355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:25.633355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:25.633355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:25.633355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:25.633355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:25.638061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 313/625] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:25.638943 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d0fc6-afe2-48a3-8c39-2128220cb31a None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:25.700104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:25.733157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ddcad-c240-45ad-bd41-c2bb103f64c4 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:25.735219 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:25.770384 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d0fc6-afe2-48a3-8c39-2128220cb31a None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:25.771533 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83192cdc-b06e-4120-9200-451a9582b18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:25.772512 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83192cdc-b06e-4120-9200-451a9582b18b None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:25.773021 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83192cdc-b06e-4120-9200-451a9582b18b None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:25.773498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83192cdc-b06e-4120-9200-451a9582b18b None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:25.774958 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83192cdc-b06e-4120-9200-451a9582b18b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:25.775471 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83192cdc-b06e-4120-9200-451a9582b18b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:25.777034 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83192cdc-b06e-4120-9200-451a9582b18b None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:25.790475 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 313/626] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:25.791641 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83192cdc-b06e-4120-9200-451a9582b18b None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:25.809946 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb3748-3fe5-44c1-b617-a06c8022fda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:25.810631 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb3748-3fe5-44c1-b617-a06c8022fda0 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:25.810915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb3748-3fe5-44c1-b617-a06c8022fda0 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:25.811190 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb3748-3fe5-44c1-b617-a06c8022fda0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:25.819671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb3748-3fe5-44c1-b617-a06c8022fda0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:25.822014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb3748-3fe5-44c1-b617-a06c8022fda0 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:25.838849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-c0bb3748-3fe5-44c1-b617-a06c8022fda0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:25.838849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:25.838849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:25.838849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:25.838849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:25.838849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:25.838849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:25.838849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:25.838849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:25.838849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:25.838849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:25.838849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:25.838849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:25.838849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:25.838849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:25.839828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:25.839828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:25.839828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:25.839828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:25.839828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:25.839828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:25.839828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:25.839828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:25.839828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:25.839828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:25.839828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:25.839828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:25.839828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:25.839828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:25.839828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:25.839828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:25.839828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:25.840723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:25.840723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:25.840723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:25.840723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:25.840723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:25.840723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:25.840723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:25.840723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:25.845187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 314/627] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:25.846152 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb3748-3fe5-44c1-b617-a06c8022fda0 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:25.911381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83192cdc-b06e-4120-9200-451a9582b18b None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:25.948112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bcef4-5926-4f86-aa7a-4743ce0d2a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:25.948732 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bcef4-5926-4f86-aa7a-4743ce0d2a6d None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:25.949017 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bcef4-5926-4f86-aa7a-4743ce0d2a6d None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:25.949118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb3748-3fe5-44c1-b617-a06c8022fda0 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:25.949301 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032bcef4-5926-4f86-aa7a-4743ce0d2a6d None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:25.949998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032bcef4-5926-4f86-aa7a-4743ce0d2a6d None admin] RBAC: Adding query filter params (name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:25.950305 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032bcef4-5926-4f86-aa7a-4743ce0d2a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:25.952195 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032bcef4-5926-4f86-aa7a-4743ce0d2a6d None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:25.958765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:25.967151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 314/628] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:36:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:25.967151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bcef4-5926-4f86-aa7a-4743ce0d2a6d None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:25.988748 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaff78c-f271-41b0-a2f5-93b923129034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:25.989386 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaff78c-f271-41b0-a2f5-93b923129034 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:25.989666 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaff78c-f271-41b0-a2f5-93b923129034 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:25.989943 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaff78c-f271-41b0-a2f5-93b923129034 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:25.991998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:25.999073 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaff78c-f271-41b0-a2f5-93b923129034 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:26.000511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaff78c-f271-41b0-a2f5-93b923129034 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:26.012915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-deaff78c-f271-41b0-a2f5-93b923129034 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 22:36:26.012915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:26.012915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:26.012915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:26.012915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:26.012915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:26.012915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:26.012915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:26.012915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:26.012915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:26.012915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:26.012915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:26.012915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:26.012915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:26.012915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:26.012915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:26.013881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:26.013881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:26.013881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:26.013881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:26.013881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:26.013881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:26.013881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:26.013881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:26.013881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:26.013881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:26.013881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:26.013881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:26.013881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:26.013881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:26.013881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:26.013881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:26.013881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:26.013881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:26.015335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:26.015335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:26.015335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:26.015335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:26.015335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:26.015335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:26.015335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:26.015335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:26.015335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 22:36:26.015335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:26.015335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 315/629] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:36:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:26.015335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae796f-9e57-448d-9da5-a3b72c5cb08f None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:26.016001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae796f-9e57-448d-9da5-a3b72c5cb08f None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:26.016001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae796f-9e57-448d-9da5-a3b72c5cb08f None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:26.021179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 316/630] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:26.021179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae796f-9e57-448d-9da5-a3b72c5cb08f None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:26.079059 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032bcef4-5926-4f86-aa7a-4743ce0d2a6d None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:26.114626 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffbc88-b344-4930-a84a-9bc5f3c06529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:26.115241 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffbc88-b344-4930-a84a-9bc5f3c06529 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:26.115524 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffbc88-b344-4930-a84a-9bc5f3c06529 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:26.115800 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffffbc88-b344-4930-a84a-9bc5f3c06529 None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:26.116538 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffbc88-b344-4930-a84a-9bc5f3c06529 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:26.116845 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffbc88-b344-4930-a84a-9bc5f3c06529 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:26.118292 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffffbc88-b344-4930-a84a-9bc5f3c06529 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:26.127740 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae796f-9e57-448d-9da5-a3b72c5cb08f None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:26.134371 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 315/631] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:26.134371 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffbc88-b344-4930-a84a-9bc5f3c06529 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:26.166246 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f303346f-2c8a-4086-9501-43c71ea6bedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:26.166911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303346f-2c8a-4086-9501-43c71ea6bedb None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:26.167192 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303346f-2c8a-4086-9501-43c71ea6bedb None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:26.167464 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f303346f-2c8a-4086-9501-43c71ea6bedb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:26.177748 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303346f-2c8a-4086-9501-43c71ea6bedb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:26.179207 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f303346f-2c8a-4086-9501-43c71ea6bedb None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:26.193161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-f303346f-2c8a-4086-9501-43c71ea6bedb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:26.193161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:26.193161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:26.193161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:26.193161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:26.193161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:26.193161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:26.193161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:26.193161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:26.193161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:26.193161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:26.193161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:26.193161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:26.193161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:26.193161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:26.194084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:26.194084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:26.194084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:26.194084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:26.194084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:26.194084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:26.194084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:26.194084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:26.194084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:26.194084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:26.194084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:26.194084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:26.194084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:26.194084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:26.194084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:26.194084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:26.194084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:26.195241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:26.195241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:26.195241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:26.195241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:26.195241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 317/632] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:26.195856 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d089c-fc5c-48bd-a6c2-c92633cb3ec9 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:26.195856 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d089c-fc5c-48bd-a6c2-c92633cb3ec9 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:26.196054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5d089c-fc5c-48bd-a6c2-c92633cb3ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:26.214055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-ee5d089c-fc5c-48bd-a6c2-c92633cb3ec9 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:26.215272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ee5d089c-fc5c-48bd-a6c2-c92633cb3ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:26.229501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:26.229677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:26.250016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffffbc88-b344-4930-a84a-9bc5f3c06529 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:26.285323 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b642c7-628e-47f5-b6ef-aaad0086405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:26.285944 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b642c7-628e-47f5-b6ef-aaad0086405c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:26.286240 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b642c7-628e-47f5-b6ef-aaad0086405c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:26.286555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b642c7-628e-47f5-b6ef-aaad0086405c None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:26.287353 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b642c7-628e-47f5-b6ef-aaad0086405c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:26.287663 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b642c7-628e-47f5-b6ef-aaad0086405c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:26.289082 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b642c7-628e-47f5-b6ef-aaad0086405c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:26.292120 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 318/633] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:26.292707 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d089c-fc5c-48bd-a6c2-c92633cb3ec9 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:26.323173 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 316/634] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Jul 27 22:36:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:26.324060 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b642c7-628e-47f5-b6ef-aaad0086405c None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:26.400579 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5d089c-fc5c-48bd-a6c2-c92633cb3ec9 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:26.435077 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b642c7-628e-47f5-b6ef-aaad0086405c None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:26.439333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f2cc7-62e1-4482-95bf-24b8c9db87a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:26.440013 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f2cc7-62e1-4482-95bf-24b8c9db87a0 None admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:26.440294 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f2cc7-62e1-4482-95bf-24b8c9db87a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:26.440569 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f2cc7-62e1-4482-95bf-24b8c9db87a0 None admin] PATH_INFO: `/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/baf405258b9d413fae1192e10250b6a3/roles/7b21a72e7f9348d28d60c78cb0853af7` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:26.456868 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f2cc7-62e1-4482-95bf-24b8c9db87a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user_id=baf405258b9d413fae1192e10250b6a3, role_id=7b21a72e7f9348d28d60c78cb0853af7)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:26.458463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f2cc7-62e1-4482-95bf-24b8c9db87a0 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:26.468663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:26.482378 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 319/635] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:36:26 2022] PUT /identity/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/baf405258b9d413fae1192e10250b6a3/roles/7b21a72e7f9348d28d60c78cb0853af7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:36:26.484547 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f2cc7-62e1-4482-95bf-24b8c9db87a0 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:26.490196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc5b51-83fc-4c7c-81d4-e73f3870a202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:26.491028 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc5b51-83fc-4c7c-81d4-e73f3870a202 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:26.491394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc5b51-83fc-4c7c-81d4-e73f3870a202 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:26.491792 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc5b51-83fc-4c7c-81d4-e73f3870a202 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:26.492801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc5b51-83fc-4c7c-81d4-e73f3870a202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:26.493128 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc5b51-83fc-4c7c-81d4-e73f3870a202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:26.494617 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc5b51-83fc-4c7c-81d4-e73f3870a202 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:26.513202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 317/636] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:26.514882 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc5b51-83fc-4c7c-81d4-e73f3870a202 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:26.519199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:26.620029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f2cc7-62e1-4482-95bf-24b8c9db87a0 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:26.662784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d073e62-2e16-4c52-b3e4-0e523c081a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:26.663911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d073e62-2e16-4c52-b3e4-0e523c081a3e None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:26.663911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d073e62-2e16-4c52-b3e4-0e523c081a3e None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:26.663911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d073e62-2e16-4c52-b3e4-0e523c081a3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:26.671421 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc5b51-83fc-4c7c-81d4-e73f3870a202 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:26.676390 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d073e62-2e16-4c52-b3e4-0e523c081a3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:26.680758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-7d073e62-2e16-4c52-b3e4-0e523c081a3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:26.680758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:26.680758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:26.680758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:26.680758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:26.680758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:26.680758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:26.680758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:26.680758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:26.680758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:26.680758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:26.680758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:26.680758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:26.680758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:26.680758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:26.680758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:26.681725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:26.681725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:26.681725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:26.681725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:26.681725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:26.681725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:26.681725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:26.681725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:26.681725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:26.681725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:26.681725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:26.681725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:26.681725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:26.681725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:26.681725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:26.681725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:26.683029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:26.683029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:26.683029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:26.683029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:26.683029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:26.683029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:26.683029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:26.683029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:26.683029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:26.683029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:26.683029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:26.683029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:26.683029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 320/637] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:26.684288 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d073e62-2e16-4c52-b3e4-0e523c081a3e None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:26.721635 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60330d7-42dd-4b27-913d-52810125b9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:26.722271 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60330d7-42dd-4b27-913d-52810125b9ed None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:26.722596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60330d7-42dd-4b27-913d-52810125b9ed None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:26.722874 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60330d7-42dd-4b27-913d-52810125b9ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:26.766794 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:26.798255 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d073e62-2e16-4c52-b3e4-0e523c081a3e None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:26.810817 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60330d7-42dd-4b27-913d-52810125b9ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:26.812260 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60330d7-42dd-4b27-913d-52810125b9ed None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:26.814230 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:26.836012 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b29a1a-2275-405e-bc72-ea5f50b5cc74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:26.837223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b29a1a-2275-405e-bc72-ea5f50b5cc74 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:26.837508 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b29a1a-2275-405e-bc72-ea5f50b5cc74 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:26.837789 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b29a1a-2275-405e-bc72-ea5f50b5cc74 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:26.845206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b29a1a-2275-405e-bc72-ea5f50b5cc74 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:26.846692 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b29a1a-2275-405e-bc72-ea5f50b5cc74 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:26.859009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-c3b29a1a-2275-405e-bc72-ea5f50b5cc74 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 22:36:26.859009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:26.859009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:26.859009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:26.859009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:26.859009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:26.859009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:26.859009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:26.859009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:26.859009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:26.859009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:26.859009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:26.859009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:26.859009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:26.859009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:26.859009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:26.860009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:26.860009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:26.860009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:26.860009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:26.860009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:26.860009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:26.860009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:26.860009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:26.860009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:26.860009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:26.860009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:26.860009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:26.860009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:26.860009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:26.860009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:26.860009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:26.860009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:26.860009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:26.860964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:26.860964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:26.860964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:26.860964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:26.860964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:26.860964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:26.860964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:26.860964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:26.860964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 22:36:26.860964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:26.860964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 321/638] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:36:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:26.861598 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b29a1a-2275-405e-bc72-ea5f50b5cc74 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:26.924142 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 318/639] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:36:26.925741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856c95e-d31f-435e-88f9-60be6d404aa3 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:26.926254 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856c95e-d31f-435e-88f9-60be6d404aa3 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:26.926781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856c95e-d31f-435e-88f9-60be6d404aa3 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:26.928237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 319/640] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:26.929144 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856c95e-d31f-435e-88f9-60be6d404aa3 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:26.981561 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b29a1a-2275-405e-bc72-ea5f50b5cc74 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:27.003621 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:27.018814 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9aeb6e-e90f-4118-aa7d-626defa604b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:27.019443 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9aeb6e-e90f-4118-aa7d-626defa604b7 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:27.019732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9aeb6e-e90f-4118-aa7d-626defa604b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:27.020013 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9aeb6e-e90f-4118-aa7d-626defa604b7 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:27.020732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9aeb6e-e90f-4118-aa7d-626defa604b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:27.021045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9aeb6e-e90f-4118-aa7d-626defa604b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:27.022442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9aeb6e-e90f-4118-aa7d-626defa604b7 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:27.033620 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 322/641] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:36:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:27.034666 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9aeb6e-e90f-4118-aa7d-626defa604b7 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:27.042750 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856c95e-d31f-435e-88f9-60be6d404aa3 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:27.044855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:27.081031 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319caf40-af87-4cb5-a551-1d5662866989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:27.081719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319caf40-af87-4cb5-a551-1d5662866989 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:27.081943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319caf40-af87-4cb5-a551-1d5662866989 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:27.082220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319caf40-af87-4cb5-a551-1d5662866989 None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:27.083048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319caf40-af87-4cb5-a551-1d5662866989 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:27.083363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319caf40-af87-4cb5-a551-1d5662866989 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:27.084798 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319caf40-af87-4cb5-a551-1d5662866989 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:27.103809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 320/642] 10.222.0.48 () {56 vars in 1137 bytes} [Wed Jul 27 22:36:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:27.107966 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dafa8-b92f-46c6-88e1-f13305e3f2c3 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:27.108446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dafa8-b92f-46c6-88e1-f13305e3f2c3 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:27.108968 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dafa8-b92f-46c6-88e1-f13305e3f2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:27.127733 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-101dafa8-b92f-46c6-88e1-f13305e3f2c3 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:27.128916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-101dafa8-b92f-46c6-88e1-f13305e3f2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:27.139935 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9aeb6e-e90f-4118-aa7d-626defa604b7 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:27.177651 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0fc03-0877-474b-be73-620f0ce7eb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:27.178226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0fc03-0877-474b-be73-620f0ce7eb6d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:27.178534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0fc03-0877-474b-be73-620f0ce7eb6d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:27.179008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea0fc03-0877-474b-be73-620f0ce7eb6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:27.190328 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0fc03-0877-474b-be73-620f0ce7eb6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:27.192759 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea0fc03-0877-474b-be73-620f0ce7eb6d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:27.198645 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 321/643] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:27.199583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dafa8-b92f-46c6-88e1-f13305e3f2c3 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:27.216747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-fea0fc03-0877-474b-be73-620f0ce7eb6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:27.216747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:27.216747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:27.216747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:27.216747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:27.216747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:27.216747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:27.216747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:27.216747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:27.216747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:27.216747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:27.216747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:27.216747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:27.216747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:27.216747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:27.217744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:27.217744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:27.217744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:27.217744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:27.217744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:27.217744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:27.217744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:27.217744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:27.217744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:27.217744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:27.217744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:27.217744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:27.217744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:27.217744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:27.217744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:27.217744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:27.217744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:27.223941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:27.223941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:27.223941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:27.223941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:27.223941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 323/644] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:27.223941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0fc03-0877-474b-be73-620f0ce7eb6d None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:27.258985 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:27.306046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:27.316252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dafa8-b92f-46c6-88e1-f13305e3f2c3 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:27.332070 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea0fc03-0877-474b-be73-620f0ce7eb6d None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:27.356214 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea3291-0aba-47aa-9fdc-b3a28c9ab6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:27.356861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea3291-0aba-47aa-9fdc-b3a28c9ab6f6 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:27.357148 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea3291-0aba-47aa-9fdc-b3a28c9ab6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:27.357428 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea3291-0aba-47aa-9fdc-b3a28c9ab6f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:27.366898 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6d2e5-9ad9-4a7b-96fc-e96855a56e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:27.367504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6d2e5-9ad9-4a7b-96fc-e96855a56e38 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:27.367783 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6d2e5-9ad9-4a7b-96fc-e96855a56e38 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:27.367949 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea3291-0aba-47aa-9fdc-b3a28c9ab6f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:27.368046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6d2e5-9ad9-4a7b-96fc-e96855a56e38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:27.369341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea3291-0aba-47aa-9fdc-b3a28c9ab6f6 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:27.384374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-b6ea3291-0aba-47aa-9fdc-b3a28c9ab6f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:27.384374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:27.384374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:27.384374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:27.384374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:27.384374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:27.384374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:27.384374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:27.384374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:27.384374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:27.384374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:27.384374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:27.384374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:27.384374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:27.384374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:27.385441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:27.385441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:27.385441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:27.385441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:27.385441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:27.385441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:27.385441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:27.385441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:27.385441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:27.385441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:27.385441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:27.385441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:27.385441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:27.385441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:27.385441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:27.385441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:27.385441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:27.386716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:27.386716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:27.386716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:27.386716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:27.386716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 322/645] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:27.386716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea3291-0aba-47aa-9fdc-b3a28c9ab6f6 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:27.446264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6d2e5-9ad9-4a7b-96fc-e96855a56e38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:27.447673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6d2e5-9ad9-4a7b-96fc-e96855a56e38 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:27.481302 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:27.493654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea3291-0aba-47aa-9fdc-b3a28c9ab6f6 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:27.529686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7250c-9a59-4fad-95d9-6d073ac0f0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:27.530667 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7250c-9a59-4fad-95d9-6d073ac0f0e8 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:27.530937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7250c-9a59-4fad-95d9-6d073ac0f0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:27.531210 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7250c-9a59-4fad-95d9-6d073ac0f0e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:27.542772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7250c-9a59-4fad-95d9-6d073ac0f0e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:27.548741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-a2b7250c-9a59-4fad-95d9-6d073ac0f0e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:27.548741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:27.548741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:27.548741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:27.548741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:27.548741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:27.548741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:27.548741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:27.548741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:27.548741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:27.548741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:27.548741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:27.548741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:27.548741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:27.548741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:27.548741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:27.549675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:27.549675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:27.549675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:27.549675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:27.549675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:27.549675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:27.549675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:27.549675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:27.549675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:27.549675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:27.549675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:27.549675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:27.549675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:27.549675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:27.549675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:27.549675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:27.550552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:27.550552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:27.550552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:27.550552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:27.550552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:27.550552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:27.550552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:27.550552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:27.550552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:27.550552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:27.550552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:27.550552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:27.550552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 323/646] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:27.551262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7250c-9a59-4fad-95d9-6d073ac0f0e8 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:27.553922 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:27.561678 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 324/647] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:36:27.561678 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6d2e5-9ad9-4a7b-96fc-e96855a56e38 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:27.665816 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6d2e5-9ad9-4a7b-96fc-e96855a56e38 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:27.669520 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7250c-9a59-4fad-95d9-6d073ac0f0e8 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:27.702399 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1d2ba-8f63-4a45-b077-77b353d51f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:27.702967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1d2ba-8f63-4a45-b077-77b353d51f8c None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:27.703247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1d2ba-8f63-4a45-b077-77b353d51f8c None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:27.703520 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1d2ba-8f63-4a45-b077-77b353d51f8c None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:27.704200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1d2ba-8f63-4a45-b077-77b353d51f8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:27.704504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1d2ba-8f63-4a45-b077-77b353d51f8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:27.705275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae6147-7890-4da6-9805-2a3b472f431e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:27.705866 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1d2ba-8f63-4a45-b077-77b353d51f8c None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:27.706580 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae6147-7890-4da6-9805-2a3b472f431e None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:27.707013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae6147-7890-4da6-9805-2a3b472f431e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:27.707441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eae6147-7890-4da6-9805-2a3b472f431e None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:27.707566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:27.708143 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae6147-7890-4da6-9805-2a3b472f431e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:27.708471 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae6147-7890-4da6-9805-2a3b472f431e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:27.709887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eae6147-7890-4da6-9805-2a3b472f431e None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:27.723117 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 325/648] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:27.723117 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1d2ba-8f63-4a45-b077-77b353d51f8c None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:27.731306 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 324/649] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:27.731306 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae6147-7890-4da6-9805-2a3b472f431e None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:27.792008 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:27.832665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1d2ba-8f63-4a45-b077-77b353d51f8c None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:27.839344 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eae6147-7890-4da6-9805-2a3b472f431e None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:27.866718 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb63713-0c58-4f8d-8e3f-b17b7229a45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:27.867822 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb63713-0c58-4f8d-8e3f-b17b7229a45d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:27.868108 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb63713-0c58-4f8d-8e3f-b17b7229a45d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:27.868387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb63713-0c58-4f8d-8e3f-b17b7229a45d None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:27.869103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb63713-0c58-4f8d-8e3f-b17b7229a45d None admin] RBAC: Adding query filter params (name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:27.869422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb63713-0c58-4f8d-8e3f-b17b7229a45d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:27.870802 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb63713-0c58-4f8d-8e3f-b17b7229a45d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:27.877674 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb81a26-cb35-4842-9f96-0b4e9666ec65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:27.878580 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb81a26-cb35-4842-9f96-0b4e9666ec65 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:27.878691 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 326/650] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:36:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:27.879155 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb81a26-cb35-4842-9f96-0b4e9666ec65 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:27.879455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb63713-0c58-4f8d-8e3f-b17b7229a45d None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:27.879805 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb81a26-cb35-4842-9f96-0b4e9666ec65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:27.895596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb81a26-cb35-4842-9f96-0b4e9666ec65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:27.897034 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb81a26-cb35-4842-9f96-0b4e9666ec65 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:27.911886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-0eb81a26-cb35-4842-9f96-0b4e9666ec65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:27.911886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:27.911886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:27.911886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:27.911886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:27.911886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:27.911886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:27.911886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:27.911886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:27.911886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:27.911886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:27.911886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:27.911886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:27.911886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:27.911886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:27.912775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:27.912775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:27.912775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:27.912775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:27.912775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:27.912775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:27.912775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:27.912775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:27.912775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:27.912775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:27.912775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:27.912775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:27.912775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:27.912775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:27.912775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:27.912775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:27.912775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:27.913657 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:27.913657 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:27.913657 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:27.913657 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:27.913657 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 325/651] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:27.913942 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb81a26-cb35-4842-9f96-0b4e9666ec65 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:27.944917 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:27.992385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb63713-0c58-4f8d-8e3f-b17b7229a45d None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:28.022908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb81a26-cb35-4842-9f96-0b4e9666ec65 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:28.028895 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a144c27-f7ee-4b47-961e-38cf60630b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:28.029551 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a144c27-f7ee-4b47-961e-38cf60630b44 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:28.029839 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a144c27-f7ee-4b47-961e-38cf60630b44 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:28.030125 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a144c27-f7ee-4b47-961e-38cf60630b44 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:28.037330 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:28.038561 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a144c27-f7ee-4b47-961e-38cf60630b44 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:28.040601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a144c27-f7ee-4b47-961e-38cf60630b44 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:28.054230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-8a144c27-f7ee-4b47-961e-38cf60630b44 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 22:36:28.054230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:28.054230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:28.054230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:28.054230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:28.054230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:28.054230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:28.054230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:28.054230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:28.054230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:28.054230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:28.054230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:28.054230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:28.054230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:28.054230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:28.054230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:28.055820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:28.055820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:28.055820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:28.055820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:28.055820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:28.055820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:28.055820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:28.055820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:28.055820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:28.055820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:28.055820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:28.055820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:28.055820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:28.055820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:28.055820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:28.055820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:28.055820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:28.055820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:28.056760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:28.056760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:28.056760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:28.056760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:28.056760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:28.056760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:28.056760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:28.056760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:28.056760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 22:36:28.056760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:28.056760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 327/652] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jul 27 22:36:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:28.057365 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a144c27-f7ee-4b47-961e-38cf60630b44 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:28.065675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882da57d-8afb-40d6-9418-8a68d528818e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:28.066327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882da57d-8afb-40d6-9418-8a68d528818e None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:28.066640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882da57d-8afb-40d6-9418-8a68d528818e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:28.066916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882da57d-8afb-40d6-9418-8a68d528818e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:28.073895 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882da57d-8afb-40d6-9418-8a68d528818e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:28.075369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882da57d-8afb-40d6-9418-8a68d528818e None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:28.087686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-882da57d-8afb-40d6-9418-8a68d528818e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:28.087686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:28.087686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:28.087686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:28.087686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:28.087686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:28.087686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:28.087686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:28.087686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:28.087686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:28.087686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:28.087686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:28.087686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:28.087686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:28.087686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:28.088680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:28.088680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:28.088680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:28.088680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:28.088680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:28.088680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:28.088680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:28.088680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:28.088680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:28.088680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:28.088680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:28.088680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:28.088680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:28.088680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:28.088680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:28.088680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:28.088680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:28.089597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:28.089597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:28.089597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:28.089597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:28.089597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:28.089597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:28.089597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:28.089597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:28.089597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 326/653] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:28.089597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882da57d-8afb-40d6-9418-8a68d528818e None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:28.166957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a144c27-f7ee-4b47-961e-38cf60630b44 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:28.184148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:28.194710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882da57d-8afb-40d6-9418-8a68d528818e None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:28.202732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440991f-9a03-453f-abed-c5ed024ad07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:28.203388 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440991f-9a03-453f-abed-c5ed024ad07a None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:28.203674 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440991f-9a03-453f-abed-c5ed024ad07a None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:28.203952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a440991f-9a03-453f-abed-c5ed024ad07a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:28.214993 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440991f-9a03-453f-abed-c5ed024ad07a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:28.216451 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a440991f-9a03-453f-abed-c5ed024ad07a None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:28.231668 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6753c06-1d70-4eb2-8f7a-4ca8d2f34c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:28.232296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6753c06-1d70-4eb2-8f7a-4ca8d2f34c9c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:28.232583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6753c06-1d70-4eb2-8f7a-4ca8d2f34c9c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:28.232866 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6753c06-1d70-4eb2-8f7a-4ca8d2f34c9c None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:28.233256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-a440991f-9a03-453f-abed-c5ed024ad07a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:28.233256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:28.233256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:28.233256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:28.233256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:28.233256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:28.233256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:28.233256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:28.233256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:28.233256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:28.233256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:28.233256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:28.233256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:28.233256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:28.233256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:28.234135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:28.234135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:28.234135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:28.234135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:28.234135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:28.234135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:28.234135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:28.234135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:28.234135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:28.234135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:28.234135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:28.234135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:28.234135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:28.234135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:28.234135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:28.234135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:28.234135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:28.235372 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:28.235372 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:28.235372 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:28.235372 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:28.235605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6753c06-1d70-4eb2-8f7a-4ca8d2f34c9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:28.235605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6753c06-1d70-4eb2-8f7a-4ca8d2f34c9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:28.235742 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 328/654] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:28.235742 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440991f-9a03-453f-abed-c5ed024ad07a None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:28.239616 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6753c06-1d70-4eb2-8f7a-4ca8d2f34c9c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:28.258051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 327/655] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:28.258051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6753c06-1d70-4eb2-8f7a-4ca8d2f34c9c None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:28.291349 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:28.348588 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a440991f-9a03-453f-abed-c5ed024ad07a None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:28.365276 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6753c06-1d70-4eb2-8f7a-4ca8d2f34c9c None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:28.388140 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d44c64-4639-4710-9285-64a3c30626c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:28.388762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d44c64-4639-4710-9285-64a3c30626c2 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:28.389071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d44c64-4639-4710-9285-64a3c30626c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:28.389468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d44c64-4639-4710-9285-64a3c30626c2 None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:28.390212 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d44c64-4639-4710-9285-64a3c30626c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:28.390556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d44c64-4639-4710-9285-64a3c30626c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:28.392001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d44c64-4639-4710-9285-64a3c30626c2 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:28.402187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a636c-5c51-4756-ba03-dcee41641c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:28.402834 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a636c-5c51-4756-ba03-dcee41641c6d None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:28.403131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a636c-5c51-4756-ba03-dcee41641c6d None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:28.403399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a636c-5c51-4756-ba03-dcee41641c6d None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:28.404151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a636c-5c51-4756-ba03-dcee41641c6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:28.404465 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a636c-5c51-4756-ba03-dcee41641c6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:28.405893 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a636c-5c51-4756-ba03-dcee41641c6d None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:28.414983 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 329/656] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jul 27 22:36:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:28.414983 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d44c64-4639-4710-9285-64a3c30626c2 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:28.420923 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 328/657] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:28.425734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a636c-5c51-4756-ba03-dcee41641c6d None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:28.447042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:28.525673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d44c64-4639-4710-9285-64a3c30626c2 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:28.527406 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:28.534502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a636c-5c51-4756-ba03-dcee41641c6d None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:28.559723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fc662-7ac8-4fad-809d-9eafc83e4903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:28.560331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fc662-7ac8-4fad-809d-9eafc83e4903 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:28.560610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fc662-7ac8-4fad-809d-9eafc83e4903 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:28.560883 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fc662-7ac8-4fad-809d-9eafc83e4903 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:28.561556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fc662-7ac8-4fad-809d-9eafc83e4903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:28.561855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fc662-7ac8-4fad-809d-9eafc83e4903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:28.563238 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863fc662-7ac8-4fad-809d-9eafc83e4903 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:28.567265 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06495fd9-7dc3-46b7-b94c-74c7ca21359e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:28.567901 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06495fd9-7dc3-46b7-b94c-74c7ca21359e None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:28.568186 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06495fd9-7dc3-46b7-b94c-74c7ca21359e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:28.568462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06495fd9-7dc3-46b7-b94c-74c7ca21359e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:28.575438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 330/658] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:28.575983 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fc662-7ac8-4fad-809d-9eafc83e4903 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:28.580470 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06495fd9-7dc3-46b7-b94c-74c7ca21359e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:28.581925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06495fd9-7dc3-46b7-b94c-74c7ca21359e None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:28.593583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-06495fd9-7dc3-46b7-b94c-74c7ca21359e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:28.593583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:28.593583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:28.593583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:28.593583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:28.593583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:28.593583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:28.593583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:28.593583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:28.593583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:28.593583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:28.593583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:28.593583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:28.593583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:28.593583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:28.594531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:28.594531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:28.594531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:28.594531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:28.594531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:28.594531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:28.594531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:28.594531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:28.594531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:28.594531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:28.594531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:28.594531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:28.594531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:28.594531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:28.594531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:28.594531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:28.594531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:28.595443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:28.595443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:28.595443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:28.595443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:28.595443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:28.595443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:28.595443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:28.595443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:28.595443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 329/659] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:28.597203 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06495fd9-7dc3-46b7-b94c-74c7ca21359e None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:28.662138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:28.678366 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fc662-7ac8-4fad-809d-9eafc83e4903 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:28.695036 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06495fd9-7dc3-46b7-b94c-74c7ca21359e None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:28.712078 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbc7d6-4579-4822-8184-c0449953b863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:28.712692 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbc7d6-4579-4822-8184-c0449953b863 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:28.712973 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbc7d6-4579-4822-8184-c0449953b863 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:28.713248 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbc7d6-4579-4822-8184-c0449953b863 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:28.727927 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0f61b-d0b8-4858-892c-bc476e496c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:28.728547 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0f61b-d0b8-4858-892c-bc476e496c09 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:28.728834 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0f61b-d0b8-4858-892c-bc476e496c09 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:28.729111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0f61b-d0b8-4858-892c-bc476e496c09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:28.729897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0f61b-d0b8-4858-892c-bc476e496c09 None admin] RBAC: Adding query filter params (role.id=7b21a72e7f9348d28d60c78cb0853af7, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=b26c60d08b9f47aca8404e4173290908) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:28.730212 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0f61b-d0b8-4858-892c-bc476e496c09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:28.731671 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d0f61b-d0b8-4858-892c-bc476e496c09 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:28.737324 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 330/660] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:36:28 2022] GET /identity/v3/role_assignments?user.id=b26c60d08b9f47aca8404e4173290908&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=7b21a72e7f9348d28d60c78cb0853af7 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:28.738518 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74792309-c1fd-4e8f-8060-80d7896030a0 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:28.738781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74792309-c1fd-4e8f-8060-80d7896030a0 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:28.739062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74792309-c1fd-4e8f-8060-80d7896030a0 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:28.740260 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 331/661] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:28.740959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74792309-c1fd-4e8f-8060-80d7896030a0 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:28.763139 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:28.795319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbc7d6-4579-4822-8184-c0449953b863 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:28.796712 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdbc7d6-4579-4822-8184-c0449953b863 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:28.859054 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74792309-c1fd-4e8f-8060-80d7896030a0 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:28.888029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:28.899678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87368c0-55f5-4bc0-9a22-070ff9848d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:28.900365 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87368c0-55f5-4bc0-9a22-070ff9848d58 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:28.900652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87368c0-55f5-4bc0-9a22-070ff9848d58 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:28.900928 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87368c0-55f5-4bc0-9a22-070ff9848d58 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:28.909975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87368c0-55f5-4bc0-9a22-070ff9848d58 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:28.911618 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87368c0-55f5-4bc0-9a22-070ff9848d58 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:28.917261 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 331/662] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:36:28.918304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbc7d6-4579-4822-8184-c0449953b863 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:28.925787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-e87368c0-55f5-4bc0-9a22-070ff9848d58 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 22:36:28.925787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:28.925787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:28.925787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:28.925787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:28.925787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:28.925787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:28.925787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:28.925787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:28.925787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:28.925787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:28.925787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:28.925787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:28.925787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:28.925787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:28.925787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:28.932665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:28.932665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:28.932665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:28.932665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:28.932665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:28.932665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:28.932665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:28.932665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:28.932665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:28.932665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:28.932665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:28.932665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:28.932665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:28.932665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:28.932665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:28.932665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:28.932665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:28.932665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:28.933881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:28.933881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:28.933881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:28.933881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:28.933881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:28.933881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:28.933881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:28.933881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:28.933881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 22:36:28.933881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:28.933881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 332/663] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:28.933881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb532e-29e6-4db6-a5b4-a84e5302a6df None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:28.933881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb532e-29e6-4db6-a5b4-a84e5302a6df None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:28.934700 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb532e-29e6-4db6-a5b4-a84e5302a6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:28.953279 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-74cb532e-29e6-4db6-a5b4-a84e5302a6df None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:28.953768 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-74cb532e-29e6-4db6-a5b4-a84e5302a6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:29.030748 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbc7d6-4579-4822-8184-c0449953b863 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:29.034564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 333/664] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:29.034564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb532e-29e6-4db6-a5b4-a84e5302a6df None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:29.045019 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:29.073452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2586dec-bbee-47f8-9b12-c15a8fe89161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:29.074131 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2586dec-bbee-47f8-9b12-c15a8fe89161 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:29.074543 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2586dec-bbee-47f8-9b12-c15a8fe89161 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:29.074889 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2586dec-bbee-47f8-9b12-c15a8fe89161 None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:29.076117 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2586dec-bbee-47f8-9b12-c15a8fe89161 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:29.076117 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2586dec-bbee-47f8-9b12-c15a8fe89161 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:29.077656 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2586dec-bbee-47f8-9b12-c15a8fe89161 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:29.095149 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 332/665] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:29.095149 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2586dec-bbee-47f8-9b12-c15a8fe89161 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:29.140923 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:29.156498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb532e-29e6-4db6-a5b4-a84e5302a6df None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:29.193525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec854d5-26bd-430e-bbe7-85896ded000f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:29.194153 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec854d5-26bd-430e-bbe7-85896ded000f None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:29.194471 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec854d5-26bd-430e-bbe7-85896ded000f None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:29.194755 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec854d5-26bd-430e-bbe7-85896ded000f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:29.196415 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2586dec-bbee-47f8-9b12-c15a8fe89161 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:29.205274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec854d5-26bd-430e-bbe7-85896ded000f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:29.206779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec854d5-26bd-430e-bbe7-85896ded000f None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:29.223137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-6ec854d5-26bd-430e-bbe7-85896ded000f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:29.223137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:29.223137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:29.223137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:29.223137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:29.223137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:29.223137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:29.223137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:29.223137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:29.223137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:29.223137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:29.223137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:29.223137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:29.223137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:29.223137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:29.224117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:29.224117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:29.224117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:29.224117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:29.224117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:29.224117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:29.224117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:29.224117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:29.224117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:29.224117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:29.224117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:29.224117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:29.224117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:29.224117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:29.224117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:29.224117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:29.224117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:29.225772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:29.225772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:29.225772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:29.225772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:29.225772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 334/666] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:29.225772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec854d5-26bd-430e-bbe7-85896ded000f None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:29.238153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152458d-cb29-4a3f-8a69-05d0a45af66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:29.238809 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152458d-cb29-4a3f-8a69-05d0a45af66e None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:29.239099 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152458d-cb29-4a3f-8a69-05d0a45af66e None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:29.239377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9152458d-cb29-4a3f-8a69-05d0a45af66e None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:29.240183 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152458d-cb29-4a3f-8a69-05d0a45af66e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:29.240493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152458d-cb29-4a3f-8a69-05d0a45af66e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:29.242251 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9152458d-cb29-4a3f-8a69-05d0a45af66e None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:29.265715 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 333/667] 10.222.0.48 () {56 vars in 1139 bytes} [Wed Jul 27 22:36:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:29.265715 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152458d-cb29-4a3f-8a69-05d0a45af66e None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:29.288031 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:29.334311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec854d5-26bd-430e-bbe7-85896ded000f None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:29.368588 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9152458d-cb29-4a3f-8a69-05d0a45af66e None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:29.370953 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:29.371295 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282d4f3-cd75-41d5-a41e-610575ea952a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:29.371937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282d4f3-cd75-41d5-a41e-610575ea952a None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:29.372227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282d4f3-cd75-41d5-a41e-610575ea952a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:29.372502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282d4f3-cd75-41d5-a41e-610575ea952a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:29.383398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282d4f3-cd75-41d5-a41e-610575ea952a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:29.388821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-c282d4f3-cd75-41d5-a41e-610575ea952a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:29.388821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:29.388821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:29.388821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:29.388821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:29.388821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:29.388821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:29.388821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:29.388821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:29.388821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:29.388821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:29.388821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:29.388821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:29.388821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:29.388821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:29.388821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:29.389824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:29.389824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:29.389824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:29.389824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:29.389824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:29.389824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:29.389824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:29.389824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:29.389824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:29.389824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:29.389824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:29.389824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:29.389824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:29.389824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:29.389824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:29.389824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:29.395368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:29.395368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:29.395368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:29.395368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:29.395368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:29.395368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:29.395368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:29.395368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:29.395368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:29.395368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:29.395368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:29.395368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:29.395368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 335/668] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:29.395368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282d4f3-cd75-41d5-a41e-610575ea952a None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:29.410886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc55da-83d2-4dc6-846b-f65006a10fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:29.411512 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc55da-83d2-4dc6-846b-f65006a10fee None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:29.411793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc55da-83d2-4dc6-846b-f65006a10fee None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:29.412070 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc55da-83d2-4dc6-846b-f65006a10fee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:29.412858 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc55da-83d2-4dc6-846b-f65006a10fee None admin] RBAC: Adding query filter params (role.id=7b21a72e7f9348d28d60c78cb0853af7, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=9ac8dcdbe57646f79593e7f39dc60900) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:29.413167 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc55da-83d2-4dc6-846b-f65006a10fee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:29.415205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc55da-83d2-4dc6-846b-f65006a10fee None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:29.430942 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 334/669] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:36:29 2022] GET /identity/v3/role_assignments?user.id=9ac8dcdbe57646f79593e7f39dc60900&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=7b21a72e7f9348d28d60c78cb0853af7 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:29.431749 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc55da-83d2-4dc6-846b-f65006a10fee None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:29.519982 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282d4f3-cd75-41d5-a41e-610575ea952a None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:29.550013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:29.562008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc55da-83d2-4dc6-846b-f65006a10fee None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:29.573582 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e08b5b-cae4-414b-960b-7ac5afb82a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:29.574935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e08b5b-cae4-414b-960b-7ac5afb82a1c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:29.575490 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e08b5b-cae4-414b-960b-7ac5afb82a1c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:29.575917 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e08b5b-cae4-414b-960b-7ac5afb82a1c None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:29.577327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e08b5b-cae4-414b-960b-7ac5afb82a1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:29.577796 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e08b5b-cae4-414b-960b-7ac5afb82a1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:29.580125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e08b5b-cae4-414b-960b-7ac5afb82a1c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:29.596657 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 336/670] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:29.597785 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e08b5b-cae4-414b-960b-7ac5afb82a1c None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:29.610137 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f1ca1-3df8-401f-8872-088829e73d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:29.610882 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f1ca1-3df8-401f-8872-088829e73d73 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:29.611239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f1ca1-3df8-401f-8872-088829e73d73 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:29.611586 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f1ca1-3df8-401f-8872-088829e73d73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:29.654975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:29.692877 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f1ca1-3df8-401f-8872-088829e73d73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:29.696093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f1ca1-3df8-401f-8872-088829e73d73 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:29.721375 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e08b5b-cae4-414b-960b-7ac5afb82a1c None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:29.757079 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9064e-507e-45b5-823e-f1a428231dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:29.757825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9064e-507e-45b5-823e-f1a428231dc7 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:29.758755 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9064e-507e-45b5-823e-f1a428231dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:29.759126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f9064e-507e-45b5-823e-f1a428231dc7 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:29.759950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9064e-507e-45b5-823e-f1a428231dc7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:29.760363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9064e-507e-45b5-823e-f1a428231dc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:29.761830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f9064e-507e-45b5-823e-f1a428231dc7 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:29.770894 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 337/671] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:36:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:29.777034 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9064e-507e-45b5-823e-f1a428231dc7 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:29.829267 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:29.831374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 335/672] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:36:29.832387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f1ca1-3df8-401f-8872-088829e73d73 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:29.900801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f9064e-507e-45b5-823e-f1a428231dc7 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:29.919147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:29.941490 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33071427-ebb3-464a-a36c-23bf7ab05ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:29.942307 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33071427-ebb3-464a-a36c-23bf7ab05ac6 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:29.942719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33071427-ebb3-464a-a36c-23bf7ab05ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:29.943100 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33071427-ebb3-464a-a36c-23bf7ab05ac6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:29.950862 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33071427-ebb3-464a-a36c-23bf7ab05ac6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:29.952792 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33071427-ebb3-464a-a36c-23bf7ab05ac6 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:29.958811 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f1ca1-3df8-401f-8872-088829e73d73 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:29.966176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-33071427-ebb3-464a-a36c-23bf7ab05ac6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:29.966176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:29.966176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:29.966176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:29.966176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:29.966176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:29.966176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:29.966176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:29.966176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:29.966176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:29.966176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:29.966176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:29.966176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:29.966176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:29.966176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:29.967402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:29.967402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:29.967402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:29.967402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:29.967402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:29.967402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:29.967402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:29.967402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:29.967402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:29.967402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:29.967402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:29.967402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:29.967402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:29.967402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:29.967402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:29.967402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:29.967402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:29.968524 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:29.968524 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:29.968524 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:29.968524 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:29.968524 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:29.968524 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:29.968524 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:29.968524 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:29.970894 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 338/673] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:29.971800 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33071427-ebb3-464a-a36c-23bf7ab05ac6 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:30.000241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1239f05-a411-4e8b-9aca-0a8aa203cfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:30.001247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1239f05-a411-4e8b-9aca-0a8aa203cfa4 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:30.001775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1239f05-a411-4e8b-9aca-0a8aa203cfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:30.002231 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1239f05-a411-4e8b-9aca-0a8aa203cfa4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:30.014306 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1239f05-a411-4e8b-9aca-0a8aa203cfa4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:30.016090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1239f05-a411-4e8b-9aca-0a8aa203cfa4 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:30.031720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-c1239f05-a411-4e8b-9aca-0a8aa203cfa4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:30.031720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:30.031720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:30.031720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:30.031720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:30.031720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:30.031720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:30.031720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:30.031720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:30.031720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:30.031720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:30.031720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:30.031720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:30.031720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:30.031720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:30.032634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:30.032634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:30.032634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:30.032634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:30.032634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:30.032634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:30.032634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:30.032634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:30.032634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:30.032634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:30.032634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:30.032634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:30.032634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:30.032634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:30.032634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:30.032634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:30.032634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:30.033546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:30.033546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:30.033546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:30.033546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:30.035854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 336/674] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:30.036979 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1239f05-a411-4e8b-9aca-0a8aa203cfa4 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:30.095240 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33071427-ebb3-464a-a36c-23bf7ab05ac6 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:30.097294 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:30.133718 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1348e-a305-41e8-96a6-7cd00c89353d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:30.134756 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1348e-a305-41e8-96a6-7cd00c89353d None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:30.135265 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1348e-a305-41e8-96a6-7cd00c89353d None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:30.135759 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1348e-a305-41e8-96a6-7cd00c89353d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:30.147452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1348e-a305-41e8-96a6-7cd00c89353d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:30.149249 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1348e-a305-41e8-96a6-7cd00c89353d None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:30.165634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-6db1348e-a305-41e8-96a6-7cd00c89353d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:30.165634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:30.165634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:30.165634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:30.165634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:30.165634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:30.165634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:30.165634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:30.165634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:30.165634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:30.165634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:30.165634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:30.165634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:30.165634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:30.165634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:30.166612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:30.166612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:30.166612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:30.166612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:30.166612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:30.166612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:30.166612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:30.166612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:30.166612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:30.166612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:30.166612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:30.166612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:30.166612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:30.166612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:30.166612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:30.166612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:30.166612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:30.167540 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:30.167540 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:30.167540 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:30.167540 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:30.167771 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1239f05-a411-4e8b-9aca-0a8aa203cfa4 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:30.173975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 339/675] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:30.175088 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1348e-a305-41e8-96a6-7cd00c89353d None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:30.189906 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:30.211567 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c733d0-93f2-4da7-bea5-8e8ba5fccb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:30.212694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c733d0-93f2-4da7-bea5-8e8ba5fccb9d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:30.212985 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c733d0-93f2-4da7-bea5-8e8ba5fccb9d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:30.213264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c733d0-93f2-4da7-bea5-8e8ba5fccb9d None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:30.214329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c733d0-93f2-4da7-bea5-8e8ba5fccb9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:30.214654 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c733d0-93f2-4da7-bea5-8e8ba5fccb9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:30.216124 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c733d0-93f2-4da7-bea5-8e8ba5fccb9d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:30.237105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 337/676] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:30.238403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c733d0-93f2-4da7-bea5-8e8ba5fccb9d None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:30.310831 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1348e-a305-41e8-96a6-7cd00c89353d None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:30.346621 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb3829-5d15-4ec9-9253-b120ef21188b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:30.347638 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb3829-5d15-4ec9-9253-b120ef21188b None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:30.348140 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb3829-5d15-4ec9-9253-b120ef21188b None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:30.348625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eb3829-5d15-4ec9-9253-b120ef21188b None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:30.349525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb3829-5d15-4ec9-9253-b120ef21188b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:30.350052 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb3829-5d15-4ec9-9253-b120ef21188b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:30.352165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eb3829-5d15-4ec9-9253-b120ef21188b None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:30.364973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 340/677] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:30.365132 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c733d0-93f2-4da7-bea5-8e8ba5fccb9d None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:30.366277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb3829-5d15-4ec9-9253-b120ef21188b None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:30.390694 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:30.409217 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1161d-c214-4e13-b450-5bbcbf5f2309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:30.409852 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1161d-c214-4e13-b450-5bbcbf5f2309 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:30.410172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1161d-c214-4e13-b450-5bbcbf5f2309 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:30.410495 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df1161d-c214-4e13-b450-5bbcbf5f2309 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:30.411220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1161d-c214-4e13-b450-5bbcbf5f2309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:30.411530 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1161d-c214-4e13-b450-5bbcbf5f2309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:30.414761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df1161d-c214-4e13-b450-5bbcbf5f2309 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:30.432547 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 338/678] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:30.433714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1161d-c214-4e13-b450-5bbcbf5f2309 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:30.480623 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:30.492022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eb3829-5d15-4ec9-9253-b120ef21188b None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:30.548700 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abb64b-7506-4f9f-b876-f7f7828e15e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:30.549332 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abb64b-7506-4f9f-b876-f7f7828e15e9 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:30.549614 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abb64b-7506-4f9f-b876-f7f7828e15e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:30.549887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abb64b-7506-4f9f-b876-f7f7828e15e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:30.550718 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abb64b-7506-4f9f-b876-f7f7828e15e9 None admin] RBAC: Adding query filter params (role.id=7b21a72e7f9348d28d60c78cb0853af7, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=c621601261e44ca8a7938862d6578639) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:30.551028 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abb64b-7506-4f9f-b876-f7f7828e15e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:30.552452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abb64b-7506-4f9f-b876-f7f7828e15e9 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:30.560112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 341/679] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:36:30 2022] GET /identity/v3/role_assignments?user.id=c621601261e44ca8a7938862d6578639&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=7b21a72e7f9348d28d60c78cb0853af7 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:30.561110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abb64b-7506-4f9f-b876-f7f7828e15e9 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:30.567026 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df1161d-c214-4e13-b450-5bbcbf5f2309 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:30.619895 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f43026-a9c0-4bf9-992b-0b2905319ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:30.620510 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f43026-a9c0-4bf9-992b-0b2905319ce3 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:30.620909 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f43026-a9c0-4bf9-992b-0b2905319ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:30.621287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f43026-a9c0-4bf9-992b-0b2905319ce3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:30.639310 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f43026-a9c0-4bf9-992b-0b2905319ce3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:30.640994 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f43026-a9c0-4bf9-992b-0b2905319ce3 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:30.664879 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:30.666158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-28f43026-a9c0-4bf9-992b-0b2905319ce3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 22:36:30.666158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:30.666158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:30.666158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:30.666158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:30.666158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:30.666158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:30.666158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:30.666158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:30.666158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:30.666158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:30.666158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:30.666158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:30.666158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:30.666158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:30.666158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:30.667374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:30.667374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:30.667374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:30.667374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:30.667374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:30.667374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:30.667374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:30.667374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:30.667374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:30.667374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:30.667374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:30.667374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:30.667374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:30.667374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:30.667374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:30.667374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:30.667374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:30.667374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:30.668566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:30.668566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:30.668566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:30.668566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:30.668566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:30.668566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:30.668566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:30.668566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:30.668566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 22:36:30.668566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:30.673056 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 339/680] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:36:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:30.678673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f43026-a9c0-4bf9-992b-0b2905319ce3 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:30.696907 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abb64b-7506-4f9f-b876-f7f7828e15e9 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:30.751433 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ba58b-f50e-4eb1-9e11-276b4bd97e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:30.752467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ba58b-f50e-4eb1-9e11-276b4bd97e68 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:30.752934 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ba58b-f50e-4eb1-9e11-276b4bd97e68 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:30.753389 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ba58b-f50e-4eb1-9e11-276b4bd97e68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:30.770078 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ba58b-f50e-4eb1-9e11-276b4bd97e68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:30.772478 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7ba58b-f50e-4eb1-9e11-276b4bd97e68 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:30.804227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-1c7ba58b-f50e-4eb1-9e11-276b4bd97e68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:30.804227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:30.804227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:30.804227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:30.804227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:30.804227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:30.804227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:30.804227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:30.804227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:30.804227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:30.804227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:30.804227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:30.804227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:30.804227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:30.804227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:30.805252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:30.805252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:30.805252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:30.805252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:30.805252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:30.805252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:30.805252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:30.805252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:30.805252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:30.805252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:30.805252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:30.805252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:30.805252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:30.805252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:30.805252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:30.805252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:30.805252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:30.806245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:30.806245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:30.806245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:30.806245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:30.806245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:30.806245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:30.806245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:30.806245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:30.808443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 342/681] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:30.814115 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ba58b-f50e-4eb1-9e11-276b4bd97e68 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:30.831536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:30.835203 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f43026-a9c0-4bf9-992b-0b2905319ce3 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:30.873264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431ee6c-b341-4c7d-a49d-74fad9f29f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:30.873905 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431ee6c-b341-4c7d-a49d-74fad9f29f39 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:30.874195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431ee6c-b341-4c7d-a49d-74fad9f29f39 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:30.874518 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431ee6c-b341-4c7d-a49d-74fad9f29f39 None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:30.875342 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431ee6c-b341-4c7d-a49d-74fad9f29f39 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:30.875798 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431ee6c-b341-4c7d-a49d-74fad9f29f39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:30.878067 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431ee6c-b341-4c7d-a49d-74fad9f29f39 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:30.901890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 340/682] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Jul 27 22:36:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:30.902114 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffe51a-93f1-472f-96e5-25a9f74b7a90 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:30.902640 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffe51a-93f1-472f-96e5-25a9f74b7a90 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:30.902640 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ffe51a-93f1-472f-96e5-25a9f74b7a90 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:30.904062 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 341/683] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:30.908718 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffe51a-93f1-472f-96e5-25a9f74b7a90 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:30.963630 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ba58b-f50e-4eb1-9e11-276b4bd97e68 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:31.001651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3ed22-bcce-4927-95af-2d79e1eb8101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:31.002271 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3ed22-bcce-4927-95af-2d79e1eb8101 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:31.002591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3ed22-bcce-4927-95af-2d79e1eb8101 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:31.002869 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3ed22-bcce-4927-95af-2d79e1eb8101 None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:31.003627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3ed22-bcce-4927-95af-2d79e1eb8101 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:31.003953 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3ed22-bcce-4927-95af-2d79e1eb8101 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:31.005365 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3ed22-bcce-4927-95af-2d79e1eb8101 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:31.013655 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:31.019606 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 343/684] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:31.020978 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340063eb-001f-4837-918d-dba0fd8f5822 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:31.021642 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340063eb-001f-4837-918d-dba0fd8f5822 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:31.022016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340063eb-001f-4837-918d-dba0fd8f5822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:31.031303 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ffe51a-93f1-472f-96e5-25a9f74b7a90 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:31.041396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-340063eb-001f-4837-918d-dba0fd8f5822 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:31.042839 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-340063eb-001f-4837-918d-dba0fd8f5822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:31.069590 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f687122-dea6-48c6-985d-c70def7165ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:31.071398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f687122-dea6-48c6-985d-c70def7165ae None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:31.071908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f687122-dea6-48c6-985d-c70def7165ae None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:31.073175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f687122-dea6-48c6-985d-c70def7165ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:31.109700 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:31.121132 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 344/685] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:31.122047 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340063eb-001f-4837-918d-dba0fd8f5822 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:31.156651 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f687122-dea6-48c6-985d-c70def7165ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:31.158479 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f687122-dea6-48c6-985d-c70def7165ae None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:31.236465 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340063eb-001f-4837-918d-dba0fd8f5822 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:31.277007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:31.279929 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 342/686] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:36:31.283074 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f687122-dea6-48c6-985d-c70def7165ae None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:31.286760 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95ab38-d66a-4b8d-9d80-22008ed864f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:31.288874 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95ab38-d66a-4b8d-9d80-22008ed864f2 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:31.289617 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95ab38-d66a-4b8d-9d80-22008ed864f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:31.290117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95ab38-d66a-4b8d-9d80-22008ed864f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:31.291423 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95ab38-d66a-4b8d-9d80-22008ed864f2 None admin] RBAC: Adding query filter params (role.id=7b21a72e7f9348d28d60c78cb0853af7, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=c266721767004428b9b54dd200f3cd6b) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:31.292051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95ab38-d66a-4b8d-9d80-22008ed864f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:31.294075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95ab38-d66a-4b8d-9d80-22008ed864f2 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:31.301497 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 345/687] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:36:31 2022] GET /identity/v3/role_assignments?user.id=c266721767004428b9b54dd200f3cd6b&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=7b21a72e7f9348d28d60c78cb0853af7 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:31.302868 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95ab38-d66a-4b8d-9d80-22008ed864f2 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:31.348386 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:31.395377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f687122-dea6-48c6-985d-c70def7165ae None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:31.421694 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95ab38-d66a-4b8d-9d80-22008ed864f2 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:31.435069 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf668e8-adfe-41d0-967e-7cd5f827192b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:31.435882 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf668e8-adfe-41d0-967e-7cd5f827192b None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:31.436009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf668e8-adfe-41d0-967e-7cd5f827192b None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:31.436297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf668e8-adfe-41d0-967e-7cd5f827192b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:31.447999 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf668e8-adfe-41d0-967e-7cd5f827192b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:31.449465 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf668e8-adfe-41d0-967e-7cd5f827192b None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:31.462388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e3b09-bdd4-4d7e-890c-f3b5fd4501ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:31.463392 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e3b09-bdd4-4d7e-890c-f3b5fd4501ed None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:31.463883 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e3b09-bdd4-4d7e-890c-f3b5fd4501ed None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:31.464419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e3b09-bdd4-4d7e-890c-f3b5fd4501ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:31.465562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-1bf668e8-adfe-41d0-967e-7cd5f827192b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:31.465562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:31.465562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:31.465562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:31.465562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:31.465562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:31.465562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:31.465562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:31.465562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:31.465562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:31.465562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:31.465562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:31.465562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:31.465562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:31.465562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:31.466499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:31.466499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:31.466499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:31.466499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:31.466499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:31.466499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:31.466499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:31.466499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:31.466499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:31.466499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:31.466499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:31.466499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:31.466499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:31.466499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:31.466499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:31.466499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:31.466499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:31.467414 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:31.467414 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:31.467414 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:31.467414 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:31.467414 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 343/688] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:31.479564 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf668e8-adfe-41d0-967e-7cd5f827192b None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:31.480621 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e3b09-bdd4-4d7e-890c-f3b5fd4501ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:31.482480 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e3b09-bdd4-4d7e-890c-f3b5fd4501ed None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:31.500193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-ac0e3b09-bdd4-4d7e-890c-f3b5fd4501ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:31.500193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:31.500193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:31.500193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:31.500193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:31.500193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:31.500193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:31.500193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:31.500193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:31.500193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:31.500193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:31.500193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:31.500193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:31.500193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:31.500193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:31.501159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:31.501159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:31.501159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:31.501159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:31.501159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:31.501159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:31.501159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:31.501159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:31.501159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:31.501159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:31.501159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:31.501159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:31.501159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:31.501159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:31.501159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:31.501159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:31.501159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:31.502078 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:31.502078 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:31.502078 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:31.502078 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:31.504599 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 346/689] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:31.511164 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e3b09-bdd4-4d7e-890c-f3b5fd4501ed None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:31.563014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:31.658548 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e3b09-bdd4-4d7e-890c-f3b5fd4501ed None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:31.662188 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf668e8-adfe-41d0-967e-7cd5f827192b None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:31.675586 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:31.699288 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013614c8-2115-42d4-8fbb-34f981ccbdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:31.700243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013614c8-2115-42d4-8fbb-34f981ccbdfa None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:31.700530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013614c8-2115-42d4-8fbb-34f981ccbdfa None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:31.700809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013614c8-2115-42d4-8fbb-34f981ccbdfa None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:31.701772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013614c8-2115-42d4-8fbb-34f981ccbdfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:31.702082 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013614c8-2115-42d4-8fbb-34f981ccbdfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:31.704564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013614c8-2115-42d4-8fbb-34f981ccbdfa None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:31.710653 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572bc1d-b6b7-49a7-a72e-8991dd70cc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:31.712142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572bc1d-b6b7-49a7-a72e-8991dd70cc03 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:31.712578 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572bc1d-b6b7-49a7-a72e-8991dd70cc03 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:31.713010 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572bc1d-b6b7-49a7-a72e-8991dd70cc03 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:31.714551 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572bc1d-b6b7-49a7-a72e-8991dd70cc03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:31.715298 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572bc1d-b6b7-49a7-a72e-8991dd70cc03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:31.716831 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e572bc1d-b6b7-49a7-a72e-8991dd70cc03 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:31.717222 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 347/690] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:31.722746 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3faa4f-5ca6-4c26-b42f-756ad332857b None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:31.723061 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3faa4f-5ca6-4c26-b42f-756ad332857b None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:31.723350 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3faa4f-5ca6-4c26-b42f-756ad332857b None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:31.725048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 348/691] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:31.727213 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3faa4f-5ca6-4c26-b42f-756ad332857b None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:31.733785 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 344/692] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:31.735342 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037894f-203a-406e-9123-9fd795eab51b None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:31.735846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037894f-203a-406e-9123-9fd795eab51b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:31.736320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037894f-203a-406e-9123-9fd795eab51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:31.760086 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-b037894f-203a-406e-9123-9fd795eab51b None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:31.762386 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-b037894f-203a-406e-9123-9fd795eab51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:31.842371 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3faa4f-5ca6-4c26-b42f-756ad332857b None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:31.845746 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:31.861362 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 345/693] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:31.862861 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037894f-203a-406e-9123-9fd795eab51b None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:31.884564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51d802-4e4d-4db9-a8e8-c27eb704833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:31.885635 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51d802-4e4d-4db9-a8e8-c27eb704833b None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:31.886021 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51d802-4e4d-4db9-a8e8-c27eb704833b None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:31.886428 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51d802-4e4d-4db9-a8e8-c27eb704833b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:31.902146 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51d802-4e4d-4db9-a8e8-c27eb704833b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:31.904342 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51d802-4e4d-4db9-a8e8-c27eb704833b None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:31.922749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-be51d802-4e4d-4db9-a8e8-c27eb704833b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:31.922749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:31.922749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:31.922749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:31.922749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:31.922749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:31.922749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:31.922749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:31.922749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:31.922749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:31.922749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:31.922749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:31.922749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:31.922749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:31.922749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:31.923856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:31.923856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:31.923856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:31.923856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:31.923856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:31.923856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:31.923856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:31.923856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:31.923856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:31.923856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:31.923856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:31.923856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:31.923856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:31.923856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:31.923856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:31.923856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:31.923856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:31.924767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:31.924767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:31.924767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:31.924767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:31.924767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:31.924767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:31.924767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:31.924767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:31.930422 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 349/694] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:31.931434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51d802-4e4d-4db9-a8e8-c27eb704833b None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:32.006787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:32.011446 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b037894f-203a-406e-9123-9fd795eab51b None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:32.061958 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fd3d7-7ea0-48db-9af9-6634de1c024a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:32.062617 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fd3d7-7ea0-48db-9af9-6634de1c024a None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:32.062902 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fd3d7-7ea0-48db-9af9-6634de1c024a None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:32.063177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fd3d7-7ea0-48db-9af9-6634de1c024a None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:32.063852 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fd3d7-7ea0-48db-9af9-6634de1c024a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:32.065284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fd3d7-7ea0-48db-9af9-6634de1c024a None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:32.078516 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51d802-4e4d-4db9-a8e8-c27eb704833b None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:32.094366 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 346/695] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 22:36:31 2022] POST /identity/v3/users => generated 254 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:36:32.094366 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fd3d7-7ea0-48db-9af9-6634de1c024a None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:32.159602 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57015c0-c7fe-41be-a413-e0cfa4d5fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:32.160280 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57015c0-c7fe-41be-a413-e0cfa4d5fbcd None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:32.161837 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57015c0-c7fe-41be-a413-e0cfa4d5fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:32.162128 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57015c0-c7fe-41be-a413-e0cfa4d5fbcd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:32.162807 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57015c0-c7fe-41be-a413-e0cfa4d5fbcd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:32.167410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57015c0-c7fe-41be-a413-e0cfa4d5fbcd None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:32.194680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-a57015c0-c7fe-41be-a413-e0cfa4d5fbcd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 22:36:32.194680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:32.194680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:36:32.194680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:36:32.194680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:36:32.194680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:36:32.194680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:36:32.194680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:32.194680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 22:36:32.194680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:32.194680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:36:32.194680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:32.194680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:32.194680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:32.194680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:32.194680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:32.195992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:32.195992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:32.195992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:32.195992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:32.195992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:32.195992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:32.195992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:32.195992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:36:32.195992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:36:32.195992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:36:32.195992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:36:32.195992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:32.195992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:32.195992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:32.195992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:32.195992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:32.196864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:32.196864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:32.196864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:32.196864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:32.196864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:32.196864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:32.196864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:32.196864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:32.196864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:32.196864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:32.196864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:32.196864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:36:32.196864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:32.196864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 22:36:32.196864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:32.200223 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 350/696] 10.222.0.48 () {56 vars in 1129 bytes} [Wed Jul 27 22:36:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:32.206655 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57015c0-c7fe-41be-a413-e0cfa4d5fbcd None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:32.251619 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:32.259397 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fd3d7-7ea0-48db-9af9-6634de1c024a None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:32.296503 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefab18-b08d-4193-bae3-6b9e297671db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:32.297102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefab18-b08d-4193-bae3-6b9e297671db None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:32.297393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefab18-b08d-4193-bae3-6b9e297671db None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:32.297672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefab18-b08d-4193-bae3-6b9e297671db None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:32.298535 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefab18-b08d-4193-bae3-6b9e297671db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:32.298848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefab18-b08d-4193-bae3-6b9e297671db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:32.300345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefab18-b08d-4193-bae3-6b9e297671db None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:32.313861 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 347/697] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:32.319704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefab18-b08d-4193-bae3-6b9e297671db None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:32.342482 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:32.344549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57015c0-c7fe-41be-a413-e0cfa4d5fbcd None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:32.393342 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c15a9-b448-4d3b-ba7a-106d7f71fb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:32.394598 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c15a9-b448-4d3b-ba7a-106d7f71fb79 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:32.395280 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c15a9-b448-4d3b-ba7a-106d7f71fb79 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:32.395715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c15a9-b448-4d3b-ba7a-106d7f71fb79 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:32.397017 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c15a9-b448-4d3b-ba7a-106d7f71fb79 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:32.397672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c15a9-b448-4d3b-ba7a-106d7f71fb79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:32.400112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c15a9-b448-4d3b-ba7a-106d7f71fb79 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:32.406421 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 351/698] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Jul 27 22:36:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:32.412655 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c15a9-b448-4d3b-ba7a-106d7f71fb79 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:32.450996 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefab18-b08d-4193-bae3-6b9e297671db None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:32.494658 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7cfa7-bc81-4591-aa42-ebe785bfb5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:32.495656 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7cfa7-bc81-4591-aa42-ebe785bfb5f9 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:32.496163 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7cfa7-bc81-4591-aa42-ebe785bfb5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:32.496654 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7cfa7-bc81-4591-aa42-ebe785bfb5f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:32.497765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7cfa7-bc81-4591-aa42-ebe785bfb5f9 None admin] RBAC: Adding query filter params (role.id=7b21a72e7f9348d28d60c78cb0853af7, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=baf405258b9d413fae1192e10250b6a3) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:32.498424 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7cfa7-bc81-4591-aa42-ebe785bfb5f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:32.500184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7cfa7-bc81-4591-aa42-ebe785bfb5f9 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:32.507272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 348/699] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:36:32 2022] GET /identity/v3/role_assignments?user.id=baf405258b9d413fae1192e10250b6a3&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=7b21a72e7f9348d28d60c78cb0853af7 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:32.528807 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:32.539744 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c15a9-b448-4d3b-ba7a-106d7f71fb79 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:32.584521 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eb24bb-504f-4afd-b9ce-4d4cc4f3012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:32.585082 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb24bb-504f-4afd-b9ce-4d4cc4f3012c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:32.585362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb24bb-504f-4afd-b9ce-4d4cc4f3012c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:32.585634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eb24bb-504f-4afd-b9ce-4d4cc4f3012c None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:32.587086 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb24bb-504f-4afd-b9ce-4d4cc4f3012c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:32.587388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb24bb-504f-4afd-b9ce-4d4cc4f3012c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:32.588777 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eb24bb-504f-4afd-b9ce-4d4cc4f3012c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:32.603594 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 352/700] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Jul 27 22:36:32 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:33.205735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aa22d-952c-40c9-a1ec-503f12109d26 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:33.206793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aa22d-952c-40c9-a1ec-503f12109d26 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:33.207346 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0aa22d-952c-40c9-a1ec-503f12109d26 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:33.209173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 349/701] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:33.214357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e7e14-25d3-4946-bd52-938af874e9b0 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:33.214765 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e7e14-25d3-4946-bd52-938af874e9b0 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:33.214936 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767e7e14-25d3-4946-bd52-938af874e9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:33.233947 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-767e7e14-25d3-4946-bd52-938af874e9b0 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:33.235520 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-767e7e14-25d3-4946-bd52-938af874e9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:33.330319 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 353/702] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:36:33.371811 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0aa22d-952c-40c9-a1ec-503f12109d26 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:33.482577 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:33.507026 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0aa22d-952c-40c9-a1ec-503f12109d26 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:33.560040 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02cb63a-a0ac-4b4a-896d-4636a2dd6e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:33.560743 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cb63a-a0ac-4b4a-896d-4636a2dd6e24 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:33.561034 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cb63a-a0ac-4b4a-896d-4636a2dd6e24 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:33.561317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02cb63a-a0ac-4b4a-896d-4636a2dd6e24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:33.578469 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02cb63a-a0ac-4b4a-896d-4636a2dd6e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:33.587135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-a02cb63a-a0ac-4b4a-896d-4636a2dd6e24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:36:33.587135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:33.587135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:33.587135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:33.587135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:33.587135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:33.587135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:33.587135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:33.587135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:33.587135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:33.587135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:33.587135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:33.587135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:33.587135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:33.587135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:33.587135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:33.588135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:33.588135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:33.588135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:33.588135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:33.588135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:33.588135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:33.588135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:33.588135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:33.588135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:33.588135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:33.588135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:33.588135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:33.588135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:33.588135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:33.588135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:33.588135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:33.589036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:33.589036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:33.589036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:33.589036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:33.589036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:33.589036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:33.589036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:33.589036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:33.589036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:33.589036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:33.589036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:36:33.589036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:33.589036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 350/703] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:36:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:33.594690 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e7e14-25d3-4946-bd52-938af874e9b0 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:33.772753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27c1e-a630-4806-b45a-cbeeae0eae71 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:33.773060 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27c1e-a630-4806-b45a-cbeeae0eae71 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:33.773867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27c1e-a630-4806-b45a-cbeeae0eae71 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:33.775545 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 351/704] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:33.780759 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da762de-59ca-4eba-9cf1-b47c2af14a45 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:33.781051 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da762de-59ca-4eba-9cf1-b47c2af14a45 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:33.781339 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da762de-59ca-4eba-9cf1-b47c2af14a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:33.800076 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-2da762de-59ca-4eba-9cf1-b47c2af14a45 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:33.801437 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-2da762de-59ca-4eba-9cf1-b47c2af14a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:33.873037 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:33.904695 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767e7e14-25d3-4946-bd52-938af874e9b0 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:33.907292 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 352/705] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:36:33.962368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56218541-7ebb-4c88-8c20-b26f341964eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:33.962931 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da762de-59ca-4eba-9cf1-b47c2af14a45 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:33.963055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56218541-7ebb-4c88-8c20-b26f341964eb None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:33.963286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56218541-7ebb-4c88-8c20-b26f341964eb None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:33.963567 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56218541-7ebb-4c88-8c20-b26f341964eb None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:33.964339 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56218541-7ebb-4c88-8c20-b26f341964eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:33.964655 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56218541-7ebb-4c88-8c20-b26f341964eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:33.966540 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56218541-7ebb-4c88-8c20-b26f341964eb None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:33.977088 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 354/706] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:36:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:33.987498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56218541-7ebb-4c88-8c20-b26f341964eb None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:34.110320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:34.141180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56218541-7ebb-4c88-8c20-b26f341964eb None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:34.154902 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da762de-59ca-4eba-9cf1-b47c2af14a45 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:34.179712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafc276-ca6a-4a69-b330-4fbe98314e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:34.180509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafc276-ca6a-4a69-b330-4fbe98314e78 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:34.180806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafc276-ca6a-4a69-b330-4fbe98314e78 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:34.181084 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bafc276-ca6a-4a69-b330-4fbe98314e78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:34.193339 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafc276-ca6a-4a69-b330-4fbe98314e78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:34.194817 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bafc276-ca6a-4a69-b330-4fbe98314e78 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:34.205067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:34.212562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-4bafc276-ca6a-4a69-b330-4fbe98314e78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:34.212562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:34.212562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:34.212562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:34.212562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:34.212562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:34.212562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:34.212562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:34.212562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:34.212562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:34.212562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:34.212562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:34.212562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:34.212562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:34.212562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:34.213463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:34.213463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:34.213463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:34.213463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:34.213463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:34.213463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:34.213463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:34.213463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:34.213463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:34.213463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:34.213463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:34.213463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:34.213463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:34.213463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:34.213463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:34.213463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:34.213463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:34.214414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:34.214414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:34.214414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:34.214414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:34.215061 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 355/707] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:34.220165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafc276-ca6a-4a69-b330-4fbe98314e78 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:34.238525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70830f73-7eac-4340-a57f-da458dd0d69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:34.239181 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70830f73-7eac-4340-a57f-da458dd0d69c None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:34.239466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70830f73-7eac-4340-a57f-da458dd0d69c None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:34.239744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70830f73-7eac-4340-a57f-da458dd0d69c None admin] PATH_INFO: `/v3/services/network` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:34.240376 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70830f73-7eac-4340-a57f-da458dd0d69c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:34.241748 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70830f73-7eac-4340-a57f-da458dd0d69c None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:34.260247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-70830f73-7eac-4340-a57f-da458dd0d69c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 22:36:34.260247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:34.260247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:36:34.260247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:36:34.260247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:36:34.260247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:36:34.260247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:36:34.260247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:34.260247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 22:36:34.260247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:34.260247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:36:34.260247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:34.260247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:34.260247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:34.260247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:34.260247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:34.260247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:34.262679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:34.262679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:34.262679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:34.262679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:34.262679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:34.262679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:34.262679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:36:34.262679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:36:34.262679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:36:34.262679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:36:34.262679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:34.262679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:34.262679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:34.262679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:34.262679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:34.262679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:34.264649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:34.264649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:34.264649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:34.264649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:34.264649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:34.264649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:34.264649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:34.264649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:34.264649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:34.264649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:34.264649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:36:34.264649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:34.264649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 22:36:34.264649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:34.264649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 353/708] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:33 2022] GET /identity/v3/services/network => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:34.270462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70830f73-7eac-4340-a57f-da458dd0d69c None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:34.391676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70830f73-7eac-4340-a57f-da458dd0d69c None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:34.428603 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e3021-9385-4711-8bab-76025d6f603d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:34.429189 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e3021-9385-4711-8bab-76025d6f603d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:34.429477 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e3021-9385-4711-8bab-76025d6f603d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:34.430292 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e3021-9385-4711-8bab-76025d6f603d None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:34.431025 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e3021-9385-4711-8bab-76025d6f603d None admin] RBAC: Adding query filter params (name=network) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:34.431338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e3021-9385-4711-8bab-76025d6f603d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:34.433067 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e3021-9385-4711-8bab-76025d6f603d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:34.434439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:34.442708 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bafc276-ca6a-4a69-b330-4fbe98314e78 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:34.446890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 354/709] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 22:36:34 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:34.451821 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e3021-9385-4711-8bab-76025d6f603d None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:34.484407 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e7ef7-e557-4bb2-a69c-bbfad74934c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:34.486083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e7ef7-e557-4bb2-a69c-bbfad74934c5 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:34.486980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e7ef7-e557-4bb2-a69c-bbfad74934c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:34.490568 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e7ef7-e557-4bb2-a69c-bbfad74934c5 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:34.491543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e7ef7-e557-4bb2-a69c-bbfad74934c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:34.492659 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e7ef7-e557-4bb2-a69c-bbfad74934c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:34.494258 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e7ef7-e557-4bb2-a69c-bbfad74934c5 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:34.525197 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 356/710] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:34.532443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e7ef7-e557-4bb2-a69c-bbfad74934c5 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:34.631255 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e3021-9385-4711-8bab-76025d6f603d None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:34.679124 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6df57-bc75-4764-bc7a-bdd13881bb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:34.680149 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6df57-bc75-4764-bc7a-bdd13881bb6e None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:34.680640 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6df57-bc75-4764-bc7a-bdd13881bb6e None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:34.681136 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6df57-bc75-4764-bc7a-bdd13881bb6e None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:34.682034 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6df57-bc75-4764-bc7a-bdd13881bb6e None admin] RBAC: Adding query filter params (type=network) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:34.682574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6df57-bc75-4764-bc7a-bdd13881bb6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:34.684167 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6df57-bc75-4764-bc7a-bdd13881bb6e None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:34.690686 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 355/711] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 22:36:34 2022] GET /identity/v3/services?type=network => generated 124 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:34.693949 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:34.718690 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3da90a-cd32-409b-9662-00cde0a32a65 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:34.719036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3da90a-cd32-409b-9662-00cde0a32a65 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:34.719550 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3da90a-cd32-409b-9662-00cde0a32a65 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:34.720853 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 356/712] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:36:34.727801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc890d-1fbb-4572-8b89-5ac9472d716b None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:34.728090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc890d-1fbb-4572-8b89-5ac9472d716b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:34.728374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc890d-1fbb-4572-8b89-5ac9472d716b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:34.748394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e7ef7-e557-4bb2-a69c-bbfad74934c5 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:34.749264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-92bc890d-1fbb-4572-8b89-5ac9472d716b None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:34.750702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-92bc890d-1fbb-4572-8b89-5ac9472d716b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:34.824211 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:34.846472 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 357/713] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 22:36:34.847267 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ed32d-7c32-4e74-a6e5-3cb78ece3467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:34.847956 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ed32d-7c32-4e74-a6e5-3cb78ece3467 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:34.848243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ed32d-7c32-4e74-a6e5-3cb78ece3467 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:34.848525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870ed32d-7c32-4e74-a6e5-3cb78ece3467 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:34.860647 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ed32d-7c32-4e74-a6e5-3cb78ece3467 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:34.862123 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870ed32d-7c32-4e74-a6e5-3cb78ece3467 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:34.883747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-870ed32d-7c32-4e74-a6e5-3cb78ece3467 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 22:36:34.883747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:34.883747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:34.883747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:34.883747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:34.883747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:34.883747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:34.883747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:34.883747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:34.883747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:34.883747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:34.883747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:34.883747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:34.883747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:34.883747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:34.883747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:34.885918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:34.885918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:34.885918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:34.885918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:34.885918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:34.885918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:34.885918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:34.885918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:34.885918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:34.885918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:34.885918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:34.885918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:34.885918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:34.885918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:34.885918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:34.885918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:34.885918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:34.885918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:34.888163 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:34.888163 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:34.888163 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:34.888163 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:34.888163 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:34.888163 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:34.888163 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:34.888163 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:34.888163 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 22:36:34.888163 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:34.888163 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 357/714] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jul 27 22:36:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:34.893302 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc890d-1fbb-4572-8b89-5ac9472d716b None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:34.903802 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ed32d-7c32-4e74-a6e5-3cb78ece3467 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:35.013356 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc890d-1fbb-4572-8b89-5ac9472d716b None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:35.040846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870ed32d-7c32-4e74-a6e5-3cb78ece3467 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:35.051037 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3675d2fb-4572-4635-963c-a81fd7c6361f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:35.052064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675d2fb-4572-4635-963c-a81fd7c6361f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:35.052541 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675d2fb-4572-4635-963c-a81fd7c6361f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:35.053044 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3675d2fb-4572-4635-963c-a81fd7c6361f None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:35.054098 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675d2fb-4572-4635-963c-a81fd7c6361f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:35.054750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675d2fb-4572-4635-963c-a81fd7c6361f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:35.056606 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3675d2fb-4572-4635-963c-a81fd7c6361f None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:35.063937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:35.078334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 358/715] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jul 27 22:36:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:35.080009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd11373-f0f4-46d2-aebe-030efb5a3fdd None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:35.080512 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd11373-f0f4-46d2-aebe-030efb5a3fdd None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:35.080918 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd11373-f0f4-46d2-aebe-030efb5a3fdd None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:35.081554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abac8635-6140-465c-b6fb-5af8f74e1b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:35.082498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac8635-6140-465c-b6fb-5af8f74e1b0d None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:35.082929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac8635-6140-465c-b6fb-5af8f74e1b0d None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:35.083359 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abac8635-6140-465c-b6fb-5af8f74e1b0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:35.087456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 359/716] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:35.088600 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd11373-f0f4-46d2-aebe-030efb5a3fdd None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:35.097190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abac8635-6140-465c-b6fb-5af8f74e1b0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:35.104386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-abac8635-6140-465c-b6fb-5af8f74e1b0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:35.104386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:35.104386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:35.104386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:35.104386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:35.104386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:35.104386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:35.104386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:35.104386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:35.104386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:35.104386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:35.104386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:35.104386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:35.104386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:35.104386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:35.104386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:35.105526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:35.105526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:35.105526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:35.105526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:35.105526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:35.105526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:35.105526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:35.105526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:35.105526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:35.105526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:35.105526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:35.105526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:35.105526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:35.105526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:35.105526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:35.105526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:35.106586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:35.106586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:35.106586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:35.106586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:35.106586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:35.106586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:35.106586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:35.106586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:35.106586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:35.106586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:35.106586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:35.106586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:35.110189 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 358/717] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:35.111417 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484fbc9-2c51-4643-92ac-3e13255abf39 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:35.111854 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484fbc9-2c51-4643-92ac-3e13255abf39 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:35.112024 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484fbc9-2c51-4643-92ac-3e13255abf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:35.140040 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-5484fbc9-2c51-4643-92ac-3e13255abf39 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:35.141261 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-5484fbc9-2c51-4643-92ac-3e13255abf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:35.161611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:35.222084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd11373-f0f4-46d2-aebe-030efb5a3fdd None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:35.226894 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 359/718] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:35.228462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484fbc9-2c51-4643-92ac-3e13255abf39 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:35.259202 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c81a9-7749-464f-9470-15e3b2924950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:35.259938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c81a9-7749-464f-9470-15e3b2924950 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:35.260125 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c81a9-7749-464f-9470-15e3b2924950 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:35.260391 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c81a9-7749-464f-9470-15e3b2924950 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:35.333993 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c81a9-7749-464f-9470-15e3b2924950 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:35.335476 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8c81a9-7749-464f-9470-15e3b2924950 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:35.338920 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484fbc9-2c51-4643-92ac-3e13255abf39 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:35.352829 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:35.381312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31cb3e-0c62-42d1-844c-458fffb663db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:35.382320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31cb3e-0c62-42d1-844c-458fffb663db None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:35.383411 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31cb3e-0c62-42d1-844c-458fffb663db None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:35.383895 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31cb3e-0c62-42d1-844c-458fffb663db None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:35.384887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31cb3e-0c62-42d1-844c-458fffb663db None admin] RBAC: Adding query filter params (name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:35.385411 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31cb3e-0c62-42d1-844c-458fffb663db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:35.387483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31cb3e-0c62-42d1-844c-458fffb663db None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:35.404410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 360/719] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:36:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:35.405822 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31cb3e-0c62-42d1-844c-458fffb663db None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:35.512677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:35.519443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31cb3e-0c62-42d1-844c-458fffb663db None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:35.557661 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1a1b3-7593-4a48-b7b2-2c78d5decae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:35.558677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1a1b3-7593-4a48-b7b2-2c78d5decae5 None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:35.559194 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1a1b3-7593-4a48-b7b2-2c78d5decae5 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:35.559668 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1a1b3-7593-4a48-b7b2-2c78d5decae5 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:35.560578 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1a1b3-7593-4a48-b7b2-2c78d5decae5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:35.562188 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1a1b3-7593-4a48-b7b2-2c78d5decae5 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:35.567725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 360/720] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:36:35.568593 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c81a9-7749-464f-9470-15e3b2924950 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:35.580903 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 361/721] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 22:36:35 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:36:35.582273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a592b8-d6b7-40dd-814b-084aa44003e4 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:35.582595 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a592b8-d6b7-40dd-814b-084aa44003e4 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:35.583017 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a592b8-d6b7-40dd-814b-084aa44003e4 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:35.584673 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 362/722] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:35.585440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a592b8-d6b7-40dd-814b-084aa44003e4 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:35.624779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:35.724591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a592b8-d6b7-40dd-814b-084aa44003e4 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:35.734182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c81a9-7749-464f-9470-15e3b2924950 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:35.767649 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdc963-0dbd-4e5d-ba01-5ece0d4bdf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:35.768311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdc963-0dbd-4e5d-ba01-5ece0d4bdf85 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:35.768596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdc963-0dbd-4e5d-ba01-5ece0d4bdf85 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:35.768989 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdc963-0dbd-4e5d-ba01-5ece0d4bdf85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:35.774396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ad7ba-b63c-41fd-bfeb-bfdb7443bf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:35.775020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ad7ba-b63c-41fd-bfeb-bfdb7443bf19 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:35.775306 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ad7ba-b63c-41fd-bfeb-bfdb7443bf19 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:35.775588 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ad7ba-b63c-41fd-bfeb-bfdb7443bf19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:35.782305 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdc963-0dbd-4e5d-ba01-5ece0d4bdf85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:35.783913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdc963-0dbd-4e5d-ba01-5ece0d4bdf85 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:35.787283 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ad7ba-b63c-41fd-bfeb-bfdb7443bf19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:35.788725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ad7ba-b63c-41fd-bfeb-bfdb7443bf19 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:35.802317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-73cdc963-0dbd-4e5d-ba01-5ece0d4bdf85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:35.802317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:35.802317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:35.802317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:35.802317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:35.802317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:35.802317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:35.802317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:35.802317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:35.802317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:35.802317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:35.802317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:35.802317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:35.802317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:35.802317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:35.803460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:35.803460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:35.803460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:35.803460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:35.803460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:35.803460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:35.803460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:35.803460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:35.803460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:35.803460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:35.803460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:35.803460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:35.803460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:35.803460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:35.803460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:35.803460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:35.803460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:35.805212 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:35.805212 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:35.805212 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:35.805212 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:35.806940 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 363/723] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:35.808274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2847484-4efe-44c0-8c1e-61b0dcda98bf None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:35.808563 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2847484-4efe-44c0-8c1e-61b0dcda98bf None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:35.808845 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2847484-4efe-44c0-8c1e-61b0dcda98bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:35.810153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-f68ad7ba-b63c-41fd-bfeb-bfdb7443bf19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:35.810153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:35.810153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:35.810153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:35.810153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:35.810153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:35.810153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:35.810153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:35.810153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:35.810153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:35.810153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:35.810153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:35.810153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:35.810153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:35.810153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:35.811082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:35.811082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:35.811082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:35.811082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:35.811082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:35.811082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:35.811082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:35.811082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:35.811082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:35.811082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:35.811082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:35.811082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:35.811082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:35.811082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:35.811082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:35.811082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:35.811082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:35.815710 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:35.815710 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:35.815710 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:35.815710 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:35.815710 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 361/724] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:35.817437 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ad7ba-b63c-41fd-bfeb-bfdb7443bf19 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:35.819673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:35.846478 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-a2847484-4efe-44c0-8c1e-61b0dcda98bf None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:35.846478 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a2847484-4efe-44c0-8c1e-61b0dcda98bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:35.936586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 364/725] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:35 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:35.936586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2847484-4efe-44c0-8c1e-61b0dcda98bf None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:35.940781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ad7ba-b63c-41fd-bfeb-bfdb7443bf19 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:35.951010 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:35.987842 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cad74f-fac0-47a7-ad52-fe506ba55c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:35.988966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cad74f-fac0-47a7-ad52-fe506ba55c68 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:35.989254 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cad74f-fac0-47a7-ad52-fe506ba55c68 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:35.989535 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cad74f-fac0-47a7-ad52-fe506ba55c68 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:35.990695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cad74f-fac0-47a7-ad52-fe506ba55c68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:35.991290 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cad74f-fac0-47a7-ad52-fe506ba55c68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:35.992987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cad74f-fac0-47a7-ad52-fe506ba55c68 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:36.007989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 362/726] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:36.008949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cad74f-fac0-47a7-ad52-fe506ba55c68 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:36.062958 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2847484-4efe-44c0-8c1e-61b0dcda98bf None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:36.089331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:36.107836 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f98afe-3c2c-423d-8ec8-d199a35887f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:36.108473 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f98afe-3c2c-423d-8ec8-d199a35887f7 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:36.108762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f98afe-3c2c-423d-8ec8-d199a35887f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:36.109095 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f98afe-3c2c-423d-8ec8-d199a35887f7 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:36.110335 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f98afe-3c2c-423d-8ec8-d199a35887f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:36.110675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f98afe-3c2c-423d-8ec8-d199a35887f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:36.112508 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f98afe-3c2c-423d-8ec8-d199a35887f7 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:36.128990 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 365/727] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:36.130150 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f98afe-3c2c-423d-8ec8-d199a35887f7 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:36.137034 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cad74f-fac0-47a7-ad52-fe506ba55c68 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:36.172906 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253c0ba-26c4-4882-b5ff-bb04a0f50422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:36.173550 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253c0ba-26c4-4882-b5ff-bb04a0f50422 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:36.173833 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253c0ba-26c4-4882-b5ff-bb04a0f50422 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:36.174107 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253c0ba-26c4-4882-b5ff-bb04a0f50422 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:36.184446 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253c0ba-26c4-4882-b5ff-bb04a0f50422 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:36.189488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-f253c0ba-26c4-4882-b5ff-bb04a0f50422 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:36:36.189488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:36.189488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:36.189488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:36.189488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:36.189488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:36.189488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:36.189488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:36.189488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:36.189488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:36.189488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:36.189488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:36.189488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:36.189488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:36.189488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:36.189488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:36.190533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:36.190533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:36.190533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:36.190533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:36.190533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:36.190533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:36.190533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:36.190533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:36.190533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:36.190533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:36.190533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:36.190533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:36.190533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:36.190533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:36.190533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:36.190533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:36.191452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:36.191452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:36.191452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:36.191452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:36.191452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:36.191452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:36.191452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:36.191452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:36.191452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:36.191452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:36.191452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:36:36.191452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:36.191452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 363/728] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:36:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:36.192171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253c0ba-26c4-4882-b5ff-bb04a0f50422 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:36.217405 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:36.253441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f98afe-3c2c-423d-8ec8-d199a35887f7 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:36.289448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18a1e5-d474-4c83-9178-9269fdd7a756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:36.290098 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18a1e5-d474-4c83-9178-9269fdd7a756 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:36.290414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18a1e5-d474-4c83-9178-9269fdd7a756 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:36.290702 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18a1e5-d474-4c83-9178-9269fdd7a756 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:36.297680 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253c0ba-26c4-4882-b5ff-bb04a0f50422 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:36.298237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18a1e5-d474-4c83-9178-9269fdd7a756 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:36.299194 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18a1e5-d474-4c83-9178-9269fdd7a756 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:36.310962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-8e18a1e5-d474-4c83-9178-9269fdd7a756 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:36.310962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:36.310962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:36.310962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:36.310962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:36.310962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:36.310962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:36.310962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:36.310962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:36.310962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:36.310962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:36.310962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:36.310962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:36.310962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:36.310962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:36.313005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:36.313005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:36.313005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:36.313005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:36.313005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:36.313005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:36.313005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:36.313005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:36.313005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:36.313005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:36.313005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:36.313005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:36.313005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:36.313005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:36.313005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:36.313005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:36.313005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:36.315108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:36.315108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:36.315108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:36.315108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:36.315108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:36.315108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:36.315108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:36.315108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:36.315108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 366/729] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:36.315108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18a1e5-d474-4c83-9178-9269fdd7a756 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:36.336932 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:36.341048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bd919-e49b-496e-a12b-313bf18b198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:36.341827 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd919-e49b-496e-a12b-313bf18b198b None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:36.342245 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd919-e49b-496e-a12b-313bf18b198b None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:36.342785 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bd919-e49b-496e-a12b-313bf18b198b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:36.351883 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bd919-e49b-496e-a12b-313bf18b198b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:36.354281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29bd919-e49b-496e-a12b-313bf18b198b None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:36.368888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-b29bd919-e49b-496e-a12b-313bf18b198b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 22:36:36.368888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:36.368888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:36.368888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:36.368888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:36.368888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:36.368888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:36.368888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:36.368888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:36.368888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:36.368888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:36.368888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:36.368888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:36.368888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:36.368888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:36.368888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:36.371216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:36.371216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:36.371216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:36.371216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:36.371216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:36.371216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:36.371216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:36.371216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:36.371216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:36.371216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:36.371216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:36.371216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:36.371216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:36.371216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:36.371216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:36.371216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:36.371216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:36.371216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:36.372546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:36.372546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:36.372546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:36.372546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:36.372546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:36.372546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:36.372546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:36.372546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:36.372546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 22:36:36.372546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:36.372546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 364/730] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jul 27 22:36:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:36.372546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bd919-e49b-496e-a12b-313bf18b198b None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:36.428291 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18a1e5-d474-4c83-9178-9269fdd7a756 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:36.469196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:36.475662 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae883338-2f02-4751-8d74-7cdea0bf6ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:36.476016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae883338-2f02-4751-8d74-7cdea0bf6ae3 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:36.476326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae883338-2f02-4751-8d74-7cdea0bf6ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:36.476644 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae883338-2f02-4751-8d74-7cdea0bf6ae3 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:36.477363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae883338-2f02-4751-8d74-7cdea0bf6ae3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:36.477673 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae883338-2f02-4751-8d74-7cdea0bf6ae3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:36.479300 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae883338-2f02-4751-8d74-7cdea0bf6ae3 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:36.489082 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 367/731] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:36:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:36.490100 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae883338-2f02-4751-8d74-7cdea0bf6ae3 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:36.492161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bd919-e49b-496e-a12b-313bf18b198b None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:36.545208 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4327aae-61bd-49f0-958c-70ccadb0c7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:36.546089 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4327aae-61bd-49f0-958c-70ccadb0c7f4 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:36.546569 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4327aae-61bd-49f0-958c-70ccadb0c7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:36.547007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4327aae-61bd-49f0-958c-70ccadb0c7f4 None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:36.548571 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4327aae-61bd-49f0-958c-70ccadb0c7f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:36.549183 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4327aae-61bd-49f0-958c-70ccadb0c7f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:36.551170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4327aae-61bd-49f0-958c-70ccadb0c7f4 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:36.573310 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 365/732] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:36.574375 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4327aae-61bd-49f0-958c-70ccadb0c7f4 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:36.608711 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae883338-2f02-4751-8d74-7cdea0bf6ae3 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:36.640302 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:36.647541 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d99e1e-c98a-45a3-bb41-3e961e1f4d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:36.649154 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d99e1e-c98a-45a3-bb41-3e961e1f4d6f None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:36.649538 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d99e1e-c98a-45a3-bb41-3e961e1f4d6f None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:36.650148 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d99e1e-c98a-45a3-bb41-3e961e1f4d6f None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:36.650939 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d99e1e-c98a-45a3-bb41-3e961e1f4d6f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:36.651365 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d99e1e-c98a-45a3-bb41-3e961e1f4d6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:36.652929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d99e1e-c98a-45a3-bb41-3e961e1f4d6f None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:36.671713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 368/733] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Jul 27 22:36:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:36.672843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d99e1e-c98a-45a3-bb41-3e961e1f4d6f None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:36.711747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4327aae-61bd-49f0-958c-70ccadb0c7f4 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:36.731374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:36.763547 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020ec3e-3e1c-45e3-bc68-f84fc8ee7dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:36.765085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020ec3e-3e1c-45e3-bc68-f84fc8ee7dbd None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:36.765577 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020ec3e-3e1c-45e3-bc68-f84fc8ee7dbd None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:36.766071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a020ec3e-3e1c-45e3-bc68-f84fc8ee7dbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:36.779708 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020ec3e-3e1c-45e3-bc68-f84fc8ee7dbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:36.782202 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a020ec3e-3e1c-45e3-bc68-f84fc8ee7dbd None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:36.789896 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d99e1e-c98a-45a3-bb41-3e961e1f4d6f None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:36.801345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-a020ec3e-3e1c-45e3-bc68-f84fc8ee7dbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:36.801345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:36.801345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:36.801345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:36.801345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:36.801345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:36.801345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:36.801345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:36.801345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:36.801345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:36.801345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:36.801345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:36.801345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:36.801345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:36.801345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:36.802267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:36.802267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:36.802267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:36.802267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:36.802267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:36.802267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:36.802267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:36.802267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:36.802267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:36.802267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:36.802267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:36.802267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:36.802267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:36.802267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:36.802267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:36.802267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:36.802267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:36.803219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:36.803219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:36.803219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:36.803219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:36.804000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 366/734] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:36.805235 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020ec3e-3e1c-45e3-bc68-f84fc8ee7dbd None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:36.830127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43cbae-1bd7-4188-a8c2-419b12083138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:36.830818 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43cbae-1bd7-4188-a8c2-419b12083138 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:36.831117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43cbae-1bd7-4188-a8c2-419b12083138 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:36.831399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e43cbae-1bd7-4188-a8c2-419b12083138 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:36.832196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43cbae-1bd7-4188-a8c2-419b12083138 None admin] RBAC: Adding query filter params (role.id=49e0ba8d8c9f4824892b61f05d0036e8, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=c621601261e44ca8a7938862d6578639) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:36.832509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43cbae-1bd7-4188-a8c2-419b12083138 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:36.833939 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e43cbae-1bd7-4188-a8c2-419b12083138 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:36.846711 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 369/735] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:36:36 2022] GET /identity/v3/role_assignments?user.id=c621601261e44ca8a7938862d6578639&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=49e0ba8d8c9f4824892b61f05d0036e8 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:36.847870 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43cbae-1bd7-4188-a8c2-419b12083138 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:36.942765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:36.957862 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a020ec3e-3e1c-45e3-bc68-f84fc8ee7dbd None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:36.980980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e43cbae-1bd7-4188-a8c2-419b12083138 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:36.997399 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b15c6-432a-4844-a94c-c57a905fa3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:36.998171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b15c6-432a-4844-a94c-c57a905fa3b5 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:36.998549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b15c6-432a-4844-a94c-c57a905fa3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:36.998897 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b15c6-432a-4844-a94c-c57a905fa3b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:37.002718 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:37.029164 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cec8c-1285-465a-9a6d-303631a3f1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:37.030062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cec8c-1285-465a-9a6d-303631a3f1e0 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:37.030200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cec8c-1285-465a-9a6d-303631a3f1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:37.030537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cec8c-1285-465a-9a6d-303631a3f1e0 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:37.031308 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7cec8c-1285-465a-9a6d-303631a3f1e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:37.031588 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7cec8c-1285-465a-9a6d-303631a3f1e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:37.033101 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7cec8c-1285-465a-9a6d-303631a3f1e0 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:37.047386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 370/736] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:37.048665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a557e-6ecd-4e13-b100-f6b9797e3f1c None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:37.049013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a557e-6ecd-4e13-b100-f6b9797e3f1c None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:37.049531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518a557e-6ecd-4e13-b100-f6b9797e3f1c None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:37.050996 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 371/737] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:37.052449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a557e-6ecd-4e13-b100-f6b9797e3f1c None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:37.078860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b15c6-432a-4844-a94c-c57a905fa3b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:37.080809 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b15c6-432a-4844-a94c-c57a905fa3b5 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:37.171140 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518a557e-6ecd-4e13-b100-f6b9797e3f1c None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:37.199514 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:37.207581 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6995a-2ada-4c9b-be22-36c07991c156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:37.208309 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6995a-2ada-4c9b-be22-36c07991c156 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:37.208665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6995a-2ada-4c9b-be22-36c07991c156 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:37.209014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6995a-2ada-4c9b-be22-36c07991c156 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:37.210568 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 367/738] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:36 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 22:36:37.212330 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d20b5-bbbd-417b-b7f4-820775c36101 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:37.212818 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d20b5-bbbd-417b-b7f4-820775c36101 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:37.213276 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d20b5-bbbd-417b-b7f4-820775c36101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:37.217624 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6995a-2ada-4c9b-be22-36c07991c156 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:37.219348 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6995a-2ada-4c9b-be22-36c07991c156 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:37.232243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-eba6995a-2ada-4c9b-be22-36c07991c156 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 22:36:37.232243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:37.232243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:37.232243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:37.232243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:37.232243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:37.232243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:37.232243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:37.232243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:37.232243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:37.232243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:37.232243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:37.232243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:37.232243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:37.232243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:37.232243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:37.233237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:37.233237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:37.233237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:37.233237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:37.233237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:37.233237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:37.233237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:37.233237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:37.233237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:37.233237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:37.233237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:37.233237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:37.233237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:37.233237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:37.233237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:37.233237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:37.233237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:37.233237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:37.234200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:37.234200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:37.234200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:37.234200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:37.234200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:37.234200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:37.234200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:37.234200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:37.234200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 22:36:37.234200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:37.234200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 372/739] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:36:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:37.234842 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6995a-2ada-4c9b-be22-36c07991c156 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:37.235861 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-292d20b5-bbbd-417b-b7f4-820775c36101 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:37.237267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-292d20b5-bbbd-417b-b7f4-820775c36101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:37.270606 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:37.313745 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 368/740] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:37 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 22:36:37.315338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d20b5-bbbd-417b-b7f4-820775c36101 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:37.354006 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6995a-2ada-4c9b-be22-36c07991c156 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:37.397770 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c50335-f190-41c0-a002-797c456eecd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:37.399257 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c50335-f190-41c0-a002-797c456eecd6 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:37.399546 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c50335-f190-41c0-a002-797c456eecd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:37.399828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c50335-f190-41c0-a002-797c456eecd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:37.412451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c50335-f190-41c0-a002-797c456eecd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:37.414750 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c50335-f190-41c0-a002-797c456eecd6 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:37.422053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d20b5-bbbd-417b-b7f4-820775c36101 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:37.433056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-e1c50335-f190-41c0-a002-797c456eecd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:37.433056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:37.433056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:37.433056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:37.433056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:37.433056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:37.433056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:37.433056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:37.433056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:37.433056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:37.433056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:37.433056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:37.433056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:37.433056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:37.433056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:37.433977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:37.433977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:37.433977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:37.433977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:37.433977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:37.433977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:37.433977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:37.433977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:37.433977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:37.433977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:37.433977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:37.433977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:37.433977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:37.433977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:37.433977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:37.433977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:37.433977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:37.434936 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:37.434936 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:37.434936 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:37.434936 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:37.434936 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 373/741] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:37.435623 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c50335-f190-41c0-a002-797c456eecd6 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:37.450316 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:37.464199 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522723a5-b233-4fbe-b3bd-29838a7d61a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:37.465154 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522723a5-b233-4fbe-b3bd-29838a7d61a3 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:37.465697 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522723a5-b233-4fbe-b3bd-29838a7d61a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:37.466198 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522723a5-b233-4fbe-b3bd-29838a7d61a3 None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:37.467277 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522723a5-b233-4fbe-b3bd-29838a7d61a3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:37.467793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522723a5-b233-4fbe-b3bd-29838a7d61a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:37.469465 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522723a5-b233-4fbe-b3bd-29838a7d61a3 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:37.488500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 369/742] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Jul 27 22:36:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:37.489707 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522723a5-b233-4fbe-b3bd-29838a7d61a3 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:37.544866 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c50335-f190-41c0-a002-797c456eecd6 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:37.583047 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:37.585407 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926f714-2cf4-4c76-8767-20891959e50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:37.586726 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926f714-2cf4-4c76-8767-20891959e50a None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:37.587208 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926f714-2cf4-4c76-8767-20891959e50a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:37.587583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926f714-2cf4-4c76-8767-20891959e50a None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:37.588592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926f714-2cf4-4c76-8767-20891959e50a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:37.589940 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926f714-2cf4-4c76-8767-20891959e50a None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:37.598107 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522723a5-b233-4fbe-b3bd-29838a7d61a3 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:37.611422 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 374/743] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 22:36:37 2022] POST /identity/v3/services => generated 240 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:36:37.612474 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926f714-2cf4-4c76-8767-20891959e50a None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:37.663181 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36870e03-3d2e-472e-97de-5185e0db7b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:37.664770 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36870e03-3d2e-472e-97de-5185e0db7b2f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:37.665206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36870e03-3d2e-472e-97de-5185e0db7b2f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:37.665667 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36870e03-3d2e-472e-97de-5185e0db7b2f None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:37.666632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36870e03-3d2e-472e-97de-5185e0db7b2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:37.667292 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36870e03-3d2e-472e-97de-5185e0db7b2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:37.671356 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36870e03-3d2e-472e-97de-5185e0db7b2f None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:37.697873 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 370/744] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:37.703683 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36870e03-3d2e-472e-97de-5185e0db7b2f None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:37.753533 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926f714-2cf4-4c76-8767-20891959e50a None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:37.785342 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:37.807462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9159e63-b556-4576-ad0b-779d808f02de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:37.808230 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9159e63-b556-4576-ad0b-779d808f02de None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:37.808519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9159e63-b556-4576-ad0b-779d808f02de None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:37.808799 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9159e63-b556-4576-ad0b-779d808f02de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:37.828764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:37.866595 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36870e03-3d2e-472e-97de-5185e0db7b2f None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:37.899396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9159e63-b556-4576-ad0b-779d808f02de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:37.900855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9159e63-b556-4576-ad0b-779d808f02de None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:37.902686 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1384bf81-7e6c-4663-b703-591bab8ec208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:37.903334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384bf81-7e6c-4663-b703-591bab8ec208 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:37.903612 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384bf81-7e6c-4663-b703-591bab8ec208 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:37.903884 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1384bf81-7e6c-4663-b703-591bab8ec208 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:37.911099 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384bf81-7e6c-4663-b703-591bab8ec208 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:37.912794 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1384bf81-7e6c-4663-b703-591bab8ec208 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:37.925001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-1384bf81-7e6c-4663-b703-591bab8ec208 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:37.925001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:37.925001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:37.925001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:37.925001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:37.925001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:37.925001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:37.925001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:37.925001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:37.925001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:37.925001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:37.925001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:37.925001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:37.925001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:37.925001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:37.925941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:37.925941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:37.925941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:37.925941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:37.925941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:37.925941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:37.925941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:37.925941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:37.925941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:37.925941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:37.925941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:37.925941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:37.925941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:37.925941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:37.925941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:37.925941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:37.925941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:37.926911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:37.926911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:37.926911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:37.926911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:37.926911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:37.926911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:37.926911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:37.926911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:37.930452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 371/745] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:37.931695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1bee5-ad2c-489b-b628-917f06d44f72 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:37.931980 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1bee5-ad2c-489b-b628-917f06d44f72 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:37.932255 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1bee5-ad2c-489b-b628-917f06d44f72 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:37.937451 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 372/746] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:37.939462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffb40a-acc7-4d9e-97ed-595511821822 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:37.939746 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffb40a-acc7-4d9e-97ed-595511821822 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:37.940023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ffb40a-acc7-4d9e-97ed-595511821822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:37.958940 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-e5ffb40a-acc7-4d9e-97ed-595511821822 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:37.960033 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e5ffb40a-acc7-4d9e-97ed-595511821822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:38.024758 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 375/747] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 22:36:38.026054 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9159e63-b556-4576-ad0b-779d808f02de None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:38.036263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 373/748] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:36:38.037125 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffb40a-acc7-4d9e-97ed-595511821822 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:38.066969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:38.091657 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:38.148845 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ffb40a-acc7-4d9e-97ed-595511821822 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:38.165222 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9159e63-b556-4576-ad0b-779d808f02de None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:38.185020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af176da4-c6e4-4f9e-8705-3798dc6f98ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:38.185668 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af176da4-c6e4-4f9e-8705-3798dc6f98ae None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:38.185951 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af176da4-c6e4-4f9e-8705-3798dc6f98ae None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:38.186222 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af176da4-c6e4-4f9e-8705-3798dc6f98ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:38.198284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af176da4-c6e4-4f9e-8705-3798dc6f98ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:38.199770 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af176da4-c6e4-4f9e-8705-3798dc6f98ae None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:38.211857 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337e389-520e-4467-992e-0a4321472895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:38.212422 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337e389-520e-4467-992e-0a4321472895 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:38.212707 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337e389-520e-4467-992e-0a4321472895 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:38.212985 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337e389-520e-4467-992e-0a4321472895 None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:38.213739 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337e389-520e-4467-992e-0a4321472895 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:38.214049 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337e389-520e-4467-992e-0a4321472895 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:38.215552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-af176da4-c6e4-4f9e-8705-3798dc6f98ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:38.215552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:38.215552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:38.215552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:38.215552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:38.215552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:38.215552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:38.215552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:38.215552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:38.215552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:38.215552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:38.215552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:38.215552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:38.215552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:38.215552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:38.217870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:38.217870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:38.217870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:38.217870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:38.217870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:38.217870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:38.217870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:38.217870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:38.217870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:38.217870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:38.217870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:38.217870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:38.217870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:38.217870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:38.217870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:38.217870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:38.217870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:38.220186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:38.220186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:38.220186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:38.220186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:38.220632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337e389-520e-4467-992e-0a4321472895 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:38.220763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 374/749] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:38.220763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af176da4-c6e4-4f9e-8705-3798dc6f98ae None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:38.230049 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 376/750] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:38.231416 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337e389-520e-4467-992e-0a4321472895 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:38.316389 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:38.344145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af176da4-c6e4-4f9e-8705-3798dc6f98ae None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:38.348586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337e389-520e-4467-992e-0a4321472895 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:38.356252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:38.386993 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559155f-47b5-4274-aa3c-5b44772e4a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:38.387728 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559155f-47b5-4274-aa3c-5b44772e4a80 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:38.388077 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559155f-47b5-4274-aa3c-5b44772e4a80 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:38.388428 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559155f-47b5-4274-aa3c-5b44772e4a80 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:38.389448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559155f-47b5-4274-aa3c-5b44772e4a80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:38.389845 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559155f-47b5-4274-aa3c-5b44772e4a80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:38.391305 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559155f-47b5-4274-aa3c-5b44772e4a80 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:38.391922 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a18df-a5f2-4bc0-b7eb-cc1c4a54ccb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:38.392985 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a18df-a5f2-4bc0-b7eb-cc1c4a54ccb6 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:38.393432 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a18df-a5f2-4bc0-b7eb-cc1c4a54ccb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:38.394444 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a18df-a5f2-4bc0-b7eb-cc1c4a54ccb6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:38.395231 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a18df-a5f2-4bc0-b7eb-cc1c4a54ccb6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:38.396742 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a18df-a5f2-4bc0-b7eb-cc1c4a54ccb6 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:38.404477 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 377/751] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:38.405387 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559155f-47b5-4274-aa3c-5b44772e4a80 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:38.408264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-858a18df-a5f2-4bc0-b7eb-cc1c4a54ccb6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 22:36:38.408264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:38.408264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:36:38.408264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:36:38.408264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:36:38.408264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:36:38.408264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:36:38.408264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:38.408264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 22:36:38.408264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:38.408264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:36:38.408264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:38.408264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:38.408264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:38.408264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:38.408264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:38.409355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:38.409355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:38.409355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:38.409355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:38.409355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:38.409355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:38.409355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:38.409355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:36:38.409355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:36:38.409355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:36:38.409355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:36:38.409355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:38.409355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:38.409355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:38.409355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:38.409355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:38.410457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:38.410457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:38.410457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:38.410457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:38.410457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:38.410457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:38.410457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:38.410457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:38.410457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:38.410457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:38.410457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:38.410457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:36:38.410457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:38.410457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 22:36:38.410457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:38.413854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 375/752] 10.222.0.48 () {56 vars in 1129 bytes} [Wed Jul 27 22:36:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:38.414806 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a18df-a5f2-4bc0-b7eb-cc1c4a54ccb6 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:38.531213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a18df-a5f2-4bc0-b7eb-cc1c4a54ccb6 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:38.535822 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559155f-47b5-4274-aa3c-5b44772e4a80 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:38.568456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f1e30-d271-41dd-8ca8-8c047d41190c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:38.569246 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f1e30-d271-41dd-8ca8-8c047d41190c None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:38.569650 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f1e30-d271-41dd-8ca8-8c047d41190c None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:38.570029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54f1e30-d271-41dd-8ca8-8c047d41190c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:38.580210 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d9711-1748-4574-9ddf-a82517c69cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:38.581039 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d9711-1748-4574-9ddf-a82517c69cb9 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:38.581479 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d9711-1748-4574-9ddf-a82517c69cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:38.581919 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2d9711-1748-4574-9ddf-a82517c69cb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:38.583169 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d9711-1748-4574-9ddf-a82517c69cb9 None admin] RBAC: Adding query filter params (role.id=7b21a72e7f9348d28d60c78cb0853af7, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=db10ad54ec9948a3bb8b04c708fc4ca7) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:38.583554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f1e30-d271-41dd-8ca8-8c047d41190c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:38.583801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d9711-1748-4574-9ddf-a82517c69cb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:38.585238 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54f1e30-d271-41dd-8ca8-8c047d41190c None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:38.585532 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2d9711-1748-4574-9ddf-a82517c69cb9 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:38.593004 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 378/753] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:36:38 2022] GET /identity/v3/role_assignments?user.id=db10ad54ec9948a3bb8b04c708fc4ca7&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=7b21a72e7f9348d28d60c78cb0853af7 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:38.593992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d9711-1748-4574-9ddf-a82517c69cb9 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:38.598442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-a54f1e30-d271-41dd-8ca8-8c047d41190c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:38.598442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:38.598442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:38.598442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:38.598442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:38.598442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:38.598442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:38.598442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:38.598442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:38.598442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:38.598442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:38.598442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:38.598442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:38.598442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:38.598442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:38.599602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:38.599602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:38.599602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:38.599602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:38.599602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:38.599602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:38.599602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:38.599602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:38.599602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:38.599602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:38.599602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:38.599602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:38.599602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:38.599602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:38.599602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:38.599602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:38.599602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:38.600714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:38.600714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:38.600714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:38.600714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:38.600714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:38.600714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:38.600714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:38.600714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:38.609611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 376/754] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:38.611678 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f1e30-d271-41dd-8ca8-8c047d41190c None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:38.617654 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:38.638683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:38.729741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2d9711-1748-4574-9ddf-a82517c69cb9 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:38.774031 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfac4f9-55a0-4979-aeb6-9865b776c173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:38.774974 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfac4f9-55a0-4979-aeb6-9865b776c173 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:38.775427 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfac4f9-55a0-4979-aeb6-9865b776c173 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:38.776418 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfac4f9-55a0-4979-aeb6-9865b776c173 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:38.777248 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfac4f9-55a0-4979-aeb6-9865b776c173 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:38.777690 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfac4f9-55a0-4979-aeb6-9865b776c173 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:38.779685 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfac4f9-55a0-4979-aeb6-9865b776c173 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:38.786370 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 379/755] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Jul 27 22:36:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:38.793086 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfac4f9-55a0-4979-aeb6-9865b776c173 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:38.807896 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54f1e30-d271-41dd-8ca8-8c047d41190c None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:38.899433 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24851dc-3837-4cbc-ad89-a89f3014c070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:38.900242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24851dc-3837-4cbc-ad89-a89f3014c070 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:38.900626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24851dc-3837-4cbc-ad89-a89f3014c070 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:38.901005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24851dc-3837-4cbc-ad89-a89f3014c070 None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:38.901868 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24851dc-3837-4cbc-ad89-a89f3014c070 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:38.902280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24851dc-3837-4cbc-ad89-a89f3014c070 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:38.903844 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24851dc-3837-4cbc-ad89-a89f3014c070 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:38.908183 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:38.917340 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfac4f9-55a0-4979-aeb6-9865b776c173 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:38.927310 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 377/756] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:38.933399 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24851dc-3837-4cbc-ad89-a89f3014c070 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:38.956792 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ed67d-2cc9-40ee-91d7-6609a0be3c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:38.957759 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ed67d-2cc9-40ee-91d7-6609a0be3c31 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:38.958223 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ed67d-2cc9-40ee-91d7-6609a0be3c31 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:38.958698 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1ed67d-2cc9-40ee-91d7-6609a0be3c31 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:38.960000 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ed67d-2cc9-40ee-91d7-6609a0be3c31 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:38.960496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ed67d-2cc9-40ee-91d7-6609a0be3c31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:38.962878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1ed67d-2cc9-40ee-91d7-6609a0be3c31 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:38.969186 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 380/757] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Jul 27 22:36:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:38.977632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ed67d-2cc9-40ee-91d7-6609a0be3c31 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:39.042087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:39.078018 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24851dc-3837-4cbc-ad89-a89f3014c070 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:39.121409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c00ed0-cbb9-4593-960f-2d89dd914943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:39.122359 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c00ed0-cbb9-4593-960f-2d89dd914943 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:39.122729 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c00ed0-cbb9-4593-960f-2d89dd914943 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:39.123756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c00ed0-cbb9-4593-960f-2d89dd914943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:39.124829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c00ed0-cbb9-4593-960f-2d89dd914943 None admin] RBAC: Adding query filter params (role.id=49e0ba8d8c9f4824892b61f05d0036e8, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=baf405258b9d413fae1192e10250b6a3) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:39.125145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c00ed0-cbb9-4593-960f-2d89dd914943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:39.127727 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c00ed0-cbb9-4593-960f-2d89dd914943 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:39.134277 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 378/758] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:36:38 2022] GET /identity/v3/role_assignments?user.id=baf405258b9d413fae1192e10250b6a3&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=49e0ba8d8c9f4824892b61f05d0036e8 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:39.139379 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7d827-a706-4cf6-9b5b-e886887729d3 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:39.139665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7d827-a706-4cf6-9b5b-e886887729d3 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:39.139946 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7d827-a706-4cf6-9b5b-e886887729d3 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:39.146963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 379/759] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:39.152047 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514327e-c3d0-466b-9f96-dd8926c59173 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:39.152376 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514327e-c3d0-466b-9f96-dd8926c59173 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:39.152595 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a514327e-c3d0-466b-9f96-dd8926c59173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:39.193727 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-a514327e-c3d0-466b-9f96-dd8926c59173 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:39.196251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1ed67d-2cc9-40ee-91d7-6609a0be3c31 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:39.206173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a514327e-c3d0-466b-9f96-dd8926c59173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:39.271708 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bb7dc-1540-47f9-a94f-b263886ed625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:39.272756 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb7dc-1540-47f9-a94f-b263886ed625 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:39.273917 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb7dc-1540-47f9-a94f-b263886ed625 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:39.274434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9bb7dc-1540-47f9-a94f-b263886ed625 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:39.275450 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bb7dc-1540-47f9-a94f-b263886ed625 None admin] RBAC: Adding query filter params (interface=public, service_id=07284a6c1bea472190758592c0f798c5, region_id=RegionOne) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:39.276896 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bb7dc-1540-47f9-a94f-b263886ed625 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:39.280892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9bb7dc-1540-47f9-a94f-b263886ed625 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:39.301493 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 381/760] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jul 27 22:36:38 2022] GET /identity/v3/endpoints?service_id=07284a6c1bea472190758592c0f798c5&interface=public®ion_id=RegionOne => generated 194 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:39.307081 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bb7dc-1540-47f9-a94f-b263886ed625 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:39.308840 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 380/761] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:36:39.340167 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:39.355816 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514327e-c3d0-466b-9f96-dd8926c59173 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:39.422480 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9bb7dc-1540-47f9-a94f-b263886ed625 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:39.467759 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81030ff-adbc-457d-914d-e1bda7b9ba6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:39.468394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81030ff-adbc-457d-914d-e1bda7b9ba6d None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:39.468681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81030ff-adbc-457d-914d-e1bda7b9ba6d None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:39.468957 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81030ff-adbc-457d-914d-e1bda7b9ba6d None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:39.469619 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81030ff-adbc-457d-914d-e1bda7b9ba6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:39.471015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81030ff-adbc-457d-914d-e1bda7b9ba6d None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:39.476618 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 382/762] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jul 27 22:36:39 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:39.477936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:39.564589 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a514327e-c3d0-466b-9f96-dd8926c59173 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:39.633216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232b670-42a4-49b6-804a-6e6805271b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:39.633893 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232b670-42a4-49b6-804a-6e6805271b8d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:39.634174 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232b670-42a4-49b6-804a-6e6805271b8d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:39.634473 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232b670-42a4-49b6-804a-6e6805271b8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:39.656078 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232b670-42a4-49b6-804a-6e6805271b8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:39.661101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-4232b670-42a4-49b6-804a-6e6805271b8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:36:39.661101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:39.661101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:39.661101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:39.661101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:39.661101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:39.661101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:39.661101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:39.661101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:39.661101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:39.661101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:39.661101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:39.661101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:39.661101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:39.661101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:39.661101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:39.662103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:39.662103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:39.662103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:39.662103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:39.662103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:39.662103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:39.662103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:39.662103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:39.662103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:39.662103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:39.662103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:39.662103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:39.662103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:39.662103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:39.662103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:39.662103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:39.663016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:39.663016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:39.663016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:39.663016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:39.663016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:39.663016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:39.663016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:39.663016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:39.663016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:39.663016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:39.663016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:36:39.663016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:39.663016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 381/763] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:36:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:39.668836 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81030ff-adbc-457d-914d-e1bda7b9ba6d None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:39.767068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:39.782887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81030ff-adbc-457d-914d-e1bda7b9ba6d None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:39.818268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119cfc7-2552-4cb3-ab60-3cf048633703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:39.818874 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119cfc7-2552-4cb3-ab60-3cf048633703 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:39.819160 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119cfc7-2552-4cb3-ab60-3cf048633703 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:39.819433 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119cfc7-2552-4cb3-ab60-3cf048633703 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:39.820795 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119cfc7-2552-4cb3-ab60-3cf048633703 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:39.821101 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119cfc7-2552-4cb3-ab60-3cf048633703 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:39.822552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119cfc7-2552-4cb3-ab60-3cf048633703 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:39.838554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 383/764] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:36:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:39.841948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232b670-42a4-49b6-804a-6e6805271b8d None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:39.884285 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a51bef-7eda-4265-b537-3c9c30bab9cb None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:39.884285 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a51bef-7eda-4265-b537-3c9c30bab9cb None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:39.884285 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a51bef-7eda-4265-b537-3c9c30bab9cb None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:39.888970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 384/765] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:36:39.890516 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40153964-72cd-4d6a-97e3-0739dbc9bd80 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:39.890804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40153964-72cd-4d6a-97e3-0739dbc9bd80 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:39.891084 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40153964-72cd-4d6a-97e3-0739dbc9bd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:39.912965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-40153964-72cd-4d6a-97e3-0739dbc9bd80 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:39.914794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-40153964-72cd-4d6a-97e3-0739dbc9bd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:39.969898 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232b670-42a4-49b6-804a-6e6805271b8d None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:40.007079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:40.046471 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 385/766] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:36:40.059063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2ac05-740b-41eb-b367-d3038406d380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:40.059790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2ac05-740b-41eb-b367-d3038406d380 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:40.060087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2ac05-740b-41eb-b367-d3038406d380 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:40.060374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2ac05-740b-41eb-b367-d3038406d380 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:40.066136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40153964-72cd-4d6a-97e3-0739dbc9bd80 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:40.080432 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2ac05-740b-41eb-b367-d3038406d380 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:40.081825 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2ac05-740b-41eb-b367-d3038406d380 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:40.110071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-a1b2ac05-740b-41eb-b367-d3038406d380 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:40.110071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:40.110071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:40.110071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:40.110071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:40.110071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:40.110071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:40.110071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:40.110071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:40.110071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:40.110071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:40.110071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:40.110071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:40.110071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:40.110071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:40.111055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:40.111055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:40.111055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:40.111055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:40.111055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:40.111055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:40.111055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:40.111055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:40.111055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:40.111055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:40.111055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:40.111055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:40.111055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:40.111055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:40.111055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:40.111055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:40.111055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:40.111952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:40.111952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:40.111952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:40.111952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:40.122054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 382/767] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:40.126050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2ac05-740b-41eb-b367-d3038406d380 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:40.182770 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:40.225666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40153964-72cd-4d6a-97e3-0739dbc9bd80 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:40.255794 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2ac05-740b-41eb-b367-d3038406d380 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:40.293300 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45729f8c-a1a2-4fe2-8851-9e4a007344d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:40.293957 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45729f8c-a1a2-4fe2-8851-9e4a007344d8 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:40.294244 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45729f8c-a1a2-4fe2-8851-9e4a007344d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:40.294644 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45729f8c-a1a2-4fe2-8851-9e4a007344d8 None admin] PATH_INFO: `/v3/services/network` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:40.295297 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45729f8c-a1a2-4fe2-8851-9e4a007344d8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:40.296668 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45729f8c-a1a2-4fe2-8851-9e4a007344d8 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:40.315032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-45729f8c-a1a2-4fe2-8851-9e4a007344d8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 22:36:40.315032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:40.315032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:36:40.315032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:36:40.315032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:36:40.315032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:36:40.315032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:36:40.315032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:40.315032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 22:36:40.315032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:40.315032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:36:40.315032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:40.315032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:40.315032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:40.315032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:40.315032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:40.315032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:40.316055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:40.316055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:40.316055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:40.316055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:40.316055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:40.316055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:40.316055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:36:40.316055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:36:40.316055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:36:40.316055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:36:40.316055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:40.316055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:40.316055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:40.316055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:40.316055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:40.316055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:40.316916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:40.316916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:40.316916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:40.316916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:40.316916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:40.316916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:40.316916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:40.316916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:40.316916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:40.316916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:40.316916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:36:40.316916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:40.316916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 22:36:40.316916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:40.316916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 386/768] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:40 2022] GET /identity/v3/services/network => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:40.319173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841dd92-c050-454d-9b0d-0017b260729b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:40.319823 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841dd92-c050-454d-9b0d-0017b260729b None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:40.320151 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841dd92-c050-454d-9b0d-0017b260729b None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:40.320437 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841dd92-c050-454d-9b0d-0017b260729b None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:40.321148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841dd92-c050-454d-9b0d-0017b260729b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:40.321489 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841dd92-c050-454d-9b0d-0017b260729b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:40.322963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841dd92-c050-454d-9b0d-0017b260729b None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:40.323221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45729f8c-a1a2-4fe2-8851-9e4a007344d8 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:40.340977 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 383/769] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:40.346200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841dd92-c050-454d-9b0d-0017b260729b None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:40.397823 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:40.513301 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45729f8c-a1a2-4fe2-8851-9e4a007344d8 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:40.525277 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841dd92-c050-454d-9b0d-0017b260729b None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:40.577983 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414485ec-dbe9-45d6-a012-c96d1d1c3471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:40.578842 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414485ec-dbe9-45d6-a012-c96d1d1c3471 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:40.579134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414485ec-dbe9-45d6-a012-c96d1d1c3471 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:40.579418 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414485ec-dbe9-45d6-a012-c96d1d1c3471 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:40.584382 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414485ec-dbe9-45d6-a012-c96d1d1c3471 None admin] RBAC: Adding query filter params (name=network) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:40.584382 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414485ec-dbe9-45d6-a012-c96d1d1c3471 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:40.584382 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414485ec-dbe9-45d6-a012-c96d1d1c3471 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:40.594274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8794950-5be1-425a-8c20-d496ed0d428e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:40.594893 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8794950-5be1-425a-8c20-d496ed0d428e None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:40.595179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8794950-5be1-425a-8c20-d496ed0d428e None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:40.595455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8794950-5be1-425a-8c20-d496ed0d428e None admin] PATH_INFO: `/v3/users/nova` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:40.597968 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 387/770] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 22:36:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:40.604216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414485ec-dbe9-45d6-a012-c96d1d1c3471 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:40.607681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8794950-5be1-425a-8c20-d496ed0d428e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:40.616441 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8794950-5be1-425a-8c20-d496ed0d428e None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:40.617263 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:40.637429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-a8794950-5be1-425a-8c20-d496ed0d428e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 22:36:40.637429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:40.637429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:40.637429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:40.637429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:40.637429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:40.637429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:40.637429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:40.637429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:40.637429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:40.637429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:40.637429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:40.637429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:40.637429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:40.637429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:40.637429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:40.638463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:40.638463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:40.638463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:40.638463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:40.638463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:40.638463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:40.638463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:40.638463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:40.638463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:40.638463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:40.638463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:40.638463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:40.638463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:40.638463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:40.638463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:40.638463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:40.638463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:40.638463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:40.639430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:40.639430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:40.639430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:40.639430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:40.639430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:40.639430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:40.639430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:40.639430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:40.639430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 22:36:40.639430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:40.639430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 384/771] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jul 27 22:36:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:40.646974 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8794950-5be1-425a-8c20-d496ed0d428e None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:40.781131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414485ec-dbe9-45d6-a012-c96d1d1c3471 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:40.813544 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:40.832429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8794950-5be1-425a-8c20-d496ed0d428e None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:40.846249 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6337f57-bbb2-4cfd-b673-2b60f83a742c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:40.846842 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6337f57-bbb2-4cfd-b673-2b60f83a742c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:40.847129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6337f57-bbb2-4cfd-b673-2b60f83a742c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:40.847409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6337f57-bbb2-4cfd-b673-2b60f83a742c None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:40.849151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6337f57-bbb2-4cfd-b673-2b60f83a742c None admin] RBAC: Adding query filter params (type=network) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:40.849467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6337f57-bbb2-4cfd-b673-2b60f83a742c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:40.850883 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6337f57-bbb2-4cfd-b673-2b60f83a742c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:40.861279 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 388/772] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 22:36:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:40.869333 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6337f57-bbb2-4cfd-b673-2b60f83a742c None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:40.897183 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f50d17-f77f-4b96-8b7f-eed8fc4d08ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:40.897980 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f50d17-f77f-4b96-8b7f-eed8fc4d08ea None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:40.899749 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f50d17-f77f-4b96-8b7f-eed8fc4d08ea None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:40.900039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f50d17-f77f-4b96-8b7f-eed8fc4d08ea None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:40.900851 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f50d17-f77f-4b96-8b7f-eed8fc4d08ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:40.901167 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f50d17-f77f-4b96-8b7f-eed8fc4d08ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:40.903446 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f50d17-f77f-4b96-8b7f-eed8fc4d08ea None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:40.938079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 385/773] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jul 27 22:36:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:40.943207 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f50d17-f77f-4b96-8b7f-eed8fc4d08ea None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:40.991924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:41.050379 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6337f57-bbb2-4cfd-b673-2b60f83a742c None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:41.095737 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac98ac7-c3de-4edf-8b9b-457d9422e577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:41.096791 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac98ac7-c3de-4edf-8b9b-457d9422e577 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:41.097279 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac98ac7-c3de-4edf-8b9b-457d9422e577 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:41.097756 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac98ac7-c3de-4edf-8b9b-457d9422e577 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:41.098744 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac98ac7-c3de-4edf-8b9b-457d9422e577 None admin] RBAC: Adding query filter params (interface=public, service_id=1fab897166c349b8887c2978dfc6161d, region_id=RegionOne) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:41.099288 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac98ac7-c3de-4edf-8b9b-457d9422e577 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:41.100851 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac98ac7-c3de-4edf-8b9b-457d9422e577 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:41.111921 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 389/774] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jul 27 22:36:40 2022] GET /identity/v3/endpoints?service_id=1fab897166c349b8887c2978dfc6161d&interface=public®ion_id=RegionOne => generated 194 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:41.118416 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac98ac7-c3de-4edf-8b9b-457d9422e577 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:41.129531 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f50d17-f77f-4b96-8b7f-eed8fc4d08ea None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:41.175928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c54f28-3ed2-412c-9b90-8ee42866d191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:41.176579 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c54f28-3ed2-412c-9b90-8ee42866d191 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:41.176867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c54f28-3ed2-412c-9b90-8ee42866d191 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:41.177151 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c54f28-3ed2-412c-9b90-8ee42866d191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:41.193649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c54f28-3ed2-412c-9b90-8ee42866d191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:41.195894 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c54f28-3ed2-412c-9b90-8ee42866d191 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:41.205785 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:41.213409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-04c54f28-3ed2-412c-9b90-8ee42866d191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:41.213409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:41.213409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:41.213409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:41.213409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:41.213409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:41.213409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:41.213409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:41.213409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:41.213409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:41.213409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:41.213409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:41.213409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:41.213409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:41.213409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:41.214556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:41.214556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:41.214556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:41.214556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:41.214556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:41.214556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:41.214556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:41.214556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:41.214556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:41.214556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:41.214556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:41.214556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:41.214556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:41.214556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:41.214556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:41.214556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:41.214556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:41.215723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:41.215723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:41.215723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:41.215723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:41.217722 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 386/775] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:41.219240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec91f4-f71a-4bca-a353-4d4ac0ac4160 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:41.219632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec91f4-f71a-4bca-a353-4d4ac0ac4160 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:41.220018 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec91f4-f71a-4bca-a353-4d4ac0ac4160 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:41.225554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 387/776] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:41.225554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec91f4-f71a-4bca-a353-4d4ac0ac4160 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:41.250960 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac98ac7-c3de-4edf-8b9b-457d9422e577 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:41.290624 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fb040-0d6c-4ee0-96a7-a1a175075f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:41.291248 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fb040-0d6c-4ee0-96a7-a1a175075f5b None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:41.291537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fb040-0d6c-4ee0-96a7-a1a175075f5b None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:41.291816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fb040-0d6c-4ee0-96a7-a1a175075f5b None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:41.292477 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fb040-0d6c-4ee0-96a7-a1a175075f5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:41.293971 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fb040-0d6c-4ee0-96a7-a1a175075f5b None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:41.294883 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:41.299747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 390/777] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jul 27 22:36:41 2022] GET /identity/v3/services => generated 772 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:41.301086 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f2f3d-11ac-4602-88c7-d7d86f9d1ae6 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:41.301392 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f2f3d-11ac-4602-88c7-d7d86f9d1ae6 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:41.301736 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f2f3d-11ac-4602-88c7-d7d86f9d1ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:41.323004 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-746f2f3d-11ac-4602-88c7-d7d86f9d1ae6 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:41.324140 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-746f2f3d-11ac-4602-88c7-d7d86f9d1ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:41.349279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec91f4-f71a-4bca-a353-4d4ac0ac4160 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:41.388206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35389c14-32c0-4a68-b007-10f0ddadacd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:41.389116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35389c14-32c0-4a68-b007-10f0ddadacd4 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:41.389592 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35389c14-32c0-4a68-b007-10f0ddadacd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:41.390026 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35389c14-32c0-4a68-b007-10f0ddadacd4 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:41.390955 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35389c14-32c0-4a68-b007-10f0ddadacd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:41.391451 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35389c14-32c0-4a68-b007-10f0ddadacd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:41.393034 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35389c14-32c0-4a68-b007-10f0ddadacd4 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:41.407167 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 391/778] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:36:41.414566 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e19d3-8fc3-4cc2-a762-31ade427c85d None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:41.414566 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e19d3-8fc3-4cc2-a762-31ade427c85d None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:41.414566 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e19d3-8fc3-4cc2-a762-31ade427c85d None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:41.414566 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 392/779] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:41.414935 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 388/780] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:41.415764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e8988-1800-433b-bcc3-11060d016178 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:41.416056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e8988-1800-433b-bcc3-11060d016178 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:41.416334 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e8988-1800-433b-bcc3-11060d016178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:41.422099 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35389c14-32c0-4a68-b007-10f0ddadacd4 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:41.449538 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-fc1e8988-1800-433b-bcc3-11060d016178 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:41.451719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-fc1e8988-1800-433b-bcc3-11060d016178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:41.511174 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:41.558205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35389c14-32c0-4a68-b007-10f0ddadacd4 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:41.567067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 393/781] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:36:41.568416 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e8988-1800-433b-bcc3-11060d016178 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:41.605541 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb04a4-1cc8-4880-b1d1-6737098aac9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:41.606407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb04a4-1cc8-4880-b1d1-6737098aac9d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:41.606706 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb04a4-1cc8-4880-b1d1-6737098aac9d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:41.607097 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb04a4-1cc8-4880-b1d1-6737098aac9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:41.614863 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb04a4-1cc8-4880-b1d1-6737098aac9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:41.616438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb04a4-1cc8-4880-b1d1-6737098aac9d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:41.630952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-04fb04a4-1cc8-4880-b1d1-6737098aac9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:41.630952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:41.630952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:41.630952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:41.630952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:41.630952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:41.630952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:41.630952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:41.630952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:41.630952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:41.630952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:41.630952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:41.630952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:41.630952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:41.630952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:41.631984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:41.631984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:41.631984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:41.631984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:41.631984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:41.631984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:41.631984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:41.631984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:41.631984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:41.631984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:41.631984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:41.631984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:41.631984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:41.631984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:41.631984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:41.631984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:41.631984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:41.632963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:41.632963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:41.632963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:41.632963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:41.632963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:41.632963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:41.632963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:41.632963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:41.632963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 389/782] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:41.633459 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb04a4-1cc8-4880-b1d1-6737098aac9d None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:41.659446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:41.707987 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e8988-1800-433b-bcc3-11060d016178 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:41.745879 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728805e5-eec7-4698-965a-ae3a0e880e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:41.746588 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728805e5-eec7-4698-965a-ae3a0e880e8d None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:41.746880 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728805e5-eec7-4698-965a-ae3a0e880e8d None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:41.747167 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728805e5-eec7-4698-965a-ae3a0e880e8d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:41.758786 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728805e5-eec7-4698-965a-ae3a0e880e8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:41.763757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-728805e5-eec7-4698-965a-ae3a0e880e8d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:41.763757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:41.763757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:41.763757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:41.763757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:41.763757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:41.763757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:41.763757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:41.763757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:41.763757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:41.763757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:41.763757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:41.763757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:41.763757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:41.763757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:41.763757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:41.764722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:41.764722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:41.764722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:41.764722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:41.764722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:41.764722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:41.764722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:41.764722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:41.764722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:41.764722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:41.764722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:41.764722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:41.764722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:41.764722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:41.764722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:41.764722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:41.765575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:41.765575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:41.765575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:41.765575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:41.765575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:41.765575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:41.765575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:41.765575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:41.765575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:41.765575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:41.765575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:41.765575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:41.769766 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 394/783] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:41.770801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728805e5-eec7-4698-965a-ae3a0e880e8d None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:41.773980 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb04a4-1cc8-4880-b1d1-6737098aac9d None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:41.802275 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:41.822223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a116b8-3421-414a-97b4-d235c0915f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:41.823738 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a116b8-3421-414a-97b4-d235c0915f4e None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:41.824503 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a116b8-3421-414a-97b4-d235c0915f4e None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:41.824989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a116b8-3421-414a-97b4-d235c0915f4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:41.840347 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a116b8-3421-414a-97b4-d235c0915f4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:41.848179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-15a116b8-3421-414a-97b4-d235c0915f4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:36:41.848179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:41.848179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:41.848179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:41.848179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:41.848179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:41.848179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:41.848179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:41.848179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:41.848179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:41.848179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:41.848179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:41.848179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:41.848179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:41.848179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:41.848179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:41.849147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:41.849147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:41.849147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:41.849147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:41.849147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:41.849147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:41.849147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:41.849147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:41.849147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:41.849147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:41.849147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:41.849147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:41.849147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:41.849147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:41.849147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:41.849147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:41.850005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:41.850005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:41.850005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:41.850005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:41.850005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:41.850005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:41.850005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:41.850005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:41.850005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:41.850005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:41.850005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:36:41.850005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:41.852438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 390/784] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:36:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:41.858492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a116b8-3421-414a-97b4-d235c0915f4e None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:41.892382 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728805e5-eec7-4698-965a-ae3a0e880e8d None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:41.913122 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:41.933951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e62e2-428e-4dfd-a184-70cd1259e391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:41.934631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e62e2-428e-4dfd-a184-70cd1259e391 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:41.934925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e62e2-428e-4dfd-a184-70cd1259e391 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:41.935210 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5e62e2-428e-4dfd-a184-70cd1259e391 None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:41.936081 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e62e2-428e-4dfd-a184-70cd1259e391 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:41.936399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e62e2-428e-4dfd-a184-70cd1259e391 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:41.937940 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5e62e2-428e-4dfd-a184-70cd1259e391 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:41.955892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 395/785] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:41.956890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e62e2-428e-4dfd-a184-70cd1259e391 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:41.973578 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a116b8-3421-414a-97b4-d235c0915f4e None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:42.008876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6c4a4-2eae-48dd-966f-477f2d448abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:42.009929 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6c4a4-2eae-48dd-966f-477f2d448abd None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:42.010463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6c4a4-2eae-48dd-966f-477f2d448abd None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:42.010995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6c4a4-2eae-48dd-966f-477f2d448abd None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:42.011996 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6c4a4-2eae-48dd-966f-477f2d448abd None admin] RBAC: Adding query filter params (name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:42.012523 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6c4a4-2eae-48dd-966f-477f2d448abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:42.014161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6c4a4-2eae-48dd-966f-477f2d448abd None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:42.023783 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 391/786] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:36:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:42.024897 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6c4a4-2eae-48dd-966f-477f2d448abd None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:42.070140 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:42.070330 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5e62e2-428e-4dfd-a184-70cd1259e391 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:42.108806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ad190-2f3e-467b-a39c-3bb57c3f274c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:42.109442 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ad190-2f3e-467b-a39c-3bb57c3f274c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:42.109826 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ad190-2f3e-467b-a39c-3bb57c3f274c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:42.110116 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074ad190-2f3e-467b-a39c-3bb57c3f274c None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:42.110869 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ad190-2f3e-467b-a39c-3bb57c3f274c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:42.111182 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ad190-2f3e-467b-a39c-3bb57c3f274c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:42.112831 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074ad190-2f3e-467b-a39c-3bb57c3f274c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:42.126281 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 396/787] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:36:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:42.126281 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ad190-2f3e-467b-a39c-3bb57c3f274c None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:42.137670 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6c4a4-2eae-48dd-966f-477f2d448abd None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:42.167107 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:42.178039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912e2060-6a91-4ab1-9454-837cbb329850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:42.178761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e2060-6a91-4ab1-9454-837cbb329850 None admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:42.179055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e2060-6a91-4ab1-9454-837cbb329850 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:42.179351 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912e2060-6a91-4ab1-9454-837cbb329850 None admin] PATH_INFO: `/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/c621601261e44ca8a7938862d6578639/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:42.181327 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e2060-6a91-4ab1-9454-837cbb329850 None admin] RBAC: Authorizing `identity:create_grant(project_id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user_id=c621601261e44ca8a7938862d6578639, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:42.182796 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912e2060-6a91-4ab1-9454-837cbb329850 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:42.196460 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 392/788] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:36:42 2022] PUT /identity/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/c621601261e44ca8a7938862d6578639/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:36:42.197949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06937d-5e06-4fac-9301-5cb61d661e10 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:42.198310 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06937d-5e06-4fac-9301-5cb61d661e10 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:42.198705 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06937d-5e06-4fac-9301-5cb61d661e10 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:42.200270 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 393/789] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:42.200896 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06937d-5e06-4fac-9301-5cb61d661e10 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:42.256255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074ad190-2f3e-467b-a39c-3bb57c3f274c None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:42.297101 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b40bf75-e787-41bb-8d79-45cc0a7f3ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:42.297807 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40bf75-e787-41bb-8d79-45cc0a7f3ddd None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:42.298136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40bf75-e787-41bb-8d79-45cc0a7f3ddd None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:42.298458 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40bf75-e787-41bb-8d79-45cc0a7f3ddd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:42.311312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40bf75-e787-41bb-8d79-45cc0a7f3ddd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:42.312995 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b40bf75-e787-41bb-8d79-45cc0a7f3ddd None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:42.331165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-0b40bf75-e787-41bb-8d79-45cc0a7f3ddd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:42.331165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:42.331165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:42.331165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:42.331165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:42.331165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:42.331165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:42.331165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:42.331165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:42.331165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:42.331165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:42.331165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:42.331165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:42.331165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:42.331165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:42.332157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:42.332157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:42.332157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:42.332157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:42.332157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:42.332157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:42.332157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:42.332157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:42.332157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:42.332157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:42.332157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:42.332157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:42.332157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:42.332157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:42.332157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:42.332157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:42.332157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:42.333067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:42.333067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:42.333067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:42.333067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:42.338169 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 397/790] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:42.339712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f3901-1e07-4ef4-bc7c-a922add44adc None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:42.340001 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f3901-1e07-4ef4-bc7c-a922add44adc None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:42.340410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885f3901-1e07-4ef4-bc7c-a922add44adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:42.360651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-885f3901-1e07-4ef4-bc7c-a922add44adc None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:42.361868 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-885f3901-1e07-4ef4-bc7c-a922add44adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:42.368316 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06937d-5e06-4fac-9301-5cb61d661e10 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:42.370073 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:42.411577 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395907f-e1e0-49a0-8d8d-45a318e1e6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:42.412518 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395907f-e1e0-49a0-8d8d-45a318e1e6f4 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:42.412985 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395907f-e1e0-49a0-8d8d-45a318e1e6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:42.413444 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395907f-e1e0-49a0-8d8d-45a318e1e6f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:42.424878 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395907f-e1e0-49a0-8d8d-45a318e1e6f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:42.427159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395907f-e1e0-49a0-8d8d-45a318e1e6f4 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:42.442159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-3395907f-e1e0-49a0-8d8d-45a318e1e6f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:42.442159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:42.442159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:42.442159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:42.442159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:42.442159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:42.442159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:42.442159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:42.442159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:42.442159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:42.442159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:42.442159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:42.442159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:42.442159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:42.442159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:42.443139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:42.443139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:42.443139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:42.443139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:42.443139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:42.443139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:42.443139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:42.443139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:42.443139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:42.443139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:42.443139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:42.443139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:42.443139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:42.443139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:42.443139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:42.443139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:42.443139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:42.444060 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:42.444060 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:42.444060 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:42.444060 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:42.444285 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 398/791] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:36:42.444285 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f3901-1e07-4ef4-bc7c-a922add44adc None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:42.446957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 394/792] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:42.455447 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395907f-e1e0-49a0-8d8d-45a318e1e6f4 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:42.474251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:42.584616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395907f-e1e0-49a0-8d8d-45a318e1e6f4 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:42.588540 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885f3901-1e07-4ef4-bc7c-a922add44adc None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:42.631454 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198673bb-83e1-4433-9369-dc2f1267f22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:42.631997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198673bb-83e1-4433-9369-dc2f1267f22d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:42.632279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198673bb-83e1-4433-9369-dc2f1267f22d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:42.633161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198673bb-83e1-4433-9369-dc2f1267f22d None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:42.634119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198673bb-83e1-4433-9369-dc2f1267f22d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:42.634456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198673bb-83e1-4433-9369-dc2f1267f22d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:42.636023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198673bb-83e1-4433-9369-dc2f1267f22d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:42.636808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6381af5-3fa4-4c27-ae19-606817af1ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:42.637937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6381af5-3fa4-4c27-ae19-606817af1ad8 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:42.638988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6381af5-3fa4-4c27-ae19-606817af1ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:42.639490 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6381af5-3fa4-4c27-ae19-606817af1ad8 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:42.640389 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6381af5-3fa4-4c27-ae19-606817af1ad8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:42.640901 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6381af5-3fa4-4c27-ae19-606817af1ad8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:42.642504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6381af5-3fa4-4c27-ae19-606817af1ad8 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:42.653575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 395/793] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:42.654804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198673bb-83e1-4433-9369-dc2f1267f22d None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:42.658015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 399/794] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:42.666689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6381af5-3fa4-4c27-ae19-606817af1ad8 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:42.678125 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:42.759105 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:42.767737 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198673bb-83e1-4433-9369-dc2f1267f22d None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:42.780607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6381af5-3fa4-4c27-ae19-606817af1ad8 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:42.802004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359dfc1-6e3f-4a5f-9260-5d26d9af2892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:42.802994 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359dfc1-6e3f-4a5f-9260-5d26d9af2892 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:42.803477 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359dfc1-6e3f-4a5f-9260-5d26d9af2892 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:42.803974 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9359dfc1-6e3f-4a5f-9260-5d26d9af2892 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:42.805339 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359dfc1-6e3f-4a5f-9260-5d26d9af2892 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:42.806916 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9359dfc1-6e3f-4a5f-9260-5d26d9af2892 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:42.816471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-9359dfc1-6e3f-4a5f-9260-5d26d9af2892 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 22:36:42.816471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:42.816471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:36:42.816471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:36:42.816471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:36:42.816471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:36:42.816471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:36:42.816471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:42.816471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 22:36:42.816471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:42.816471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:36:42.816471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:42.816471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:42.816471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:42.816471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:42.816471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:42.817431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:42.817431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:42.817431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:42.817431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:42.817431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:42.817431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:42.817431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:42.817431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:36:42.817431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:36:42.817431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:36:42.817431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:36:42.817431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:42.817431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:42.817431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:42.817431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:42.817431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:42.818272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:42.818272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:42.818272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:42.818272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:42.818272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:42.818272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:42.818272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:42.818272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:42.818272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:42.818272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:42.818272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:42.818272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:36:42.818272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:42.818272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 22:36:42.818272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:42.819093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88e1bd-a08d-41e4-9a66-6be2a71f661a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:42.819093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88e1bd-a08d-41e4-9a66-6be2a71f661a None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:42.819093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88e1bd-a08d-41e4-9a66-6be2a71f661a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:42.819093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b88e1bd-a08d-41e4-9a66-6be2a71f661a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:42.827149 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 396/795] 10.222.0.48 () {56 vars in 1129 bytes} [Wed Jul 27 22:36:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:42.828210 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88e1bd-a08d-41e4-9a66-6be2a71f661a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:42.828532 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359dfc1-6e3f-4a5f-9260-5d26d9af2892 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:42.829671 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b88e1bd-a08d-41e4-9a66-6be2a71f661a None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:42.842273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-2b88e1bd-a08d-41e4-9a66-6be2a71f661a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 22:36:42.842273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:42.842273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:42.842273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:42.842273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:42.842273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:42.842273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:42.842273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:42.842273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:42.842273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:42.842273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:42.842273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:42.842273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:42.842273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:42.842273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:42.842273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:42.843287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:42.843287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:42.843287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:42.843287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:42.843287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:42.843287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:42.843287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:42.843287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:42.843287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:42.843287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:42.843287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:42.843287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:42.843287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:42.843287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:42.843287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:42.843287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:42.843287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:42.843287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:42.844260 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:42.844260 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:42.844260 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:42.844260 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:42.844260 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:42.844260 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:42.844260 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:42.844260 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:42.844260 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 22:36:42.844260 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:42.848318 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 400/796] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jul 27 22:36:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:42.849195 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88e1bd-a08d-41e4-9a66-6be2a71f661a None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:42.913577 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:42.936589 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9359dfc1-6e3f-4a5f-9260-5d26d9af2892 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:42.961510 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b88e1bd-a08d-41e4-9a66-6be2a71f661a None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:42.972422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb4792-c639-4cbc-b360-99069093668b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:42.973379 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb4792-c639-4cbc-b360-99069093668b None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:42.973889 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb4792-c639-4cbc-b360-99069093668b None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:42.974385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb4792-c639-4cbc-b360-99069093668b None admin] PATH_INFO: `/v3/users/swift` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:42.982860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb4792-c639-4cbc-b360-99069093668b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:42.984543 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb4792-c639-4cbc-b360-99069093668b None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:42.996800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-38fb4792-c639-4cbc-b360-99069093668b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 22:36:42.996800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:42.996800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:42.996800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:42.996800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:42.996800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:42.996800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:42.996800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:42.996800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:42.996800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:42.996800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:42.996800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:42.996800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:42.996800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:42.996800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:42.996800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:42.997790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:42.997790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:42.997790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:42.997790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:42.997790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:42.997790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:42.997790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:42.997790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:42.997790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:42.997790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:42.997790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:42.997790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:42.997790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:42.997790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:42.997790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:42.997790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:42.997790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:42.997790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:42.998787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:42.998787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:42.998787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:42.998787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:42.998787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:42.998787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:42.998787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:42.998787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:42.998787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 22:36:42.998787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:43.004648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 397/797] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:36:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:43.004648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb4792-c639-4cbc-b360-99069093668b None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:43.007728 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df41c9-68f5-4850-84f5-214f7a4830cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:43.008366 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df41c9-68f5-4850-84f5-214f7a4830cc None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:43.008655 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df41c9-68f5-4850-84f5-214f7a4830cc None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:43.008932 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df41c9-68f5-4850-84f5-214f7a4830cc None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:43.009619 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df41c9-68f5-4850-84f5-214f7a4830cc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:43.009929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df41c9-68f5-4850-84f5-214f7a4830cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:43.011320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df41c9-68f5-4850-84f5-214f7a4830cc None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:43.027045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 401/798] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Jul 27 22:36:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:43.027940 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df41c9-68f5-4850-84f5-214f7a4830cc None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:43.040525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:43.137646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb4792-c639-4cbc-b360-99069093668b None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:43.153273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df41c9-68f5-4850-84f5-214f7a4830cc None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:43.178967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7f132-7686-4597-90ff-c80088b8bc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:43.180121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7f132-7686-4597-90ff-c80088b8bc11 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:43.180418 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7f132-7686-4597-90ff-c80088b8bc11 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:43.180940 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d7f132-7686-4597-90ff-c80088b8bc11 None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:43.182273 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7f132-7686-4597-90ff-c80088b8bc11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:43.182613 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7f132-7686-4597-90ff-c80088b8bc11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:43.184615 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d7f132-7686-4597-90ff-c80088b8bc11 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:43.197743 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6f0b7-439a-42ec-878f-628aea7bdef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:43.198394 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:43.198895 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6f0b7-439a-42ec-878f-628aea7bdef4 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:43.199502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6f0b7-439a-42ec-878f-628aea7bdef4 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:43.200007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6f0b7-439a-42ec-878f-628aea7bdef4 None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:43.202213 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd6f0b7-439a-42ec-878f-628aea7bdef4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:43.202749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd6f0b7-439a-42ec-878f-628aea7bdef4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:43.204514 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd6f0b7-439a-42ec-878f-628aea7bdef4 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:43.214525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 398/799] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Jul 27 22:36:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:43.216111 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7f132-7686-4597-90ff-c80088b8bc11 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:43.234456 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 402/800] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Jul 27 22:36:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:43.234456 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6f0b7-439a-42ec-878f-628aea7bdef4 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:43.301609 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:43.333435 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d7f132-7686-4597-90ff-c80088b8bc11 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:43.346558 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6f0b7-439a-42ec-878f-628aea7bdef4 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:43.371247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46eda7-b711-4932-bdb4-bc9d3957a68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:43.372020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46eda7-b711-4932-bdb4-bc9d3957a68f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:43.372398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46eda7-b711-4932-bdb4-bc9d3957a68f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:43.372768 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46eda7-b711-4932-bdb4-bc9d3957a68f None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:43.373635 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46eda7-b711-4932-bdb4-bc9d3957a68f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:43.374035 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46eda7-b711-4932-bdb4-bc9d3957a68f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:43.375650 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46eda7-b711-4932-bdb4-bc9d3957a68f None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:43.386492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 399/801] 10.222.0.48 () {56 vars in 1124 bytes} [Wed Jul 27 22:36:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:43.387775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46eda7-b711-4932-bdb4-bc9d3957a68f None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:43.390229 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ece6f4-fa0f-4167-ae39-5d7ecc4bc80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:43.391307 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ece6f4-fa0f-4167-ae39-5d7ecc4bc80e None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:43.391750 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ece6f4-fa0f-4167-ae39-5d7ecc4bc80e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:43.392282 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ece6f4-fa0f-4167-ae39-5d7ecc4bc80e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:43.404633 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ece6f4-fa0f-4167-ae39-5d7ecc4bc80e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:43.407387 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ece6f4-fa0f-4167-ae39-5d7ecc4bc80e None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:43.426207 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-05ece6f4-fa0f-4167-ae39-5d7ecc4bc80e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:43.426207 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:43.426207 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:43.426207 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:43.426207 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:43.426207 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:43.426207 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:43.426207 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:43.426207 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:43.426207 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:43.426207 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:43.426207 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:43.426207 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:43.426207 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:43.426207 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:43.427346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:43.427346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:43.427346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:43.427346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:43.427346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:43.427346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:43.427346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:43.427346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:43.427346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:43.427346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:43.427346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:43.427346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:43.427346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:43.427346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:43.427346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:43.427346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:43.427346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:43.428453 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:43.428453 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:43.428453 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:43.428453 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:43.434668 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 403/802] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:43.435662 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ece6f4-fa0f-4167-ae39-5d7ecc4bc80e None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:43.449569 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:43.493849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46eda7-b711-4932-bdb4-bc9d3957a68f None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:43.529218 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa116b1-6d20-4d95-bde2-19fe00b2522e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:43.529864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa116b1-6d20-4d95-bde2-19fe00b2522e None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:43.530148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa116b1-6d20-4d95-bde2-19fe00b2522e None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:43.530462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa116b1-6d20-4d95-bde2-19fe00b2522e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:43.541903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa116b1-6d20-4d95-bde2-19fe00b2522e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:43.543161 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ece6f4-fa0f-4167-ae39-5d7ecc4bc80e None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:43.543369 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa116b1-6d20-4d95-bde2-19fe00b2522e None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:43.558957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-6fa116b1-6d20-4d95-bde2-19fe00b2522e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:43.558957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:43.558957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:43.558957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:43.558957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:43.558957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:43.558957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:43.558957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:43.558957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:43.558957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:43.558957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:43.558957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:43.558957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:43.558957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:43.558957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:43.560057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:43.560057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:43.560057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:43.560057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:43.560057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:43.560057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:43.560057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:43.560057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:43.560057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:43.560057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:43.560057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:43.560057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:43.560057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:43.560057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:43.560057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:43.560057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:43.560057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:43.561216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:43.561216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:43.561216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:43.561216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:43.562249 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:43.564889 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 400/803] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:43.566157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d935d60-23ff-4058-94c0-272850ab58a3 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:43.566475 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d935d60-23ff-4058-94c0-272850ab58a3 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:43.566760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d935d60-23ff-4058-94c0-272850ab58a3 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:43.568023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 401/804] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:43.568711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d935d60-23ff-4058-94c0-272850ab58a3 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:43.589617 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfebb3b-b41e-45cf-9613-6e80d6a5b93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:43.590744 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfebb3b-b41e-45cf-9613-6e80d6a5b93f None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:43.591181 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfebb3b-b41e-45cf-9613-6e80d6a5b93f None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:43.591582 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfebb3b-b41e-45cf-9613-6e80d6a5b93f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:43.592311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfebb3b-b41e-45cf-9613-6e80d6a5b93f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:43.594449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfebb3b-b41e-45cf-9613-6e80d6a5b93f None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:43.624392 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 404/805] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:36:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:36:43.625379 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfebb3b-b41e-45cf-9613-6e80d6a5b93f None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:43.702534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d935d60-23ff-4058-94c0-272850ab58a3 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:43.714764 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:43.747206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cb324-2f10-4b34-acab-43c1b2bb94e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:43.747889 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cb324-2f10-4b34-acab-43c1b2bb94e9 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:43.748180 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cb324-2f10-4b34-acab-43c1b2bb94e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:43.748461 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cb324-2f10-4b34-acab-43c1b2bb94e9 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:43.749236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cb324-2f10-4b34-acab-43c1b2bb94e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:43.749553 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cb324-2f10-4b34-acab-43c1b2bb94e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:43.751775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cb324-2f10-4b34-acab-43c1b2bb94e9 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:43.767423 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfebb3b-b41e-45cf-9613-6e80d6a5b93f None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:43.770499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 402/806] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:43.772131 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183b713-d7ed-4345-8fae-b5d685fc0321 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:43.772627 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183b713-d7ed-4345-8fae-b5d685fc0321 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:43.773680 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183b713-d7ed-4345-8fae-b5d685fc0321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:43.792807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-0183b713-d7ed-4345-8fae-b5d685fc0321 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:43.794326 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-0183b713-d7ed-4345-8fae-b5d685fc0321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:43.811536 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172c6f1-939b-4b8b-b82d-80148eed1d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:43.812174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172c6f1-939b-4b8b-b82d-80148eed1d36 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:43.812456 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172c6f1-939b-4b8b-b82d-80148eed1d36 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:43.812735 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a172c6f1-939b-4b8b-b82d-80148eed1d36 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:43.813541 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172c6f1-939b-4b8b-b82d-80148eed1d36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:43.813844 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172c6f1-939b-4b8b-b82d-80148eed1d36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:43.815366 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a172c6f1-939b-4b8b-b82d-80148eed1d36 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:43.829630 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 405/807] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:43.830828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172c6f1-939b-4b8b-b82d-80148eed1d36 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:43.867259 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:43.886191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 403/808] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:36:43.887437 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183b713-d7ed-4345-8fae-b5d685fc0321 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:43.957606 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a172c6f1-939b-4b8b-b82d-80148eed1d36 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:43.993853 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fe9af-d483-48b9-a9d9-be8d3b70761e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:43.994537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fe9af-d483-48b9-a9d9-be8d3b70761e None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:43.994823 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fe9af-d483-48b9-a9d9-be8d3b70761e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:43.995099 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991fe9af-d483-48b9-a9d9-be8d3b70761e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:44.001869 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:44.002167 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fe9af-d483-48b9-a9d9-be8d3b70761e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:44.003630 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991fe9af-d483-48b9-a9d9-be8d3b70761e None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:44.006810 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183b713-d7ed-4345-8fae-b5d685fc0321 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:44.016607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-991fe9af-d483-48b9-a9d9-be8d3b70761e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:44.016607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:44.016607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:44.016607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:44.016607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:44.016607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:44.016607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:44.016607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:44.016607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:44.016607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:44.016607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:44.016607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:44.016607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:44.016607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:44.016607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:44.017604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:44.017604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:44.017604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:44.017604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:44.017604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:44.017604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:44.017604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:44.017604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:44.017604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:44.017604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:44.017604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:44.017604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:44.017604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:44.017604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:44.017604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:44.017604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:44.017604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:44.018537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:44.018537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:44.018537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:44.018537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:44.018537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:44.018537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:44.018537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:44.018537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:44.024149 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 406/809] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:44.024992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fe9af-d483-48b9-a9d9-be8d3b70761e None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:44.047650 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85be49-b57d-44cb-a04b-01d86966bc22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:44.048605 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85be49-b57d-44cb-a04b-01d86966bc22 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:44.049073 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85be49-b57d-44cb-a04b-01d86966bc22 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:44.049529 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85be49-b57d-44cb-a04b-01d86966bc22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:44.056924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85be49-b57d-44cb-a04b-01d86966bc22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:44.058658 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85be49-b57d-44cb-a04b-01d86966bc22 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:44.071014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-fc85be49-b57d-44cb-a04b-01d86966bc22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:44.071014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:44.071014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:44.071014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:44.071014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:44.071014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:44.071014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:44.071014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:44.071014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:44.071014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:44.071014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:44.071014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:44.071014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:44.071014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:44.071014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:44.072023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:44.072023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:44.072023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:44.072023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:44.072023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:44.072023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:44.072023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:44.072023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:44.072023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:44.072023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:44.072023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:44.072023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:44.072023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:44.072023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:44.072023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:44.072023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:44.072023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:44.072938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:44.072938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:44.072938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:44.072938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:44.072938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:44.072938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:44.072938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:44.072938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:44.075463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 404/810] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:44.076664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85be49-b57d-44cb-a04b-01d86966bc22 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:44.135110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:44.146177 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991fe9af-d483-48b9-a9d9-be8d3b70761e None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:44.191005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85be49-b57d-44cb-a04b-01d86966bc22 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:44.196914 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddab12-b8b4-4959-910a-ac4518738c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:44.197651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddab12-b8b4-4959-910a-ac4518738c8e None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:44.198075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddab12-b8b4-4959-910a-ac4518738c8e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:44.198460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddab12-b8b4-4959-910a-ac4518738c8e None admin] PATH_INFO: `/v3/services/network` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:44.199232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddab12-b8b4-4959-910a-ac4518738c8e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:44.200685 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ddab12-b8b4-4959-910a-ac4518738c8e None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:44.214112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-e0ddab12-b8b4-4959-910a-ac4518738c8e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 22:36:44.214112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:44.214112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:36:44.214112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:36:44.214112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:36:44.214112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:36:44.214112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:36:44.214112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:44.214112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 22:36:44.214112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:44.214112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:36:44.214112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:44.214112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:44.214112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:44.214112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:44.214112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:44.214112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:44.215166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:44.215166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:44.215166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:44.215166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:44.215166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:44.215166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:44.215166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:36:44.215166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:36:44.215166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:36:44.215166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:36:44.215166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:44.215166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:44.215166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:44.215166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:44.215166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:44.215166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:44.216015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:44.216015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:44.216015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:44.216015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:44.216015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:44.216015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:44.216015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:44.216015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:44.216015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:44.216015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:44.216015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:36:44.216015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:44.216015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 22:36:44.216015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:44.216015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 407/811] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:44 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:44.216826 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddab12-b8b4-4959-910a-ac4518738c8e None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:44.235992 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e1a84-0c19-4953-bf13-d2de988cee87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:44.236985 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e1a84-0c19-4953-bf13-d2de988cee87 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:44.237498 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e1a84-0c19-4953-bf13-d2de988cee87 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:44.237977 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e1a84-0c19-4953-bf13-d2de988cee87 None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:44.238957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e1a84-0c19-4953-bf13-d2de988cee87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:44.239473 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e1a84-0c19-4953-bf13-d2de988cee87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:44.241113 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e1a84-0c19-4953-bf13-d2de988cee87 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:44.255530 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 405/812] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:44.256661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e1a84-0c19-4953-bf13-d2de988cee87 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:44.278864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:44.358739 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddab12-b8b4-4959-910a-ac4518738c8e None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:44.378330 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e1a84-0c19-4953-bf13-d2de988cee87 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:44.393590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b819c50-29dc-4d60-b7e9-c75f829a450e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:44.394211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b819c50-29dc-4d60-b7e9-c75f829a450e None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:44.394520 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b819c50-29dc-4d60-b7e9-c75f829a450e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:44.394797 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b819c50-29dc-4d60-b7e9-c75f829a450e None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:44.395548 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b819c50-29dc-4d60-b7e9-c75f829a450e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:44.395857 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b819c50-29dc-4d60-b7e9-c75f829a450e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:44.397274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b819c50-29dc-4d60-b7e9-c75f829a450e None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:44.409362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 408/813] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:44.410164 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b819c50-29dc-4d60-b7e9-c75f829a450e None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:44.415735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d333d4a5-9d4c-4cd2-8ae8-7987735b5f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:44.416409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333d4a5-9d4c-4cd2-8ae8-7987735b5f1a None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:44.416697 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333d4a5-9d4c-4cd2-8ae8-7987735b5f1a None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:44.417022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d333d4a5-9d4c-4cd2-8ae8-7987735b5f1a None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:44.417708 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333d4a5-9d4c-4cd2-8ae8-7987735b5f1a None admin] RBAC: Adding query filter params (name=network) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:44.418015 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333d4a5-9d4c-4cd2-8ae8-7987735b5f1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:44.419438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d333d4a5-9d4c-4cd2-8ae8-7987735b5f1a None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:44.424773 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 406/814] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 22:36:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:44.426375 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c3815-1ec6-407a-a716-5a5460786e75 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:44.426375 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c3815-1ec6-407a-a716-5a5460786e75 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:44.430169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c3815-1ec6-407a-a716-5a5460786e75 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:44.430467 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 407/815] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:44.431215 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c3815-1ec6-407a-a716-5a5460786e75 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:44.435522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:44.518227 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:44.529331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b819c50-29dc-4d60-b7e9-c75f829a450e None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:44.539585 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c3815-1ec6-407a-a716-5a5460786e75 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:44.570890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7255c8-810b-4321-a928-17cedfa7d707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:44.571611 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7255c8-810b-4321-a928-17cedfa7d707 None admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:44.572026 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7255c8-810b-4321-a928-17cedfa7d707 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:44.572310 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7255c8-810b-4321-a928-17cedfa7d707 None admin] PATH_INFO: `/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/db10ad54ec9948a3bb8b04c708fc4ca7/roles/7b21a72e7f9348d28d60c78cb0853af7` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:44.583912 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efea54-b44e-4a1f-95ac-dd48f03b1a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:44.585006 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efea54-b44e-4a1f-95ac-dd48f03b1a2c None admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:44.585295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efea54-b44e-4a1f-95ac-dd48f03b1a2c None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:44.585617 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efea54-b44e-4a1f-95ac-dd48f03b1a2c None admin] PATH_INFO: `/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/baf405258b9d413fae1192e10250b6a3/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:44.587578 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efea54-b44e-4a1f-95ac-dd48f03b1a2c None admin] RBAC: Authorizing `identity:create_grant(project_id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user_id=baf405258b9d413fae1192e10250b6a3, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:44.589010 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75efea54-b44e-4a1f-95ac-dd48f03b1a2c None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:44.591334 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7255c8-810b-4321-a928-17cedfa7d707 None admin] RBAC: Authorizing `identity:create_grant(project_id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user_id=db10ad54ec9948a3bb8b04c708fc4ca7, role_id=7b21a72e7f9348d28d60c78cb0853af7)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:44.593428 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7255c8-810b-4321-a928-17cedfa7d707 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:44.604663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 408/816] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:36:44 2022] PUT /identity/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/baf405258b9d413fae1192e10250b6a3/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:36:44.605503 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efea54-b44e-4a1f-95ac-dd48f03b1a2c None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:44.620306 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 409/817] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:36:44 2022] PUT /identity/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/db10ad54ec9948a3bb8b04c708fc4ca7/roles/7b21a72e7f9348d28d60c78cb0853af7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:36:44.622196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcef6e7-c225-46a2-aa59-4e8f7aeacceb None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:44.622808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcef6e7-c225-46a2-aa59-4e8f7aeacceb None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:44.623319 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcef6e7-c225-46a2-aa59-4e8f7aeacceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:44.645905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-fbcef6e7-c225-46a2-aa59-4e8f7aeacceb None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:44.647785 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-fbcef6e7-c225-46a2-aa59-4e8f7aeacceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:44.722771 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:44.733824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 410/818] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:36:44.760088 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcef6e7-c225-46a2-aa59-4e8f7aeacceb None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:44.808074 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efea54-b44e-4a1f-95ac-dd48f03b1a2c None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:44.848074 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7663d64-f198-4398-8b53-9aa0cbfa7486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:44.848471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7663d64-f198-4398-8b53-9aa0cbfa7486 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:44.848666 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7663d64-f198-4398-8b53-9aa0cbfa7486 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:44.848928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7663d64-f198-4398-8b53-9aa0cbfa7486 None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:44.849630 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7663d64-f198-4398-8b53-9aa0cbfa7486 None admin] RBAC: Adding query filter params (type=network) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:44.849943 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7663d64-f198-4398-8b53-9aa0cbfa7486 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:44.851960 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7663d64-f198-4398-8b53-9aa0cbfa7486 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:44.858052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 409/819] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 22:36:44 2022] GET /identity/v3/services?type=network => generated 350 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:44.863747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7663d64-f198-4398-8b53-9aa0cbfa7486 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:44.874303 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:44.881803 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcef6e7-c225-46a2-aa59-4e8f7aeacceb None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:44.922671 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9ab00-c47d-434a-98e3-17818f0d82ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:44.923236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9ab00-c47d-434a-98e3-17818f0d82ec None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:44.923533 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9ab00-c47d-434a-98e3-17818f0d82ec None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:44.923874 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9ab00-c47d-434a-98e3-17818f0d82ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:44.936143 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9ab00-c47d-434a-98e3-17818f0d82ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:44.942151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-21a9ab00-c47d-434a-98e3-17818f0d82ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:36:44.942151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:44.942151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:44.942151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:44.942151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:44.942151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:44.942151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:44.942151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:44.942151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:44.942151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:44.942151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:44.942151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:44.942151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:44.942151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:44.942151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:44.942151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:44.943136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:44.943136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:44.943136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:44.943136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:44.943136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:44.943136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:44.943136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:44.943136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:44.943136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:44.943136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:44.943136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:44.943136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:44.943136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:44.943136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:44.943136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:44.943136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:44.944404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:44.944404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:44.944404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:44.944404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:44.944404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:44.944404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:44.944404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:44.944404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:44.944404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:44.944404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:44.944404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:36:44.944404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:44.944404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 411/820] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:36:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:44.949820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9ab00-c47d-434a-98e3-17818f0d82ec None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:44.994614 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7663d64-f198-4398-8b53-9aa0cbfa7486 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:45.042216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1decbd-4342-44f9-92f0-05f4c852e5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:45.042700 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:45.042884 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1decbd-4342-44f9-92f0-05f4c852e5b9 None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:45.043157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1decbd-4342-44f9-92f0-05f4c852e5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:45.043674 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1decbd-4342-44f9-92f0-05f4c852e5b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:45.044364 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1decbd-4342-44f9-92f0-05f4c852e5b9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:45.045744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1decbd-4342-44f9-92f0-05f4c852e5b9 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:45.087918 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 410/821] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:36:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:36:45.110024 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9ab00-c47d-434a-98e3-17818f0d82ec None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:45.159575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111ba2e-9490-4c32-a4a4-fdfd696c07cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:45.160530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111ba2e-9490-4c32-a4a4-fdfd696c07cc None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:45.160966 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111ba2e-9490-4c32-a4a4-fdfd696c07cc None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:45.161387 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0111ba2e-9490-4c32-a4a4-fdfd696c07cc None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:45.162292 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111ba2e-9490-4c32-a4a4-fdfd696c07cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:45.162781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111ba2e-9490-4c32-a4a4-fdfd696c07cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:45.164945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0111ba2e-9490-4c32-a4a4-fdfd696c07cc None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:45.175201 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 412/822] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:36:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:45.180930 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1decbd-4342-44f9-92f0-05f4c852e5b9 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:45.273077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:45.320922 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1decbd-4342-44f9-92f0-05f4c852e5b9 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:45.358603 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178c672-2065-4582-abf3-4676aadf1f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:45.359189 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178c672-2065-4582-abf3-4676aadf1f5a None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:45.359473 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178c672-2065-4582-abf3-4676aadf1f5a None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:45.359754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1178c672-2065-4582-abf3-4676aadf1f5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:45.374870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178c672-2065-4582-abf3-4676aadf1f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:45.376351 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1178c672-2065-4582-abf3-4676aadf1f5a None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:45.397664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-1178c672-2065-4582-abf3-4676aadf1f5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:45.397664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:45.397664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:45.397664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:45.397664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:45.397664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:45.397664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:45.397664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:45.397664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:45.397664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:45.397664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:45.397664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:45.397664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:45.397664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:45.397664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:45.399239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:45.399239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:45.399239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:45.399239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:45.399239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:45.399239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:45.399239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:45.399239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:45.399239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:45.399239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:45.399239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:45.399239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:45.399239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:45.399239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:45.399239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:45.399239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:45.399239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:45.400172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:45.400172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:45.400172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:45.400172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:45.400172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 411/823] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:45.407463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111ba2e-9490-4c32-a4a4-fdfd696c07cc None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:45.531631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0111ba2e-9490-4c32-a4a4-fdfd696c07cc None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:45.548053 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:45.572913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918a633-4e54-48c5-861f-85190db41d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:45.573542 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918a633-4e54-48c5-861f-85190db41d64 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:45.573827 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918a633-4e54-48c5-861f-85190db41d64 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:45.574109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918a633-4e54-48c5-861f-85190db41d64 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:45.574841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918a633-4e54-48c5-861f-85190db41d64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:45.575152 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918a633-4e54-48c5-861f-85190db41d64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:45.576772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918a633-4e54-48c5-861f-85190db41d64 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:45.594901 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 413/824] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:45.600864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178c672-2065-4582-abf3-4676aadf1f5a None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:45.707102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1178c672-2065-4582-abf3-4676aadf1f5a None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:45.721360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:45.750637 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a427caa-edb7-4e39-a932-eb88e31ee915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:45.751570 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a427caa-edb7-4e39-a932-eb88e31ee915 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:45.752004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a427caa-edb7-4e39-a932-eb88e31ee915 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:45.752425 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a427caa-edb7-4e39-a932-eb88e31ee915 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:45.761111 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a427caa-edb7-4e39-a932-eb88e31ee915 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:45.762756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a427caa-edb7-4e39-a932-eb88e31ee915 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:45.774252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-2a427caa-edb7-4e39-a932-eb88e31ee915 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 22:36:45.774252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:45.774252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:45.774252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:45.774252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:45.774252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:45.774252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:45.774252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:45.774252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:45.774252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:45.774252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:45.774252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:45.774252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:45.774252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:45.774252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:45.774252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:45.775401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:45.775401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:45.775401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:45.775401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:45.775401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:45.775401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:45.775401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:45.775401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:45.775401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:45.775401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:45.775401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:45.775401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:45.775401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:45.775401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:45.775401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:45.775401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:45.775401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:45.775401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:45.776581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:45.776581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:45.776581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:45.776581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:45.776581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:45.776581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:45.776581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:45.776581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:45.776581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 22:36:45.776581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:45.778750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 412/825] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jul 27 22:36:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:45.787933 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918a633-4e54-48c5-861f-85190db41d64 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:45.889212 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918a633-4e54-48c5-861f-85190db41d64 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:45.925430 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c78d70-e57f-43fb-8778-c60f81758b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:45.926060 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c78d70-e57f-43fb-8778-c60f81758b31 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:45.926363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c78d70-e57f-43fb-8778-c60f81758b31 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:45.926699 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c78d70-e57f-43fb-8778-c60f81758b31 None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:45.927508 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c78d70-e57f-43fb-8778-c60f81758b31 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:45.927818 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c78d70-e57f-43fb-8778-c60f81758b31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:45.929743 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c78d70-e57f-43fb-8778-c60f81758b31 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:45.933019 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21bba-480a-44de-b77e-fbd935739d86 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:45.933316 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21bba-480a-44de-b77e-fbd935739d86 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:45.933600 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca21bba-480a-44de-b77e-fbd935739d86 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:45.938393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 413/826] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:45.940563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26f259-0b36-4037-a749-d867202dbc30 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:45.940851 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26f259-0b36-4037-a749-d867202dbc30 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:45.941128 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26f259-0b36-4037-a749-d867202dbc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:45.949877 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 414/827] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jul 27 22:36:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:45.956145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c78d70-e57f-43fb-8778-c60f81758b31 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:45.964301 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-cd26f259-0b36-4037-a749-d867202dbc30 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:45.965874 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-cd26f259-0b36-4037-a749-d867202dbc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:45.990545 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:46.062175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 414/828] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:36:46.079450 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c78d70-e57f-43fb-8778-c60f81758b31 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:46.086267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26f259-0b36-4037-a749-d867202dbc30 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:46.120523 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8721e18-c6b6-4c9d-8757-2bc3dc698119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:46.121150 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8721e18-c6b6-4c9d-8757-2bc3dc698119 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:46.121436 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8721e18-c6b6-4c9d-8757-2bc3dc698119 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:46.121716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8721e18-c6b6-4c9d-8757-2bc3dc698119 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:46.194740 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8721e18-c6b6-4c9d-8757-2bc3dc698119 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:46.196362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8721e18-c6b6-4c9d-8757-2bc3dc698119 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:46.196764 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26f259-0b36-4037-a749-d867202dbc30 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:46.199330 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:46.227252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:46.235669 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6147d-1755-4fdb-838f-7eed513d02c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:46.237377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6147d-1755-4fdb-838f-7eed513d02c7 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:46.237825 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6147d-1755-4fdb-838f-7eed513d02c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:46.238418 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6147d-1755-4fdb-838f-7eed513d02c7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:46.239297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6147d-1755-4fdb-838f-7eed513d02c7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:46.240920 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6147d-1755-4fdb-838f-7eed513d02c7 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:46.251602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-cfe6147d-1755-4fdb-838f-7eed513d02c7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 22:36:46.251602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:46.251602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:36:46.251602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:36:46.251602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:36:46.251602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:36:46.251602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:36:46.251602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:46.251602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 22:36:46.251602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:46.251602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:36:46.251602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:46.251602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:46.251602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:46.251602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:46.251602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:46.251602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:46.252704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:46.252704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:46.252704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:46.252704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:46.252704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:46.252704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:46.252704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:36:46.252704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:36:46.252704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:36:46.252704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:36:46.252704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:46.252704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:46.252704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:46.252704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:46.252704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:46.252704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:46.253558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:46.253558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:46.253558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:46.253558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:46.253558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:46.253558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:46.253558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:46.253558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:46.253558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:46.253558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:46.253558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:36:46.253558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:46.253558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 22:36:46.253558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:46.260980 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 415/829] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:36:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:46.262054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6147d-1755-4fdb-838f-7eed513d02c7 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:46.304901 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 415/830] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:45 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 22:36:46.306098 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8721e18-c6b6-4c9d-8757-2bc3dc698119 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:46.371195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6147d-1755-4fdb-838f-7eed513d02c7 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:46.410142 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8721e18-c6b6-4c9d-8757-2bc3dc698119 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:46.410881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074817e-d8e3-4422-aa28-379100ce38c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:46.411750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074817e-d8e3-4422-aa28-379100ce38c7 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:46.412364 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074817e-d8e3-4422-aa28-379100ce38c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:46.413436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1074817e-d8e3-4422-aa28-379100ce38c7 None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:46.415346 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074817e-d8e3-4422-aa28-379100ce38c7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:46.415893 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074817e-d8e3-4422-aa28-379100ce38c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:46.417503 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1074817e-d8e3-4422-aa28-379100ce38c7 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:46.431015 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 416/831] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:36:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:46.432596 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074817e-d8e3-4422-aa28-379100ce38c7 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:46.443126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:46.454359 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582ab21-6ebd-40a8-948b-ae0327f4a4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:46.454987 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582ab21-6ebd-40a8-948b-ae0327f4a4e9 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:46.456830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582ab21-6ebd-40a8-948b-ae0327f4a4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:46.457038 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e582ab21-6ebd-40a8-948b-ae0327f4a4e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:46.474906 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582ab21-6ebd-40a8-948b-ae0327f4a4e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:46.477759 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e582ab21-6ebd-40a8-948b-ae0327f4a4e9 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:46.493602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:46.500909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-e582ab21-6ebd-40a8-948b-ae0327f4a4e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:46.500909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:46.500909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:46.500909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:46.500909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:46.500909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:46.500909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:46.500909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:46.500909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:46.500909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:46.500909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:46.500909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:46.500909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:46.500909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:46.500909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:46.501806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:46.501806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:46.501806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:46.501806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:46.501806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:46.501806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:46.501806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:46.501806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:46.501806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:46.501806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:46.501806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:46.501806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:46.501806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:46.501806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:46.501806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:46.501806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:46.501806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:46.503297 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:46.503297 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:46.503297 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:46.503297 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:46.506468 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 416/832] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:46.508135 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582ab21-6ebd-40a8-948b-ae0327f4a4e9 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:46.573288 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1074817e-d8e3-4422-aa28-379100ce38c7 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:46.611347 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9366d3-aeee-4b72-b77b-c786176f387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:46.612820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9366d3-aeee-4b72-b77b-c786176f387d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:46.613499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9366d3-aeee-4b72-b77b-c786176f387d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:46.613973 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9366d3-aeee-4b72-b77b-c786176f387d None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:46.614976 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9366d3-aeee-4b72-b77b-c786176f387d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:46.615492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9366d3-aeee-4b72-b77b-c786176f387d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:46.617251 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9366d3-aeee-4b72-b77b-c786176f387d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:46.621421 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e582ab21-6ebd-40a8-948b-ae0327f4a4e9 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:46.630549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 417/833] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:36:46 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:46.661139 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4966e8e-4774-4a85-9bec-239e4ec8e704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:46.661814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4966e8e-4774-4a85-9bec-239e4ec8e704 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:46.662097 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4966e8e-4774-4a85-9bec-239e4ec8e704 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:46.662397 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4966e8e-4774-4a85-9bec-239e4ec8e704 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:46.663104 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4966e8e-4774-4a85-9bec-239e4ec8e704 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:46.663411 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4966e8e-4774-4a85-9bec-239e4ec8e704 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:46.665418 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4966e8e-4774-4a85-9bec-239e4ec8e704 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:46.684719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 417/834] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:46.686140 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9366d3-aeee-4b72-b77b-c786176f387d None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:46.806676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:46.814615 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9366d3-aeee-4b72-b77b-c786176f387d None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:46.854650 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368eca4-d08c-41e0-81e7-59c0a2ec407d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:46.855300 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368eca4-d08c-41e0-81e7-59c0a2ec407d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:46.855602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368eca4-d08c-41e0-81e7-59c0a2ec407d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:46.855851 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368eca4-d08c-41e0-81e7-59c0a2ec407d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:46.862790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368eca4-d08c-41e0-81e7-59c0a2ec407d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:46.864219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368eca4-d08c-41e0-81e7-59c0a2ec407d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:46.876711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-6368eca4-d08c-41e0-81e7-59c0a2ec407d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:46.876711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:46.876711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:46.876711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:46.876711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:46.876711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:46.876711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:46.876711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:46.876711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:46.876711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:46.876711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:46.876711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:46.876711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:46.876711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:46.876711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:46.877648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:46.877648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:46.877648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:46.877648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:46.877648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:46.877648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:46.877648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:46.877648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:46.877648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:46.877648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:46.877648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:46.877648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:46.877648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:46.877648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:46.877648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:46.877648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:46.877648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:46.878735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:46.878735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:46.878735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:46.878735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:46.878735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:46.878735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:46.878735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:46.878735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:46.878735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 418/835] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:46.885819 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4966e8e-4774-4a85-9bec-239e4ec8e704 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:46.899684 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e2033-5b2d-4058-b839-d2ef8af75bf2 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:46.899865 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e2033-5b2d-4058-b839-d2ef8af75bf2 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:46.900097 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e2033-5b2d-4058-b839-d2ef8af75bf2 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:46.901674 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 419/836] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:36:46.906583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff3a4d-15e2-4628-8427-72737db84af5 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:46.906868 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff3a4d-15e2-4628-8427-72737db84af5 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:46.907144 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff3a4d-15e2-4628-8427-72737db84af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:46.925816 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-84ff3a4d-15e2-4628-8427-72737db84af5 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:46.927021 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-84ff3a4d-15e2-4628-8427-72737db84af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:46.943774 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:47.010431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 420/837] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:36:47.021372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4966e8e-4774-4a85-9bec-239e4ec8e704 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:47.030982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d70d2e-0b66-4be6-8e14-f56fa0e49147 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:47.031281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d70d2e-0b66-4be6-8e14-f56fa0e49147 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:47.031550 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d70d2e-0b66-4be6-8e14-f56fa0e49147 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:47.033148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 421/838] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:36:47.036190 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d70d2e-0b66-4be6-8e14-f56fa0e49147 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:47.061311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68c2c5-f32a-4381-afb8-63c756c6541a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:47.061982 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68c2c5-f32a-4381-afb8-63c756c6541a None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:47.062268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68c2c5-f32a-4381-afb8-63c756c6541a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:47.062582 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68c2c5-f32a-4381-afb8-63c756c6541a None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:47.063332 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68c2c5-f32a-4381-afb8-63c756c6541a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:47.063674 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68c2c5-f32a-4381-afb8-63c756c6541a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:47.065059 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68c2c5-f32a-4381-afb8-63c756c6541a None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:47.083694 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 418/839] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:47.083694 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b98ad3-3b63-44d9-99dc-f2859150c7b5 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:47.083694 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b98ad3-3b63-44d9-99dc-f2859150c7b5 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:47.083694 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b98ad3-3b63-44d9-99dc-f2859150c7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:47.101081 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-19b98ad3-3b63-44d9-99dc-f2859150c7b5 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:47.102283 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-19b98ad3-3b63-44d9-99dc-f2859150c7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:47.155944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:47.174841 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d70d2e-0b66-4be6-8e14-f56fa0e49147 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:47.177141 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 419/840] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:36:47.183730 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b98ad3-3b63-44d9-99dc-f2859150c7b5 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:47.213880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df892fc-0138-4908-91ba-665734909daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:47.214554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df892fc-0138-4908-91ba-665734909daa None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:47.214842 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df892fc-0138-4908-91ba-665734909daa None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:47.215119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df892fc-0138-4908-91ba-665734909daa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:47.224064 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:47.226083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df892fc-0138-4908-91ba-665734909daa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:47.231807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-8df892fc-0138-4908-91ba-665734909daa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:36:47.231807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:47.231807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:47.231807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:47.231807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:47.231807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:47.231807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:47.231807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:47.231807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:47.231807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:47.231807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:47.231807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:47.231807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:47.231807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:47.231807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:47.231807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:47.232765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:47.232765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:47.232765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:47.232765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:47.232765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:47.232765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:47.232765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:47.232765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:47.232765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:47.232765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:47.232765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:47.232765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:47.232765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:47.232765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:47.232765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:47.232765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:47.239243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:47.239243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:47.239243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:47.239243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:47.239243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:47.239243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:47.239243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:47.239243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:47.239243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:47.239243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:47.239243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:36:47.239243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:47.239243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 422/841] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:36:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:47.239243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df892fc-0138-4908-91ba-665734909daa None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:47.308391 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b98ad3-3b63-44d9-99dc-f2859150c7b5 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:47.345154 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df892fc-0138-4908-91ba-665734909daa None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:47.346364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8496f-cf19-48fa-9654-0b2203876c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:47.346997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8496f-cf19-48fa-9654-0b2203876c97 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:47.347280 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8496f-cf19-48fa-9654-0b2203876c97 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:47.347558 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8496f-cf19-48fa-9654-0b2203876c97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:47.348353 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8496f-cf19-48fa-9654-0b2203876c97 None admin] RBAC: Adding query filter params (role.id=49e0ba8d8c9f4824892b61f05d0036e8, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=c621601261e44ca8a7938862d6578639) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:47.348669 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8496f-cf19-48fa-9654-0b2203876c97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:47.350170 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8496f-cf19-48fa-9654-0b2203876c97 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:47.356051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 420/842] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:36:47 2022] GET /identity/v3/role_assignments?user.id=c621601261e44ca8a7938862d6578639&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=49e0ba8d8c9f4824892b61f05d0036e8 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:47.356842 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8496f-cf19-48fa-9654-0b2203876c97 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:47.396935 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d074ce4-fc1e-4982-b566-b32fe4b4cf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:47.398029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d074ce4-fc1e-4982-b566-b32fe4b4cf23 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:47.398528 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d074ce4-fc1e-4982-b566-b32fe4b4cf23 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:47.399076 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d074ce4-fc1e-4982-b566-b32fe4b4cf23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:47.420938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d074ce4-fc1e-4982-b566-b32fe4b4cf23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:47.426574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-8d074ce4-fc1e-4982-b566-b32fe4b4cf23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:47.426574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:47.426574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:47.426574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:47.426574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:47.426574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:47.426574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:47.426574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:47.426574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:47.426574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:47.426574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:47.426574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:47.426574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:47.426574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:47.426574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:47.426574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:47.427824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:47.427824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:47.427824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:47.427824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:47.427824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:47.427824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:47.427824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:47.427824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:47.427824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:47.427824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:47.427824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:47.427824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:47.427824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:47.427824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:47.427824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:47.427824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:47.428860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:47.428860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:47.428860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:47.428860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:47.428860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:47.428860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:47.428860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:47.428860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:47.428860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:47.428860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:47.428860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:36:47.428860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:47.432017 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 423/843] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:36:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:47.438216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d074ce4-fc1e-4982-b566-b32fe4b4cf23 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:47.460940 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:47.533427 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:47.538494 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8496f-cf19-48fa-9654-0b2203876c97 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:47.576887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b3126-b28c-4a32-b7e5-1925c7f3cea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:47.577428 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b3126-b28c-4a32-b7e5-1925c7f3cea1 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:47.577713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b3126-b28c-4a32-b7e5-1925c7f3cea1 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:47.577994 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9b3126-b28c-4a32-b7e5-1925c7f3cea1 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:47.578766 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b3126-b28c-4a32-b7e5-1925c7f3cea1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:47.579080 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b3126-b28c-4a32-b7e5-1925c7f3cea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:47.580481 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9b3126-b28c-4a32-b7e5-1925c7f3cea1 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:47.589365 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d074ce4-fc1e-4982-b566-b32fe4b4cf23 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:47.590213 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 421/844] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:36:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:47.595492 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b3126-b28c-4a32-b7e5-1925c7f3cea1 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:47.637784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37490556-b0ca-45ea-995f-5bbfcfb56d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:47.639108 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37490556-b0ca-45ea-995f-5bbfcfb56d85 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:47.639398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37490556-b0ca-45ea-995f-5bbfcfb56d85 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:47.639681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37490556-b0ca-45ea-995f-5bbfcfb56d85 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:47.640412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37490556-b0ca-45ea-995f-5bbfcfb56d85 None admin] RBAC: Adding query filter params (name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:47.640724 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37490556-b0ca-45ea-995f-5bbfcfb56d85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:47.642119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37490556-b0ca-45ea-995f-5bbfcfb56d85 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:47.651238 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 424/845] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:36:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:47.656606 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37490556-b0ca-45ea-995f-5bbfcfb56d85 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:47.723941 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9b3126-b28c-4a32-b7e5-1925c7f3cea1 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:47.730552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:47.760413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cd8de-74dc-4c88-aad7-dc464f00073f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:47.761086 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cd8de-74dc-4c88-aad7-dc464f00073f None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:47.761367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cd8de-74dc-4c88-aad7-dc464f00073f None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:47.761643 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cd8de-74dc-4c88-aad7-dc464f00073f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:47.769820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37490556-b0ca-45ea-995f-5bbfcfb56d85 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:47.772396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cd8de-74dc-4c88-aad7-dc464f00073f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:47.773875 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384cd8de-74dc-4c88-aad7-dc464f00073f None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:47.788522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-384cd8de-74dc-4c88-aad7-dc464f00073f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:47.788522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:47.788522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:47.788522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:47.788522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:47.788522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:47.788522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:47.788522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:47.788522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:47.788522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:47.788522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:47.788522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:47.788522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:47.788522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:47.788522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:47.790023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:47.790023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:47.790023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:47.790023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:47.790023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:47.790023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:47.790023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:47.790023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:47.790023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:47.790023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:47.790023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:47.790023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:47.790023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:47.790023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:47.790023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:47.790023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:47.790023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:47.790998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:47.790998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:47.790998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:47.790998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:47.790998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 422/846] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:47.797289 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cd8de-74dc-4c88-aad7-dc464f00073f None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:47.812731 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b414ca0-9eb6-45d3-941e-22a0195a39c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:47.813436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b414ca0-9eb6-45d3-941e-22a0195a39c8 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:47.813727 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b414ca0-9eb6-45d3-941e-22a0195a39c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:47.814008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b414ca0-9eb6-45d3-941e-22a0195a39c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:47.819988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:47.826056 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b414ca0-9eb6-45d3-941e-22a0195a39c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:47.827881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b414ca0-9eb6-45d3-941e-22a0195a39c8 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:47.844279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-7b414ca0-9eb6-45d3-941e-22a0195a39c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:47.844279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:47.844279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:47.844279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:47.844279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:47.844279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:47.844279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:47.844279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:47.844279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:47.844279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:47.844279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:47.844279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:47.844279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:47.844279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:47.844279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:47.845281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:47.845281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:47.845281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:47.845281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:47.845281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:47.845281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:47.845281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:47.845281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:47.845281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:47.845281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:47.845281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:47.845281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:47.845281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:47.845281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:47.845281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:47.845281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:47.845281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:47.846279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:47.846279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:47.846279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:47.846279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:47.846279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 425/847] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:47.851750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b414ca0-9eb6-45d3-941e-22a0195a39c8 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:47.920937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cd8de-74dc-4c88-aad7-dc464f00073f None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:47.961410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1915fd5-a53e-4102-9465-c069ff44f028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:47.961784 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1915fd5-a53e-4102-9465-c069ff44f028 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:47.962071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1915fd5-a53e-4102-9465-c069ff44f028 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:47.962366 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1915fd5-a53e-4102-9465-c069ff44f028 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:47.963150 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1915fd5-a53e-4102-9465-c069ff44f028 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:47.963381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1915fd5-a53e-4102-9465-c069ff44f028 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:47.964747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1915fd5-a53e-4102-9465-c069ff44f028 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:47.972813 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b414ca0-9eb6-45d3-941e-22a0195a39c8 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:47.982059 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 423/848] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:47.983414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1915fd5-a53e-4102-9465-c069ff44f028 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:47.997484 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:48.013438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e96dbb-8d68-4825-bf05-e98fa566d052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:48.014056 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e96dbb-8d68-4825-bf05-e98fa566d052 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:48.014415 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e96dbb-8d68-4825-bf05-e98fa566d052 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:48.014692 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e96dbb-8d68-4825-bf05-e98fa566d052 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:48.015427 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e96dbb-8d68-4825-bf05-e98fa566d052 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:48.015730 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e96dbb-8d68-4825-bf05-e98fa566d052 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:48.017091 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e96dbb-8d68-4825-bf05-e98fa566d052 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:48.030719 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 426/849] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:48.035637 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e96dbb-8d68-4825-bf05-e98fa566d052 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:48.098803 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:48.121330 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1915fd5-a53e-4102-9465-c069ff44f028 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:48.138716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e96dbb-8d68-4825-bf05-e98fa566d052 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:48.166272 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f03094-3bfb-4509-a2df-2447a19fcc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:48.166806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f03094-3bfb-4509-a2df-2447a19fcc49 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:48.167162 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f03094-3bfb-4509-a2df-2447a19fcc49 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:48.167510 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f03094-3bfb-4509-a2df-2447a19fcc49 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:48.176570 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f03094-3bfb-4509-a2df-2447a19fcc49 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:48.178810 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f03094-3bfb-4509-a2df-2447a19fcc49 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:48.183009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3a276-ba43-4a5d-beb0-b27f629ad604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:48.183919 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3a276-ba43-4a5d-beb0-b27f629ad604 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:48.184388 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3a276-ba43-4a5d-beb0-b27f629ad604 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:48.184847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3a276-ba43-4a5d-beb0-b27f629ad604 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:48.192648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-b4f03094-3bfb-4509-a2df-2447a19fcc49 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 22:36:48.192648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:48.192648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:48.192648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:48.192648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:48.192648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:48.192648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:48.192648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:48.192648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:48.192648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:48.192648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:48.192648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:48.192648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:48.192648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:48.192648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:48.192648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:48.193625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:48.193625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:48.193625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:48.193625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:48.193625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:48.193625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:48.193625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:48.193625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:48.193625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:48.193625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:48.193625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:48.193625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:48.193625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:48.193625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:48.193625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:48.193625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:48.193625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:48.193625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:48.194631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:48.194631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:48.194631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:48.194631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:48.194631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:48.194631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:48.194631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:48.194631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:48.194631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 22:36:48.194631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:48.194631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 424/850] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:36:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:48.195283 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3a276-ba43-4a5d-beb0-b27f629ad604 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:48.201783 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3a276-ba43-4a5d-beb0-b27f629ad604 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:48.201907 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f03094-3bfb-4509-a2df-2447a19fcc49 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:48.214899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-53a3a276-ba43-4a5d-beb0-b27f629ad604 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 22:36:48.214899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:48.214899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:48.214899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:48.214899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:48.214899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:48.214899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:48.214899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:48.214899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:48.214899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:48.214899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:48.214899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:48.214899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:48.214899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:48.214899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:48.214899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:48.215987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:48.215987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:48.215987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:48.215987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:48.215987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:48.215987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:48.215987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:48.215987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:48.215987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:48.215987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:48.215987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:48.215987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:48.215987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:48.215987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:48.215987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:48.215987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:48.215987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:48.215987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:48.216952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:48.216952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:48.216952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:48.216952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:48.216952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:48.216952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:48.216952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:48.216952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:48.216952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 22:36:48.216952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:48.221001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 427/851] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jul 27 22:36:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:48.221895 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3a276-ba43-4a5d-beb0-b27f629ad604 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:48.265470 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:48.315456 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f03094-3bfb-4509-a2df-2447a19fcc49 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:48.328695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3a276-ba43-4a5d-beb0-b27f629ad604 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:48.352216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:48.356436 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333d693-5966-4c67-9f79-4c77c9eaa04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:48.357383 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333d693-5966-4c67-9f79-4c77c9eaa04b None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:48.357925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333d693-5966-4c67-9f79-4c77c9eaa04b None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:48.358431 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333d693-5966-4c67-9f79-4c77c9eaa04b None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:48.359473 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333d693-5966-4c67-9f79-4c77c9eaa04b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:48.360014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333d693-5966-4c67-9f79-4c77c9eaa04b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:48.361864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333d693-5966-4c67-9f79-4c77c9eaa04b None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:48.366373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635eb9ef-5a6a-41e6-ab83-5f1c625b9736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:48.367044 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eb9ef-5a6a-41e6-ab83-5f1c625b9736 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:48.367327 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eb9ef-5a6a-41e6-ab83-5f1c625b9736 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:48.367602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635eb9ef-5a6a-41e6-ab83-5f1c625b9736 None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:48.368457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635eb9ef-5a6a-41e6-ab83-5f1c625b9736 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:48.368813 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635eb9ef-5a6a-41e6-ab83-5f1c625b9736 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:48.370239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635eb9ef-5a6a-41e6-ab83-5f1c625b9736 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:48.387744 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 425/852] 10.222.0.48 () {56 vars in 1135 bytes} [Wed Jul 27 22:36:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:48.388955 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333d693-5966-4c67-9f79-4c77c9eaa04b None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:48.394121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 428/853] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Jul 27 22:36:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:48.395096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635eb9ef-5a6a-41e6-ab83-5f1c625b9736 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:48.495337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:48.497469 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333d693-5966-4c67-9f79-4c77c9eaa04b None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:48.498876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635eb9ef-5a6a-41e6-ab83-5f1c625b9736 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:48.537505 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083f560-f263-426d-90bd-991ab8174671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:48.537945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313e6b1-4db4-4f84-8156-cf54dddaa348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:48.538163 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083f560-f263-426d-90bd-991ab8174671 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:48.538452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083f560-f263-426d-90bd-991ab8174671 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:48.539265 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083f560-f263-426d-90bd-991ab8174671 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:48.539969 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313e6b1-4db4-4f84-8156-cf54dddaa348 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:48.540461 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313e6b1-4db4-4f84-8156-cf54dddaa348 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:48.540957 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313e6b1-4db4-4f84-8156-cf54dddaa348 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:48.608399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:48.616567 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083f560-f263-426d-90bd-991ab8174671 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:48.618004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083f560-f263-426d-90bd-991ab8174671 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:48.624080 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313e6b1-4db4-4f84-8156-cf54dddaa348 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:48.625905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313e6b1-4db4-4f84-8156-cf54dddaa348 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:48.721585 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:48.731181 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 429/854] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:48 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 22:36:48.733679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083f560-f263-426d-90bd-991ab8174671 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:48.747942 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 426/855] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:48 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 22:36:48.749685 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313e6b1-4db4-4f84-8156-cf54dddaa348 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:48.844956 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083f560-f263-426d-90bd-991ab8174671 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:48.849874 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:48.863555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313e6b1-4db4-4f84-8156-cf54dddaa348 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:48.880089 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31184b-ab2d-41ff-b8cf-2f2ac1fd993f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:48.880735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31184b-ab2d-41ff-b8cf-2f2ac1fd993f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:48.881023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31184b-ab2d-41ff-b8cf-2f2ac1fd993f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:48.881310 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31184b-ab2d-41ff-b8cf-2f2ac1fd993f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:48.891162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31184b-ab2d-41ff-b8cf-2f2ac1fd993f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:48.892599 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31184b-ab2d-41ff-b8cf-2f2ac1fd993f None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:48.899882 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b6c7c-a836-4397-8552-9dec266917e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:48.900750 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b6c7c-a836-4397-8552-9dec266917e0 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:48.901336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b6c7c-a836-4397-8552-9dec266917e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:48.901693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b6c7c-a836-4397-8552-9dec266917e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:48.907611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-fa31184b-ab2d-41ff-b8cf-2f2ac1fd993f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:48.907611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:48.907611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:48.907611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:48.907611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:48.907611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:48.907611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:48.907611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:48.907611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:48.907611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:48.907611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:48.907611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:48.907611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:48.907611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:48.907611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:48.908509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:48.908509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:48.908509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:48.908509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:48.908509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:48.908509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:48.908509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:48.908509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:48.908509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:48.908509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:48.908509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:48.908509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:48.908509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:48.908509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:48.908509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:48.908509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:48.908509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:48.909411 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:48.909411 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:48.909411 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:48.909411 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:48.909411 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 430/856] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:48.911017 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3e0b1-44e0-489a-9039-115240beb951 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:48.911017 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3e0b1-44e0-489a-9039-115240beb951 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:48.911017 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3e0b1-44e0-489a-9039-115240beb951 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:48.912255 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 431/857] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:48.917386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b6c7c-a836-4397-8552-9dec266917e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:48.917614 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3e0b1-44e0-489a-9039-115240beb951 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:48.918867 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b6c7c-a836-4397-8552-9dec266917e0 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:48.935535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-035b6c7c-a836-4397-8552-9dec266917e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:48.935535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:48.935535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:48.935535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:48.935535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:48.935535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:48.935535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:48.935535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:48.935535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:48.935535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:48.935535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:48.935535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:48.935535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:48.935535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:48.935535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:48.936485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:48.936485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:48.936485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:48.936485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:48.936485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:48.936485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:48.936485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:48.936485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:48.936485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:48.936485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:48.936485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:48.936485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:48.936485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:48.936485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:48.936485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:48.936485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:48.936485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:48.937389 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:48.937389 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:48.937389 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:48.937389 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:48.937389 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 427/858] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:48.939025 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeae292-5cdb-4213-b24a-3d4d37a0a79f None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:48.939025 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeae292-5cdb-4213-b24a-3d4d37a0a79f None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:48.939025 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeae292-5cdb-4213-b24a-3d4d37a0a79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:48.957386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-8aeae292-5cdb-4213-b24a-3d4d37a0a79f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:48.958611 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8aeae292-5cdb-4213-b24a-3d4d37a0a79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:48.974927 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:49.034530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 428/859] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:48 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:36:49.034724 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3e0b1-44e0-489a-9039-115240beb951 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:49.034809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeae292-5cdb-4213-b24a-3d4d37a0a79f None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:49.081703 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6617a-64df-432b-9724-1513b5d1d8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:49.082331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6617a-64df-432b-9724-1513b5d1d8c5 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:49.082659 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6617a-64df-432b-9724-1513b5d1d8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:49.082944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6617a-64df-432b-9724-1513b5d1d8c5 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:49.083642 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6617a-64df-432b-9724-1513b5d1d8c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:49.083954 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6617a-64df-432b-9724-1513b5d1d8c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:49.086103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6617a-64df-432b-9724-1513b5d1d8c5 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:49.105336 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 432/860] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:49.105336 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6617a-64df-432b-9724-1513b5d1d8c5 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:49.120871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:49.156421 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeae292-5cdb-4213-b24a-3d4d37a0a79f None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:49.190557 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf969a-2840-47cf-87d0-fad5e5555b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:49.191185 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf969a-2840-47cf-87d0-fad5e5555b0a None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:49.191473 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf969a-2840-47cf-87d0-fad5e5555b0a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:49.191759 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf969a-2840-47cf-87d0-fad5e5555b0a None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:49.192451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf969a-2840-47cf-87d0-fad5e5555b0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:49.192762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf969a-2840-47cf-87d0-fad5e5555b0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:49.194132 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf969a-2840-47cf-87d0-fad5e5555b0a None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:49.205972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6617a-64df-432b-9724-1513b5d1d8c5 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:49.206630 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 429/861] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:49.207456 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf969a-2840-47cf-87d0-fad5e5555b0a None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:49.221941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:49.247309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577f4e9-f2c7-403e-b63a-04cba49a927f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:49.248016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577f4e9-f2c7-403e-b63a-04cba49a927f None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:49.248302 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577f4e9-f2c7-403e-b63a-04cba49a927f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:49.248585 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577f4e9-f2c7-403e-b63a-04cba49a927f None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:49.249297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577f4e9-f2c7-403e-b63a-04cba49a927f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:49.250693 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577f4e9-f2c7-403e-b63a-04cba49a927f None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:49.278368 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 433/862] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 22:36:49 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:36:49.278368 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577f4e9-f2c7-403e-b63a-04cba49a927f None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:49.330995 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf969a-2840-47cf-87d0-fad5e5555b0a None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:49.374737 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:49.388835 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d9075-df5f-49bb-b81e-21c9dc1af8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:49.389794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d9075-df5f-49bb-b81e-21c9dc1af8c7 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:49.390157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d9075-df5f-49bb-b81e-21c9dc1af8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:49.390475 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d9075-df5f-49bb-b81e-21c9dc1af8c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:49.399158 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d9075-df5f-49bb-b81e-21c9dc1af8c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:49.401432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d9075-df5f-49bb-b81e-21c9dc1af8c7 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:49.418908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-ea9d9075-df5f-49bb-b81e-21c9dc1af8c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:49.418908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:49.418908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:49.418908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:49.418908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:49.418908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:49.418908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:49.418908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:49.418908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:49.418908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:49.418908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:49.418908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:49.418908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:49.418908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:49.418908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:49.419905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:49.419905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:49.419905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:49.419905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:49.419905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:49.419905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:49.419905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:49.419905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:49.419905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:49.419905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:49.419905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:49.419905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:49.419905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:49.419905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:49.419905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:49.419905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:49.419905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:49.420804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:49.420804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:49.420804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:49.420804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:49.420804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:49.420804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:49.420804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:49.420804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:49.421428 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 430/863] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:49.427239 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d9075-df5f-49bb-b81e-21c9dc1af8c7 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:49.430785 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577f4e9-f2c7-403e-b63a-04cba49a927f None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:49.475100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efdf11-1432-43b4-82ad-9794fcdbc272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:49.475815 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efdf11-1432-43b4-82ad-9794fcdbc272 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:49.476154 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efdf11-1432-43b4-82ad-9794fcdbc272 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:49.476436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efdf11-1432-43b4-82ad-9794fcdbc272 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:49.483776 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efdf11-1432-43b4-82ad-9794fcdbc272 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:49.485258 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6efdf11-1432-43b4-82ad-9794fcdbc272 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:49.500499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-c6efdf11-1432-43b4-82ad-9794fcdbc272 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:49.500499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:49.500499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:49.500499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:49.500499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:49.500499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:49.500499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:49.500499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:49.500499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:49.500499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:49.500499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:49.500499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:49.500499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:49.500499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:49.500499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:49.501439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:49.501439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:49.501439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:49.501439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:49.501439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:49.501439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:49.501439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:49.501439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:49.501439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:49.501439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:49.501439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:49.501439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:49.501439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:49.501439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:49.501439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:49.501439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:49.501439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:49.502422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:49.502422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:49.502422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:49.502422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:49.502422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:49.502422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:49.502422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:49.502422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:49.502422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 434/864] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:49.507939 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efdf11-1432-43b4-82ad-9794fcdbc272 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:49.543440 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:49.551096 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d9075-df5f-49bb-b81e-21c9dc1af8c7 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:49.588317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77fd8c-6c3a-4aab-9b7d-2c4e4d5deb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:49.588941 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77fd8c-6c3a-4aab-9b7d-2c4e4d5deb95 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:49.589223 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77fd8c-6c3a-4aab-9b7d-2c4e4d5deb95 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:49.589498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77fd8c-6c3a-4aab-9b7d-2c4e4d5deb95 None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:49.590249 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77fd8c-6c3a-4aab-9b7d-2c4e4d5deb95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:49.590588 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77fd8c-6c3a-4aab-9b7d-2c4e4d5deb95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:49.592011 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77fd8c-6c3a-4aab-9b7d-2c4e4d5deb95 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:49.609853 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 431/865] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:49.609853 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8eab3-95f9-49b1-8efc-dc34e131d25b None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:49.609853 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8eab3-95f9-49b1-8efc-dc34e131d25b None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:49.609853 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e8eab3-95f9-49b1-8efc-dc34e131d25b None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:49.609853 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 432/866] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:49.614316 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8eab3-95f9-49b1-8efc-dc34e131d25b None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:49.625653 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6efdf11-1432-43b4-82ad-9794fcdbc272 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:49.662658 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:49.667593 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae81ea8-0698-483f-8d6c-2ab07ad64201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:49.668239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae81ea8-0698-483f-8d6c-2ab07ad64201 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:49.668501 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae81ea8-0698-483f-8d6c-2ab07ad64201 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:49.668780 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae81ea8-0698-483f-8d6c-2ab07ad64201 None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:49.669531 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae81ea8-0698-483f-8d6c-2ab07ad64201 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:49.669844 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae81ea8-0698-483f-8d6c-2ab07ad64201 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:49.671303 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae81ea8-0698-483f-8d6c-2ab07ad64201 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:49.683393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 435/867] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:49.684565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410aa10-755f-47d5-9d38-0291098fa423 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:49.684856 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410aa10-755f-47d5-9d38-0291098fa423 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:49.685129 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410aa10-755f-47d5-9d38-0291098fa423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:49.703597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-c410aa10-755f-47d5-9d38-0291098fa423 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:49.704778 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c410aa10-755f-47d5-9d38-0291098fa423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:49.727478 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e8eab3-95f9-49b1-8efc-dc34e131d25b None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:49.766102 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053c0c4-47f5-4c79-b903-e6e46845c847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:49.766857 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053c0c4-47f5-4c79-b903-e6e46845c847 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:49.767164 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053c0c4-47f5-4c79-b903-e6e46845c847 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:49.767430 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0053c0c4-47f5-4c79-b903-e6e46845c847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:49.768219 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053c0c4-47f5-4c79-b903-e6e46845c847 None admin] RBAC: Adding query filter params (role.id=7b21a72e7f9348d28d60c78cb0853af7, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=db10ad54ec9948a3bb8b04c708fc4ca7) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:49.768534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053c0c4-47f5-4c79-b903-e6e46845c847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:49.769943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0053c0c4-47f5-4c79-b903-e6e46845c847 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:49.778397 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 433/868] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:36:49 2022] GET /identity/v3/role_assignments?user.id=db10ad54ec9948a3bb8b04c708fc4ca7&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=7b21a72e7f9348d28d60c78cb0853af7 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:49.778397 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053c0c4-47f5-4c79-b903-e6e46845c847 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:49.786702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 436/869] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:36:49.797083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410aa10-755f-47d5-9d38-0291098fa423 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:49.821886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:49.914498 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410aa10-755f-47d5-9d38-0291098fa423 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:49.926988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0053c0c4-47f5-4c79-b903-e6e46845c847 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:49.946026 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:49.960982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97a67e-c030-4307-869b-b122a177975b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:49.961658 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97a67e-c030-4307-869b-b122a177975b None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:49.961941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97a67e-c030-4307-869b-b122a177975b None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:49.962216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a97a67e-c030-4307-869b-b122a177975b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:49.962954 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97a67e-c030-4307-869b-b122a177975b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:49.964666 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a97a67e-c030-4307-869b-b122a177975b None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:49.974597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20a033-4879-41b4-aafd-ad97a7305785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:49.975506 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20a033-4879-41b4-aafd-ad97a7305785 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:49.975788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20a033-4879-41b4-aafd-ad97a7305785 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:49.976102 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20a033-4879-41b4-aafd-ad97a7305785 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:49.976205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-2a97a67e-c030-4307-869b-b122a177975b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 22:36:49.976205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:49.976205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:36:49.976205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:36:49.976205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:36:49.976205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:36:49.976205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:36:49.976205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:49.976205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 22:36:49.976205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:49.976205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:36:49.976205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:49.976205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:49.976205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:49.976205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:49.976205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:49.977109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:49.977109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:49.977109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:49.977109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:49.977109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:49.977109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:49.977109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:49.977109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:36:49.977109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:36:49.977109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:36:49.977109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:36:49.977109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:49.977109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:49.977109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:49.977109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:49.977109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:49.977968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:49.977968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:49.977968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:49.977968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:49.977968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:49.977968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:49.977968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:49.977968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:49.977968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:49.977968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:49.977968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:49.977968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:36:49.977968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:49.977968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 22:36:49.977968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:49.978812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20a033-4879-41b4-aafd-ad97a7305785 None admin] RBAC: Adding query filter params (role.id=49e0ba8d8c9f4824892b61f05d0036e8, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=baf405258b9d413fae1192e10250b6a3) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:49.978812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20a033-4879-41b4-aafd-ad97a7305785 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:49.978950 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 437/870] 10.222.0.48 () {56 vars in 1132 bytes} [Wed Jul 27 22:36:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:49.982950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20a033-4879-41b4-aafd-ad97a7305785 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:49.984416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97a67e-c030-4307-869b-b122a177975b None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:49.990960 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 434/871] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:36:49 2022] GET /identity/v3/role_assignments?user.id=baf405258b9d413fae1192e10250b6a3&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=49e0ba8d8c9f4824892b61f05d0036e8 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:50.099008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:50.112656 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a97a67e-c030-4307-869b-b122a177975b None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:50.149770 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811a2fc-8eaa-4f36-8edb-5117b9c86fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:50.150421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811a2fc-8eaa-4f36-8edb-5117b9c86fc7 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:50.150707 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811a2fc-8eaa-4f36-8edb-5117b9c86fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:50.150983 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811a2fc-8eaa-4f36-8edb-5117b9c86fc7 None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:50.151664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811a2fc-8eaa-4f36-8edb-5117b9c86fc7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:50.151967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811a2fc-8eaa-4f36-8edb-5117b9c86fc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:50.153337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811a2fc-8eaa-4f36-8edb-5117b9c86fc7 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:50.158357 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 438/872] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 22:36:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:50.164305 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20a033-4879-41b4-aafd-ad97a7305785 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:50.267556 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20a033-4879-41b4-aafd-ad97a7305785 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:50.301074 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee46a7-3a75-471d-9390-6878de246518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:50.301693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee46a7-3a75-471d-9390-6878de246518 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:50.301975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee46a7-3a75-471d-9390-6878de246518 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:50.302249 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee46a7-3a75-471d-9390-6878de246518 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:50.302964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee46a7-3a75-471d-9390-6878de246518 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:50.303272 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee46a7-3a75-471d-9390-6878de246518 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:50.305154 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee46a7-3a75-471d-9390-6878de246518 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:50.309940 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 435/873] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 22:36:50 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:51.392500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f5933-e125-4594-a7d3-5b7e2fae6a80 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:51.404647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f5933-e125-4594-a7d3-5b7e2fae6a80 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:51.404647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f5933-e125-4594-a7d3-5b7e2fae6a80 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:51.404647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 439/874] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:51.404907 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc5d81-6fd3-47c4-b46f-526340c2bdb5 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:51.404907 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc5d81-6fd3-47c4-b46f-526340c2bdb5 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:51.404907 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cc5d81-6fd3-47c4-b46f-526340c2bdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:51.422146 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-47cc5d81-6fd3-47c4-b46f-526340c2bdb5 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:51.423846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-47cc5d81-6fd3-47c4-b46f-526340c2bdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:51.464999 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:51.500789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 436/875] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:51 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:36:51.524200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f5933-e125-4594-a7d3-5b7e2fae6a80 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:51.627587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f5933-e125-4594-a7d3-5b7e2fae6a80 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:51.667094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706822d-f268-46c4-a559-5a52b879c311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:51.667668 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706822d-f268-46c4-a559-5a52b879c311 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:51.667954 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706822d-f268-46c4-a559-5a52b879c311 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:51.668232 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706822d-f268-46c4-a559-5a52b879c311 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:51.668864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706822d-f268-46c4-a559-5a52b879c311 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:51.670239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2706822d-f268-46c4-a559-5a52b879c311 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:51.679933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-2706822d-f268-46c4-a559-5a52b879c311 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 22:36:51.679933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:51.679933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:36:51.679933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:36:51.679933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:36:51.679933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:36:51.679933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:36:51.679933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:51.679933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 22:36:51.679933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:51.679933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:36:51.679933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:51.679933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:51.679933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:51.679933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:51.679933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:51.679933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:51.681014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:51.681014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:51.681014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:51.681014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:51.681014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:51.681014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:51.681014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:36:51.681014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:36:51.681014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:36:51.681014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:36:51.681014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:51.681014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:51.681014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:51.681014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:51.681014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:51.681014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:51.682226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:51.682226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:51.682226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:51.682226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:51.682226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:51.682226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:51.682226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:51.682226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:51.682226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:51.682226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:51.682226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:36:51.682226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:51.682226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 22:36:51.682226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:51.682226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 440/876] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:36:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:51.687058 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc5d81-6fd3-47c4-b46f-526340c2bdb5 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:51.803544 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cc5d81-6fd3-47c4-b46f-526340c2bdb5 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:51.839562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71602868-20d0-485a-9a9a-68134b667e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:51.840184 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71602868-20d0-485a-9a9a-68134b667e1c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:51.840465 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71602868-20d0-485a-9a9a-68134b667e1c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:51.840741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71602868-20d0-485a-9a9a-68134b667e1c None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:51.841418 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71602868-20d0-485a-9a9a-68134b667e1c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:51.841721 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71602868-20d0-485a-9a9a-68134b667e1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:51.843128 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71602868-20d0-485a-9a9a-68134b667e1c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:51.848234 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 437/877] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:36:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:51.853629 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706822d-f268-46c4-a559-5a52b879c311 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:51.873816 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:51.963258 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706822d-f268-46c4-a559-5a52b879c311 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:51.999273 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd18e3-e338-4f6c-82d7-4018629a0184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:51.999893 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd18e3-e338-4f6c-82d7-4018629a0184 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:52.000181 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd18e3-e338-4f6c-82d7-4018629a0184 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:52.000461 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd18e3-e338-4f6c-82d7-4018629a0184 None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:52.001246 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd18e3-e338-4f6c-82d7-4018629a0184 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:52.001557 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd18e3-e338-4f6c-82d7-4018629a0184 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:52.002575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95f894-909f-4445-8ffb-0ac7cb23f2d2 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:52.002868 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95f894-909f-4445-8ffb-0ac7cb23f2d2 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:52.003041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd18e3-e338-4f6c-82d7-4018629a0184 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:52.003196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95f894-909f-4445-8ffb-0ac7cb23f2d2 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:52.004714 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 438/878] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:52.008389 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 441/879] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:36:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:52.012292 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da6514-f239-4450-a1d9-1a9f01a1acaa None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:52.013511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd18e3-e338-4f6c-82d7-4018629a0184 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:52.013989 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da6514-f239-4450-a1d9-1a9f01a1acaa None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:52.014274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09da6514-f239-4450-a1d9-1a9f01a1acaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:52.040909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-09da6514-f239-4450-a1d9-1a9f01a1acaa None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:52.041583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-09da6514-f239-4450-a1d9-1a9f01a1acaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:52.077295 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:52.110544 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:52.130570 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 439/880] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:52 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:36:52.132846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a890b7a-72dd-4a89-8223-f140ce2bfc7e None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:52.133294 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a890b7a-72dd-4a89-8223-f140ce2bfc7e None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:52.133884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a890b7a-72dd-4a89-8223-f140ce2bfc7e None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:52.136142 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 440/881] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:52.137287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd18e3-e338-4f6c-82d7-4018629a0184 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:52.146359 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb4ec8-8208-4fdb-bab0-b4ca69aaacb4 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:52.146359 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb4ec8-8208-4fdb-bab0-b4ca69aaacb4 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:52.146359 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb4ec8-8208-4fdb-bab0-b4ca69aaacb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:52.159043 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-dafb4ec8-8208-4fdb-bab0-b4ca69aaacb4 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:52.160215 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-dafb4ec8-8208-4fdb-bab0-b4ca69aaacb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:52.180629 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94cd73-5280-4684-b556-843534f4dbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:52.181248 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94cd73-5280-4684-b556-843534f4dbbf None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:52.181535 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94cd73-5280-4684-b556-843534f4dbbf None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:52.181807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94cd73-5280-4684-b556-843534f4dbbf None admin] PATH_INFO: `/v3/endpoints` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:52.182592 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94cd73-5280-4684-b556-843534f4dbbf None admin] RBAC: Adding query filter params (interface=public, service_id=1df6eb67df6a4eeea078979245719f4c, region_id=RegionOne) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:52.182904 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94cd73-5280-4684-b556-843534f4dbbf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:52.184265 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94cd73-5280-4684-b556-843534f4dbbf None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:52.191924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 442/882] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jul 27 22:36:52 2022] GET /identity/v3/endpoints?service_id=1df6eb67df6a4eeea078979245719f4c&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:52.192688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94cd73-5280-4684-b556-843534f4dbbf None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:52.237016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 441/883] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:52 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:36:52.237780 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb4ec8-8208-4fdb-bab0-b4ca69aaacb4 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:52.309679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94cd73-5280-4684-b556-843534f4dbbf None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:52.338870 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:52.346416 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb4ec8-8208-4fdb-bab0-b4ca69aaacb4 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:52.349646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf37097-0d66-4e8f-95ab-3e9be7cfeffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:52.350291 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf37097-0d66-4e8f-95ab-3e9be7cfeffc None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:52.350636 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf37097-0d66-4e8f-95ab-3e9be7cfeffc None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:52.350955 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf37097-0d66-4e8f-95ab-3e9be7cfeffc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:52.359300 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:52.364294 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf37097-0d66-4e8f-95ab-3e9be7cfeffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:52.369402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-3cf37097-0d66-4e8f-95ab-3e9be7cfeffc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 22:36:52.369402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:52.369402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:52.369402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:52.369402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:52.369402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:52.369402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:52.369402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:52.369402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:52.369402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:52.369402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:52.369402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:52.369402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:52.369402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:52.369402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:52.369402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:52.370626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:52.370626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:52.370626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:52.370626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:52.370626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:52.370626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:52.370626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:52.370626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:52.370626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:52.370626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:52.370626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:52.370626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:52.370626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:52.370626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:52.370626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:52.370626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:52.372030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:52.372030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:52.372030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:52.372030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:52.372030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:52.372030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:52.372030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:52.372030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:52.372030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:52.372030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:52.372030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 22:36:52.372030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:52.372030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 443/884] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Jul 27 22:36:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:52.372030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf37097-0d66-4e8f-95ab-3e9be7cfeffc None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:52.382835 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430b05c-8743-4992-b728-747a8f3e7b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:52.383464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430b05c-8743-4992-b728-747a8f3e7b96 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:52.383751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430b05c-8743-4992-b728-747a8f3e7b96 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:52.384030 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430b05c-8743-4992-b728-747a8f3e7b96 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:52.384688 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430b05c-8743-4992-b728-747a8f3e7b96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:52.386046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9430b05c-8743-4992-b728-747a8f3e7b96 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:52.392266 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 442/885] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jul 27 22:36:52 2022] GET /identity/v3/services => generated 1011 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:36:52.393640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029d74e-8493-4301-8ed3-55bcbb56ac93 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:52.393753 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029d74e-8493-4301-8ed3-55bcbb56ac93 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:52.393987 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029d74e-8493-4301-8ed3-55bcbb56ac93 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:52.398957 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 443/886] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:52.398957 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029d74e-8493-4301-8ed3-55bcbb56ac93 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:52.489622 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf37097-0d66-4e8f-95ab-3e9be7cfeffc None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:52.524277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029d74e-8493-4301-8ed3-55bcbb56ac93 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:52.528454 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43d8c9-abe1-48ed-9a95-914ca1494c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:52.529414 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43d8c9-abe1-48ed-9a95-914ca1494c0f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:52.529917 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43d8c9-abe1-48ed-9a95-914ca1494c0f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:52.530449 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43d8c9-abe1-48ed-9a95-914ca1494c0f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:52.531305 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43d8c9-abe1-48ed-9a95-914ca1494c0f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:52.533048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43d8c9-abe1-48ed-9a95-914ca1494c0f None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:52.544242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-2f43d8c9-abe1-48ed-9a95-914ca1494c0f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 22:36:52.544242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:52.544242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:36:52.544242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:36:52.544242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:36:52.544242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:36:52.544242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:36:52.544242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:52.544242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 22:36:52.544242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:52.544242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:36:52.544242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:52.544242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:52.544242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:52.544242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:52.544242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:52.544242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:52.545297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:52.545297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:52.545297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:52.545297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:52.545297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:52.545297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:52.545297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:36:52.545297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:36:52.545297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:36:52.545297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:36:52.545297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:52.545297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:52.545297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:52.545297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:52.545297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:52.545297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:52.546219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:52.546219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:52.546219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:52.546219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:52.546219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:52.546219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:52.546219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:52.546219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:52.546219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:52.546219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:52.546219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:36:52.546219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:52.546219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 22:36:52.546219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:52.546219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 444/887] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 22:36:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:52.547809 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbacc8-db53-4eb3-b9d3-edcdcc40d2e0 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:52.547809 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbacc8-db53-4eb3-b9d3-edcdcc40d2e0 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:52.547809 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edbacc8-db53-4eb3-b9d3-edcdcc40d2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:52.567518 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3d80d-3e0a-48cf-af59-6ecbffba277c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:52.568146 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3d80d-3e0a-48cf-af59-6ecbffba277c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:52.568429 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3d80d-3e0a-48cf-af59-6ecbffba277c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:52.568700 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3d80d-3e0a-48cf-af59-6ecbffba277c None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:52.569515 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3d80d-3e0a-48cf-af59-6ecbffba277c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:52.569860 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3d80d-3e0a-48cf-af59-6ecbffba277c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:52.570235 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-8edbacc8-db53-4eb3-b9d3-edcdcc40d2e0 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:52.571266 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3d80d-3e0a-48cf-af59-6ecbffba277c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:52.571461 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8edbacc8-db53-4eb3-b9d3-edcdcc40d2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:52.580281 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 444/888] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jul 27 22:36:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:52.586021 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3d80d-3e0a-48cf-af59-6ecbffba277c None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:52.613192 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:52.641383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:52.651879 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 445/889] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:52 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:36:52.652777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbacc8-db53-4eb3-b9d3-edcdcc40d2e0 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:52.704262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3d80d-3e0a-48cf-af59-6ecbffba277c None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:52.738806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5208ac-e588-4535-81f3-511392ca1913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:52.739425 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5208ac-e588-4535-81f3-511392ca1913 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:52.739769 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5208ac-e588-4535-81f3-511392ca1913 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:52.739991 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5208ac-e588-4535-81f3-511392ca1913 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:52.740666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5208ac-e588-4535-81f3-511392ca1913 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:52.740977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5208ac-e588-4535-81f3-511392ca1913 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:52.742383 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5208ac-e588-4535-81f3-511392ca1913 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:52.747174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 445/890] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jul 27 22:36:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:52.747934 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5208ac-e588-4535-81f3-511392ca1913 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:52.776881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edbacc8-db53-4eb3-b9d3-edcdcc40d2e0 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:52.816255 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e8db9-e469-4652-8bc8-142466c4fa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:52.817432 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e8db9-e469-4652-8bc8-142466c4fa3e None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:52.817766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e8db9-e469-4652-8bc8-142466c4fa3e None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:52.818308 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e8db9-e469-4652-8bc8-142466c4fa3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:52.832015 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e8db9-e469-4652-8bc8-142466c4fa3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:52.833687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e8db9-e469-4652-8bc8-142466c4fa3e None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:52.837224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:52.849436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-700e8db9-e469-4652-8bc8-142466c4fa3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:52.849436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:52.849436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:52.849436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:52.849436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:52.849436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:52.849436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:52.849436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:52.849436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:52.849436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:52.849436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:52.849436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:52.849436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:52.849436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:52.849436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:52.850632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:52.850632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:52.850632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:52.850632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:52.850632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:52.850632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:52.850632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:52.850632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:52.850632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:52.850632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:52.850632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:52.850632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:52.850632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:52.850632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:52.850632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:52.850632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:52.850632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:52.851824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:52.851824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:52.851824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:52.851824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:52.855299 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 446/891] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:52.856001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e8db9-e469-4652-8bc8-142466c4fa3e None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:52.857329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5208ac-e588-4535-81f3-511392ca1913 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:52.895595 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a4d53-d0db-4ac9-87a1-58d42d9bdbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:52.896221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a4d53-d0db-4ac9-87a1-58d42d9bdbfb None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:52.896500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a4d53-d0db-4ac9-87a1-58d42d9bdbfb None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:52.896770 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a4d53-d0db-4ac9-87a1-58d42d9bdbfb None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:52.897453 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a4d53-d0db-4ac9-87a1-58d42d9bdbfb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:52.899653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a4d53-d0db-4ac9-87a1-58d42d9bdbfb None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:52.908080 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:52.917143 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 446/892] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 22:36:52 2022] POST /identity/v3/services => generated 269 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:36:52.917911 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a4d53-d0db-4ac9-87a1-58d42d9bdbfb None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:52.986857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e8db9-e469-4652-8bc8-142466c4fa3e None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:53.033580 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00bc40-eccb-4bbf-b0ac-34181a46d188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:53.034445 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00bc40-eccb-4bbf-b0ac-34181a46d188 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:53.034559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00bc40-eccb-4bbf-b0ac-34181a46d188 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:53.034818 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00bc40-eccb-4bbf-b0ac-34181a46d188 None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:53.035563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00bc40-eccb-4bbf-b0ac-34181a46d188 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:53.035971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00bc40-eccb-4bbf-b0ac-34181a46d188 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:53.037285 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00bc40-eccb-4bbf-b0ac-34181a46d188 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:53.050393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 447/893] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jul 27 22:36:52 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:53.071145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a4d53-d0db-4ac9-87a1-58d42d9bdbfb None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:53.112504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe490b-fa77-4dc7-be74-2a057d528da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:53.113158 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe490b-fa77-4dc7-be74-2a057d528da6 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:53.113444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe490b-fa77-4dc7-be74-2a057d528da6 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:53.113723 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fe490b-fa77-4dc7-be74-2a057d528da6 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:53.114496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe490b-fa77-4dc7-be74-2a057d528da6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:53.114808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe490b-fa77-4dc7-be74-2a057d528da6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:53.116243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fe490b-fa77-4dc7-be74-2a057d528da6 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:53.130665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 447/894] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:53.136834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00bc40-eccb-4bbf-b0ac-34181a46d188 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:53.245476 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00bc40-eccb-4bbf-b0ac-34181a46d188 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:53.253017 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:53.282545 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4ae08-32ce-4017-91a1-2f3ae5237000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:53.283196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4ae08-32ce-4017-91a1-2f3ae5237000 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:53.283481 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4ae08-32ce-4017-91a1-2f3ae5237000 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:53.283828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4ae08-32ce-4017-91a1-2f3ae5237000 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:53.292263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4ae08-32ce-4017-91a1-2f3ae5237000 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:53.293702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4ae08-32ce-4017-91a1-2f3ae5237000 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:53.305732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-4cb4ae08-32ce-4017-91a1-2f3ae5237000 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 22:36:53.305732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:53.305732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:53.305732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:53.305732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:53.305732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:53.305732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:53.305732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:53.305732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:53.305732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:53.305732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:53.305732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:53.305732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:53.305732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:53.305732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:53.305732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:53.306784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:53.306784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:53.306784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:53.306784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:53.306784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:53.306784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:53.306784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:53.306784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:53.306784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:53.306784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:53.306784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:53.306784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:53.306784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:53.306784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:53.306784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:53.306784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:53.306784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:53.306784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:53.307766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:53.307766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:53.307766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:53.307766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:53.307766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:53.307766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:53.307766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:53.307766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:53.307766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 22:36:53.307766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:53.307766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 448/895] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jul 27 22:36:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:53.312859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe490b-fa77-4dc7-be74-2a057d528da6 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:53.317740 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:53.427291 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fe490b-fa77-4dc7-be74-2a057d528da6 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:53.463556 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c1e5f-9ec5-467b-a8ac-7a6a0034ca22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:53.464553 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c1e5f-9ec5-467b-a8ac-7a6a0034ca22 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:53.465058 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c1e5f-9ec5-467b-a8ac-7a6a0034ca22 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:53.465539 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c1e5f-9ec5-467b-a8ac-7a6a0034ca22 None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:53.466653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c1e5f-9ec5-467b-a8ac-7a6a0034ca22 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:53.467198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c1e5f-9ec5-467b-a8ac-7a6a0034ca22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:53.468830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c1e5f-9ec5-467b-a8ac-7a6a0034ca22 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:53.487931 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 448/896] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Jul 27 22:36:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:53.493364 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4ae08-32ce-4017-91a1-2f3ae5237000 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:53.613191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4ae08-32ce-4017-91a1-2f3ae5237000 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:53.651268 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3428b-7cbe-4668-a73d-a7818537f033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:53.652273 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3428b-7cbe-4668-a73d-a7818537f033 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:53.652760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3428b-7cbe-4668-a73d-a7818537f033 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:53.653252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3428b-7cbe-4668-a73d-a7818537f033 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:53.689415 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:53.729138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3428b-7cbe-4668-a73d-a7818537f033 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:53.730971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c3428b-7cbe-4668-a73d-a7818537f033 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:53.836182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 449/897] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:36:53 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 22:36:53.842022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c1e5f-9ec5-467b-a8ac-7a6a0034ca22 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:53.914785 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:53.956859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c1e5f-9ec5-467b-a8ac-7a6a0034ca22 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:53.992184 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d12d8-63e8-462d-ac7e-3a51385821df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:53.992832 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d12d8-63e8-462d-ac7e-3a51385821df None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:53.993114 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d12d8-63e8-462d-ac7e-3a51385821df None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:53.993391 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272d12d8-63e8-462d-ac7e-3a51385821df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:54.004311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d12d8-63e8-462d-ac7e-3a51385821df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:54.005760 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272d12d8-63e8-462d-ac7e-3a51385821df None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:54.021198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-272d12d8-63e8-462d-ac7e-3a51385821df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:54.021198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:54.021198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:54.021198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:54.021198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:54.021198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:54.021198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:54.021198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:54.021198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:54.021198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:54.021198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:54.021198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:54.021198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:54.021198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:54.021198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:54.022206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:54.022206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:54.022206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:54.022206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:54.022206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:54.022206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:54.022206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:54.022206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:54.022206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:54.022206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:54.022206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:54.022206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:54.022206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:54.022206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:54.022206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:54.022206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:54.022206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:54.023701 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:54.023701 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:54.023701 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:54.023701 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:54.023701 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 449/898] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:54.032254 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3428b-7cbe-4668-a73d-a7818537f033 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:54.105350 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:54.143032 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3428b-7cbe-4668-a73d-a7818537f033 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:54.179640 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2c971-e600-42ef-a256-a33202da9af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:54.180590 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2c971-e600-42ef-a256-a33202da9af3 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:54.181092 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2c971-e600-42ef-a256-a33202da9af3 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:54.181577 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2c971-e600-42ef-a256-a33202da9af3 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:54.182531 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2c971-e600-42ef-a256-a33202da9af3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:54.183044 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2c971-e600-42ef-a256-a33202da9af3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:54.184602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2c971-e600-42ef-a256-a33202da9af3 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:54.197262 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 450/899] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:54.207413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d12d8-63e8-462d-ac7e-3a51385821df None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:54.362626 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272d12d8-63e8-462d-ac7e-3a51385821df None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:54.377136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:54.408066 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df1d239-6c2f-4482-9af5-fff281004085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:54.408719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1d239-6c2f-4482-9af5-fff281004085 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:54.408998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1d239-6c2f-4482-9af5-fff281004085 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:54.414363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df1d239-6c2f-4482-9af5-fff281004085 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:54.424591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1d239-6c2f-4482-9af5-fff281004085 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:54.426041 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df1d239-6c2f-4482-9af5-fff281004085 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:54.447748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-0df1d239-6c2f-4482-9af5-fff281004085 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:54.447748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:54.447748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:54.447748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:54.447748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:54.447748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:54.447748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:54.447748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:54.447748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:54.447748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:54.447748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:54.447748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:54.447748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:54.447748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:54.447748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:54.448681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:54.448681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:54.448681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:54.448681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:54.448681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:54.448681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:54.448681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:54.448681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:54.448681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:54.448681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:54.448681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:54.448681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:54.448681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:54.448681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:54.448681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:54.448681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:54.448681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:54.449603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:54.449603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:54.449603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:54.449603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:54.449603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:54.449603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:54.449603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:54.449603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:54.449603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 450/900] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:54.457552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2c971-e600-42ef-a256-a33202da9af3 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:54.514393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff659d05-4d6e-48e7-b9d8-cbd5a2432c1a None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:54.514736 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff659d05-4d6e-48e7-b9d8-cbd5a2432c1a None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:54.514954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff659d05-4d6e-48e7-b9d8-cbd5a2432c1a None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:54.516590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 451/901] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:36:54.521453 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23230d9d-548c-477a-9186-c6c25e4e7535 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:54.521738 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23230d9d-548c-477a-9186-c6c25e4e7535 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:54.522027 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23230d9d-548c-477a-9186-c6c25e4e7535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:54.558055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-23230d9d-548c-477a-9186-c6c25e4e7535 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:54.559271 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-23230d9d-548c-477a-9186-c6c25e4e7535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:54.590382 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2c971-e600-42ef-a256-a33202da9af3 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:54.635348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:54.647654 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7aadab-7366-496d-94c2-44776cefb113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:54.650602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aadab-7366-496d-94c2-44776cefb113 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:54.651068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aadab-7366-496d-94c2-44776cefb113 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:54.651487 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7aadab-7366-496d-94c2-44776cefb113 None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:54.652232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 452/902] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:36:54.652984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7aadab-7366-496d-94c2-44776cefb113 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:54.653434 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7aadab-7366-496d-94c2-44776cefb113 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:54.656198 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7aadab-7366-496d-94c2-44776cefb113 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:54.669656 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 451/903] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:54.674590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23230d9d-548c-477a-9186-c6c25e4e7535 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:54.676955 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7aadab-7366-496d-94c2-44776cefb113 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:54.789463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23230d9d-548c-477a-9186-c6c25e4e7535 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:54.793007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:54.814727 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7aadab-7366-496d-94c2-44776cefb113 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:54.840328 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b813a7-43d7-425c-a632-cc6bc6032c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:54.840988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b813a7-43d7-425c-a632-cc6bc6032c2d None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:54.841271 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b813a7-43d7-425c-a632-cc6bc6032c2d None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:54.841545 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b813a7-43d7-425c-a632-cc6bc6032c2d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:54.842173 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b813a7-43d7-425c-a632-cc6bc6032c2d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:54.843778 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b813a7-43d7-425c-a632-cc6bc6032c2d None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:54.856274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-f9b813a7-43d7-425c-a632-cc6bc6032c2d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 22:36:54.856274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:54.856274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:36:54.856274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:36:54.856274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:36:54.856274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:36:54.856274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:36:54.856274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:54.856274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 22:36:54.856274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:54.856274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:36:54.856274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:54.856274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:54.856274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:54.856274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:54.856274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:54.856274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:54.857325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:54.857325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:54.857325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:54.857325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:54.857325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:54.857325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:54.857325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:36:54.857325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:36:54.857325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:36:54.857325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:36:54.857325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:54.857325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:54.857325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:54.857325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:54.857325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:54.857325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:54.858174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:54.858174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:54.858174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:54.858174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:54.858174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:54.858174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:54.858174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:54.858174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:54.858174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:54.858174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:54.858174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:36:54.858174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:54.858174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 22:36:54.858174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:54.862453 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 453/904] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:36:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:54.863246 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9065ba4-696c-4e95-942c-20e75fa8334f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:54.863759 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b813a7-43d7-425c-a632-cc6bc6032c2d None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:54.864455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9065ba4-696c-4e95-942c-20e75fa8334f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:54.864995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9065ba4-696c-4e95-942c-20e75fa8334f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:54.865473 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9065ba4-696c-4e95-942c-20e75fa8334f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:54.867100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9065ba4-696c-4e95-942c-20e75fa8334f None admin] RBAC: Adding query filter params (role.id=5b5390395eb544b8bf3d5d39591c987d, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=db10ad54ec9948a3bb8b04c708fc4ca7) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:54.867924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9065ba4-696c-4e95-942c-20e75fa8334f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:54.870662 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9065ba4-696c-4e95-942c-20e75fa8334f None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:54.882891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 452/905] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:36:54 2022] GET /identity/v3/role_assignments?user.id=db10ad54ec9948a3bb8b04c708fc4ca7&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=5b5390395eb544b8bf3d5d39591c987d => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:54.982154 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b813a7-43d7-425c-a632-cc6bc6032c2d None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:55.019916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6e9c9-0e23-4f31-a2c5-04ae94ed7392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:55.020555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6e9c9-0e23-4f31-a2c5-04ae94ed7392 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:55.020846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6e9c9-0e23-4f31-a2c5-04ae94ed7392 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:55.021125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6e9c9-0e23-4f31-a2c5-04ae94ed7392 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:55.021817 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6e9c9-0e23-4f31-a2c5-04ae94ed7392 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:55.022186 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6e9c9-0e23-4f31-a2c5-04ae94ed7392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:55.023707 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6e9c9-0e23-4f31-a2c5-04ae94ed7392 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:55.033983 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 454/906] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:36:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:55.035600 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9065ba4-696c-4e95-942c-20e75fa8334f None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:55.093446 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:55.146733 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9065ba4-696c-4e95-942c-20e75fa8334f None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:55.182696 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f88373-9330-4674-a7e1-ab022089b88a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:55.183323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f88373-9330-4674-a7e1-ab022089b88a None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:55.183610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f88373-9330-4674-a7e1-ab022089b88a None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:55.183890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f88373-9330-4674-a7e1-ab022089b88a None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:55.184633 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f88373-9330-4674-a7e1-ab022089b88a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:55.184942 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f88373-9330-4674-a7e1-ab022089b88a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:55.186378 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f88373-9330-4674-a7e1-ab022089b88a None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:55.191836 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 453/907] 10.222.0.48 () {56 vars in 1114 bytes} [Wed Jul 27 22:36:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:55.198200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6e9c9-0e23-4f31-a2c5-04ae94ed7392 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:55.232696 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:55.244231 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5576b4-4374-4175-a8dd-e49a093b7ffa None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:55.244521 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5576b4-4374-4175-a8dd-e49a093b7ffa None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:55.245716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5576b4-4374-4175-a8dd-e49a093b7ffa None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:55.247065 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 454/908] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:36:55.251790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da768547-87dd-41da-9052-642ecabfaadf None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:55.252076 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da768547-87dd-41da-9052-642ecabfaadf None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:55.252338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da768547-87dd-41da-9052-642ecabfaadf None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:55.253711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 455/909] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:36:55.254617 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2800b8-021d-47d4-9e77-86fec9098714 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:55.254896 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2800b8-021d-47d4-9e77-86fec9098714 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:55.255168 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2800b8-021d-47d4-9e77-86fec9098714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:55.275325 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-ce2800b8-021d-47d4-9e77-86fec9098714 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:55.276525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ce2800b8-021d-47d4-9e77-86fec9098714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:55.312045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6e9c9-0e23-4f31-a2c5-04ae94ed7392 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:55.346522 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 456/910] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:36:55.349571 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d0456-1d3a-439d-bbf4-0ee7cea6176a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:55.350414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d0456-1d3a-439d-bbf4-0ee7cea6176a None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:55.350899 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d0456-1d3a-439d-bbf4-0ee7cea6176a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:55.351443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d0456-1d3a-439d-bbf4-0ee7cea6176a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:55.351869 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b5eb2-ae54-450c-aa55-44476f032d0d None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:55.352232 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b5eb2-ae54-450c-aa55-44476f032d0d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:55.352589 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b5eb2-ae54-450c-aa55-44476f032d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:55.352902 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d0456-1d3a-439d-bbf4-0ee7cea6176a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:55.354450 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903d0456-1d3a-439d-bbf4-0ee7cea6176a None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:55.374653 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-f62b5eb2-ae54-450c-aa55-44476f032d0d None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:55.375898 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-f62b5eb2-ae54-450c-aa55-44476f032d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:55.377134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 455/911] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:36:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:36:55.378228 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d0456-1d3a-439d-bbf4-0ee7cea6176a None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:55.422145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:55.472040 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 457/912] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:36:55.487127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:55.496340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b5eb2-ae54-450c-aa55-44476f032d0d None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:55.504613 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903d0456-1d3a-439d-bbf4-0ee7cea6176a None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:55.549973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e9c9d-1db2-4572-b1d3-5475959b98f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:55.551694 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e9c9d-1db2-4572-b1d3-5475959b98f5 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:55.551982 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e9c9d-1db2-4572-b1d3-5475959b98f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:55.552254 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128e9c9d-1db2-4572-b1d3-5475959b98f5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:55.552892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e9c9d-1db2-4572-b1d3-5475959b98f5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:55.554847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128e9c9d-1db2-4572-b1d3-5475959b98f5 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:55.564764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-128e9c9d-1db2-4572-b1d3-5475959b98f5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 22:36:55.564764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:55.564764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:36:55.564764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:36:55.564764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:36:55.564764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:36:55.564764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:36:55.564764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:55.564764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 22:36:55.564764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:55.564764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:36:55.564764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:55.564764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:55.564764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:55.564764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:55.564764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:55.565706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:55.565706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:55.565706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:55.565706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:55.565706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:55.565706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:55.565706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:55.565706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:36:55.565706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:36:55.565706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:36:55.565706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:36:55.565706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:55.565706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:55.565706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:55.565706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:55.565706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:55.566600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:55.566600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:55.566600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:55.566600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:55.566600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:55.566600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:55.566600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:55.566600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:55.566600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:55.566600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:55.566600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:55.566600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:36:55.566600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:55.566600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 22:36:55.566600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:55.566600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 456/913] 10.222.0.48 () {56 vars in 1132 bytes} [Wed Jul 27 22:36:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:55.577968 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e9c9d-1db2-4572-b1d3-5475959b98f5 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:55.621519 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b5eb2-ae54-450c-aa55-44476f032d0d None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:55.664802 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431fd27-b956-48f4-aa3b-5ca36e209a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:55.665523 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431fd27-b956-48f4-aa3b-5ca36e209a74 None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:55.665842 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431fd27-b956-48f4-aa3b-5ca36e209a74 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:55.666120 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431fd27-b956-48f4-aa3b-5ca36e209a74 None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:55.666862 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431fd27-b956-48f4-aa3b-5ca36e209a74 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:55.668239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431fd27-b956-48f4-aa3b-5ca36e209a74 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:55.687425 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 458/914] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 22:36:55 2022] POST /identity/v3/services => generated 241 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:36:55.723942 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128e9c9d-1db2-4572-b1d3-5475959b98f5 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:55.771666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a135b-e37d-449d-ba44-c78dbbcf7c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:55.772298 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a135b-e37d-449d-ba44-c78dbbcf7c73 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:55.772626 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a135b-e37d-449d-ba44-c78dbbcf7c73 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:55.772955 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4a135b-e37d-449d-ba44-c78dbbcf7c73 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:55.773647 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a135b-e37d-449d-ba44-c78dbbcf7c73 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:55.773955 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a135b-e37d-449d-ba44-c78dbbcf7c73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:55.775540 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4a135b-e37d-449d-ba44-c78dbbcf7c73 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:55.782051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 457/915] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 22:36:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:55.787763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431fd27-b956-48f4-aa3b-5ca36e209a74 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:55.825362 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:55.902163 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431fd27-b956-48f4-aa3b-5ca36e209a74 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:55.942585 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18521245-fbe2-44ba-a33f-7b07a75faa7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:55.943217 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18521245-fbe2-44ba-a33f-7b07a75faa7f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:55.943499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18521245-fbe2-44ba-a33f-7b07a75faa7f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:55.943770 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18521245-fbe2-44ba-a33f-7b07a75faa7f None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:55.944448 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18521245-fbe2-44ba-a33f-7b07a75faa7f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:55.944792 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18521245-fbe2-44ba-a33f-7b07a75faa7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:55.946154 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18521245-fbe2-44ba-a33f-7b07a75faa7f None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:55.951969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 459/916] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 22:36:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:36:55.959575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a135b-e37d-449d-ba44-c78dbbcf7c73 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:55.976457 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:56.070456 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4a135b-e37d-449d-ba44-c78dbbcf7c73 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:56.108753 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589ec2a-2486-444c-8326-ca968aad464c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:56.109629 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589ec2a-2486-444c-8326-ca968aad464c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:56.110061 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589ec2a-2486-444c-8326-ca968aad464c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:56.110553 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589ec2a-2486-444c-8326-ca968aad464c None admin] PATH_INFO: `/v3/endpoints` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:56.111456 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589ec2a-2486-444c-8326-ca968aad464c None admin] RBAC: Adding query filter params (interface=public, service_id=e1a30f77c3cb42c5b9d989212b2a060a, region_id=RegionOne) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:56.111928 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589ec2a-2486-444c-8326-ca968aad464c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:56.113425 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589ec2a-2486-444c-8326-ca968aad464c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:56.119388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 458/917] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jul 27 22:36:55 2022] GET /identity/v3/endpoints?service_id=e1a30f77c3cb42c5b9d989212b2a060a&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:56.124617 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18521245-fbe2-44ba-a33f-7b07a75faa7f None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:56.224259 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:56.231872 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18521245-fbe2-44ba-a33f-7b07a75faa7f None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:56.268095 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf3c40-c296-4973-aa17-51dcf98cd8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:56.268944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf3c40-c296-4973-aa17-51dcf98cd8c7 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:56.269399 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf3c40-c296-4973-aa17-51dcf98cd8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:56.269839 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf3c40-c296-4973-aa17-51dcf98cd8c7 None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:56.270660 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf3c40-c296-4973-aa17-51dcf98cd8c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:56.272168 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf3c40-c296-4973-aa17-51dcf98cd8c7 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:56.279199 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 460/918] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jul 27 22:36:56 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:36:56.998528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ff5a6-7ee5-429b-b753-ee4ae3a5dff7 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:56.999068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ff5a6-7ee5-429b-b753-ee4ae3a5dff7 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:56.999068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ff5a6-7ee5-429b-b753-ee4ae3a5dff7 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:57.000661 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 459/919] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:57.005964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cac9a1-4e30-4c03-ae8c-6e52592250a8 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:57.006399 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cac9a1-4e30-4c03-ae8c-6e52592250a8 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:57.006572 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cac9a1-4e30-4c03-ae8c-6e52592250a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:57.025504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-99cac9a1-4e30-4c03-ae8c-6e52592250a8 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:57.026739 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-99cac9a1-4e30-4c03-ae8c-6e52592250a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:57.097154 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 461/920] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:36:57.119545 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ff5a6-7ee5-429b-b753-ee4ae3a5dff7 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:57.200360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:57.224866 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ff5a6-7ee5-429b-b753-ee4ae3a5dff7 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:57.259525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130179e6-9d05-4397-96cc-eac2116b8401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:57.260091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130179e6-9d05-4397-96cc-eac2116b8401 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:57.260379 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130179e6-9d05-4397-96cc-eac2116b8401 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:57.260660 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130179e6-9d05-4397-96cc-eac2116b8401 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:57.271113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130179e6-9d05-4397-96cc-eac2116b8401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:36:57.276752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-130179e6-9d05-4397-96cc-eac2116b8401 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 22:36:57.276752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:57.276752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:57.276752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:57.276752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:57.276752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:57.276752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:57.276752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:57.276752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:57.276752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:57.276752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:57.276752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:57.276752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:36:57.276752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:36:57.276752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:36:57.276752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:36:57.277710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:36:57.277710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:36:57.277710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:36:57.277710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:36:57.277710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:57.277710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:57.277710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:57.277710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:57.277710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:57.277710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:57.277710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:57.277710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:57.277710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:57.277710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:57.277710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:57.277710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:57.278959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:57.278959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:57.278959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:57.278959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:57.278959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:36:57.278959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:36:57.278959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:36:57.278959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:36:57.278959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:36:57.278959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:36:57.278959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 22:36:57.278959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:57.278959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 460/921] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Jul 27 22:36:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:57.284196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cac9a1-4e30-4c03-ae8c-6e52592250a8 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:57.377583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:57.391635 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cac9a1-4e30-4c03-ae8c-6e52592250a8 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:57.432417 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db4c92-2e95-41fe-a74a-2974cad138d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:57.433054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db4c92-2e95-41fe-a74a-2974cad138d3 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:57.433343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db4c92-2e95-41fe-a74a-2974cad138d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:57.433626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db4c92-2e95-41fe-a74a-2974cad138d3 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:57.434383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db4c92-2e95-41fe-a74a-2974cad138d3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:57.434697 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db4c92-2e95-41fe-a74a-2974cad138d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:57.436140 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db4c92-2e95-41fe-a74a-2974cad138d3 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:57.445578 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 462/922] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jul 27 22:36:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:57.451414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130179e6-9d05-4397-96cc-eac2116b8401 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:57.491449 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b045f40-5c79-4438-9695-d60ae251aeea None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:57.492279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b045f40-5c79-4438-9695-d60ae251aeea None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:57.492544 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b045f40-5c79-4438-9695-d60ae251aeea None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:57.494165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 463/923] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:36:57.500332 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eed37d-54f4-43e3-a960-5412529d85b3 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:57.500621 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eed37d-54f4-43e3-a960-5412529d85b3 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:57.500901 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eed37d-54f4-43e3-a960-5412529d85b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:57.520168 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-36eed37d-54f4-43e3-a960-5412529d85b3 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:57.521399 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-36eed37d-54f4-43e3-a960-5412529d85b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:57.579697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130179e6-9d05-4397-96cc-eac2116b8401 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:57.599973 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 464/924] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:36:57.623596 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eed37d-54f4-43e3-a960-5412529d85b3 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:57.625482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd16cf-f45a-4043-aaa4-8a5e1312fef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:57.626438 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd16cf-f45a-4043-aaa4-8a5e1312fef0 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:57.627674 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd16cf-f45a-4043-aaa4-8a5e1312fef0 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:57.627974 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd16cf-f45a-4043-aaa4-8a5e1312fef0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:57.630854 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:57.642464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd16cf-f45a-4043-aaa4-8a5e1312fef0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:57.644556 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd16cf-f45a-4043-aaa4-8a5e1312fef0 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:57.665855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-7ecd16cf-f45a-4043-aaa4-8a5e1312fef0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:57.665855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:57.665855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:57.665855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:57.665855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:57.665855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:57.665855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:57.665855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:57.665855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:57.665855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:57.665855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:57.665855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:57.665855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:57.665855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:57.665855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:57.666861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:57.666861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:57.666861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:57.666861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:57.666861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:57.666861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:57.666861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:57.666861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:57.666861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:57.666861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:57.666861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:57.666861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:57.666861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:57.666861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:57.666861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:57.666861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:57.666861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:57.667817 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:57.667817 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:57.667817 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:57.667817 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:57.673412 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 461/925] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:57.674295 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd16cf-f45a-4043-aaa4-8a5e1312fef0 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:57.720062 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:57.755452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eed37d-54f4-43e3-a960-5412529d85b3 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:57.792926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd16cf-f45a-4043-aaa4-8a5e1312fef0 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:57.801559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386144a1-32cd-4c56-8f87-cf8ea911a520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:57.802507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386144a1-32cd-4c56-8f87-cf8ea911a520 None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:57.802801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386144a1-32cd-4c56-8f87-cf8ea911a520 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:57.803154 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386144a1-32cd-4c56-8f87-cf8ea911a520 None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:57.804005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386144a1-32cd-4c56-8f87-cf8ea911a520 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:57.805643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386144a1-32cd-4c56-8f87-cf8ea911a520 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:57.808462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: WARNING keystone.server.flask.common [None req-386144a1-32cd-4c56-8f87-cf8ea911a520 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 22:36:57.828788 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.sql.core [None req-386144a1-32cd-4c56-8f87-cf8ea911a520 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 22:36:57.828788 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 22:36:57.828788 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [parameters: {'id': '42b951529e464855bb63edafa2084575', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 22:36:57.828788 dv-cinder-851249-4-smb devstack@keystone.service[86595]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86595) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 22:36:57.836323 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869051e-ca4b-4f60-bae0-e905544b10dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:57.837201 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869051e-ca4b-4f60-bae0-e905544b10dc None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:57.837676 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869051e-ca4b-4f60-bae0-e905544b10dc None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:57.838154 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2869051e-ca4b-4f60-bae0-e905544b10dc None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:57.838513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-386144a1-32cd-4c56-8f87-cf8ea911a520 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 42b951529e464855bb63edafa2084575.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 42b951529e464855bb63edafa2084575. Jul 27 22:36:57.838513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:57.838513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 22:36:57.838513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 22:36:57.838513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 22:36:57.838513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 22:36:57.838513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 22:36:57.838513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 22:36:57.838513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 22:36:57.838513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application conn.query(q) Jul 27 22:36:57.838513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 22:36:57.838513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 22:36:57.838513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 22:36:57.839343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application result.read() Jul 27 22:36:57.839343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 22:36:57.839343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 22:36:57.839343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 22:36:57.839343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 22:36:57.839343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 22:36:57.839343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 22:36:57.839343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 22:36:57.839343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 22:36:57.839343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 22:36:57.839343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:57.839343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 22:36:57.839343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:57.839343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:57.839343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 22:36:57.839343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 22:36:57.839343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 27 22:36:57.839343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 27 22:36:57.840338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 22:36:57.840338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application next(self.gen) Jul 27 22:36:57.840338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 22:36:57.840338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application yield resource Jul 27 22:36:57.840338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 22:36:57.840338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application next(self.gen) Jul 27 22:36:57.840338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 22:36:57.840338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 22:36:57.840338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 22:36:57.840338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 22:36:57.840338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 22:36:57.840338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise self.value Jul 27 22:36:57.840338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 22:36:57.840338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 22:36:57.840338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 22:36:57.840338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application session.commit() Jul 27 22:36:57.840338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 22:36:57.841274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 22:36:57.841274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 22:36:57.841274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 22:36:57.841274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 22:36:57.841274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self.session.flush() Jul 27 22:36:57.841274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 22:36:57.841274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 22:36:57.841274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 22:36:57.841274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 22:36:57.841274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 22:36:57.841274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application compat.raise_( Jul 27 22:36:57.841274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 22:36:57.841274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception Jul 27 22:36:57.841274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 22:36:57.841274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 22:36:57.841274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 22:36:57.841274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 22:36:57.842243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 22:36:57.842243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 22:36:57.842243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 22:36:57.842243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 22:36:57.842243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 22:36:57.842243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 22:36:57.842243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 22:36:57.842243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 22:36:57.842243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 22:36:57.842243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 22:36:57.842243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 22:36:57.842243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 22:36:57.842243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 22:36:57.842243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 22:36:57.842243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 22:36:57.843105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 22:36:57.843105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 22:36:57.843105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception Jul 27 22:36:57.843105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 22:36:57.843105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 22:36:57.843105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 22:36:57.843105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 22:36:57.843105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 22:36:57.843105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 22:36:57.843105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 22:36:57.843105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application conn.query(q) Jul 27 22:36:57.843105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 22:36:57.843105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 22:36:57.843105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 22:36:57.843105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application result.read() Jul 27 22:36:57.843105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 22:36:57.843105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 22:36:57.843998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 22:36:57.843998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 22:36:57.843998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 22:36:57.843998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 22:36:57.843998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 22:36:57.843998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 22:36:57.843998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 22:36:57.843998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 22:36:57.843998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [parameters: {'id': '42b951529e464855bb63edafa2084575', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 22:36:57.843998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 22:36:57.843998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:57.843998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:36:57.843998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:57.843998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:57.843998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 27 22:36:57.844800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 27 22:36:57.844800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 22:36:57.844800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 22:36:57.844800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 27 22:36:57.844800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:57.844800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:36:57.844800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:57.844800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:57.844800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:57.844800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:57.844800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:57.844800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:57.844800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:57.844800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:57.844800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:57.844800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:57.844800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:57.845734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:57.845734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 27 22:36:57.845734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 27 22:36:57.845734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:57.845734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:57.845734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 27 22:36:57.845734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 27 22:36:57.845734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 42b951529e464855bb63edafa2084575. Jul 27 22:36:57.845734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:57.845734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 465/926] 10.222.0.48 () {60 vars in 1140 bytes} [Wed Jul 27 22:36:57 2022] POST /identity/v3/projects => generated 262 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:57.846294 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386144a1-32cd-4c56-8f87-cf8ea911a520 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:57.849813 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869051e-ca4b-4f60-bae0-e905544b10dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:57.849813 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869051e-ca4b-4f60-bae0-e905544b10dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:57.851531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2869051e-ca4b-4f60-bae0-e905544b10dc None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:57.865268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 462/927] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:57.871111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869051e-ca4b-4f60-bae0-e905544b10dc None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:57.924204 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:57.957441 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386144a1-32cd-4c56-8f87-cf8ea911a520 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:57.979930 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2869051e-ca4b-4f60-bae0-e905544b10dc None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:57.993546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4202c4b-8dfd-472d-81ed-59695e5b003d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:57.994200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4202c4b-8dfd-472d-81ed-59695e5b003d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:57.994520 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4202c4b-8dfd-472d-81ed-59695e5b003d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:57.994808 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4202c4b-8dfd-472d-81ed-59695e5b003d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:57.997680 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:58.002957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4202c4b-8dfd-472d-81ed-59695e5b003d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:58.005070 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4202c4b-8dfd-472d-81ed-59695e5b003d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:58.016764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d0ce8-e75b-420e-928a-021fe391bfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:58.017417 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d0ce8-e75b-420e-928a-021fe391bfd4 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:58.017700 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d0ce8-e75b-420e-928a-021fe391bfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:58.017977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d0ce8-e75b-420e-928a-021fe391bfd4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:58.019403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-e4202c4b-8dfd-472d-81ed-59695e5b003d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:58.019403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:58.019403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:58.019403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:58.019403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:58.019403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:58.019403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:58.019403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:58.019403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:58.019403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:58.019403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:58.019403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:58.019403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:58.019403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:58.019403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:58.020517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:58.020517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:58.020517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:58.020517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:58.020517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:58.020517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:58.020517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:58.020517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:58.020517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:58.020517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:58.020517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:58.020517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:58.020517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:58.020517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:58.020517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:58.020517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:58.020517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:58.021438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:58.021438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:58.021438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:58.021438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:58.021438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:58.021438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:58.021438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:58.021438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:58.025927 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 466/928] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:58.027343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af1585-afd2-493a-8f66-b725e61937ac None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:58.027634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af1585-afd2-493a-8f66-b725e61937ac None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:58.027915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6af1585-afd2-493a-8f66-b725e61937ac None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:58.028574 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d0ce8-e75b-420e-928a-021fe391bfd4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:58.030018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d0ce8-e75b-420e-928a-021fe391bfd4 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:58.034389 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 467/929] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:58.034389 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af1585-afd2-493a-8f66-b725e61937ac None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:58.045945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-611d0ce8-e75b-420e-928a-021fe391bfd4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 22:36:58.045945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:58.045945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:58.045945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:58.045945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:58.045945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:58.045945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:58.045945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:58.045945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:58.045945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:58.045945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:58.045945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:58.045945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:36:58.045945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:36:58.045945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:36:58.045945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:36:58.046950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:58.046950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:58.046950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:36:58.046950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:58.046950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:36:58.046950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:36:58.046950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:58.046950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:58.046950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:58.046950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:58.046950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:58.046950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:58.046950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:58.046950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:58.046950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:58.046950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:58.046950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:58.046950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:58.047884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:58.047884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:58.047884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:36:58.047884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:36:58.047884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:36:58.047884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:36:58.047884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:36:58.047884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:36:58.047884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 22:36:58.047884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:58.047884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 463/930] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jul 27 22:36:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:58.049258 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f11399-1df4-42a6-a686-b0e709f890ef None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:58.049258 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f11399-1df4-42a6-a686-b0e709f890ef None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:58.049258 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f11399-1df4-42a6-a686-b0e709f890ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:58.068637 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-35f11399-1df4-42a6-a686-b0e709f890ef None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:58.070399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-35f11399-1df4-42a6-a686-b0e709f890ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:58.143726 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6af1585-afd2-493a-8f66-b725e61937ac None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:58.145958 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 464/931] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:36:58.146837 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f11399-1df4-42a6-a686-b0e709f890ef None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:58.190697 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05045b-8f21-4ef4-b300-a51254727e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:58.191345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05045b-8f21-4ef4-b300-a51254727e09 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:58.191626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05045b-8f21-4ef4-b300-a51254727e09 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:58.191900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be05045b-8f21-4ef4-b300-a51254727e09 None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:58.192618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05045b-8f21-4ef4-b300-a51254727e09 None admin] RBAC: Adding query filter params (name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:58.192920 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05045b-8f21-4ef4-b300-a51254727e09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:58.194370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be05045b-8f21-4ef4-b300-a51254727e09 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:58.197982 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:58.222371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 468/932] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 22:36:58 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:58.222371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05045b-8f21-4ef4-b300-a51254727e09 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:58.287906 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:58.288692 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f11399-1df4-42a6-a686-b0e709f890ef None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:58.331142 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a7ccf-99e4-4b5f-8e08-5814afceecf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:58.331809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a7ccf-99e4-4b5f-8e08-5814afceecf9 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:58.332241 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a7ccf-99e4-4b5f-8e08-5814afceecf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:58.332586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a7ccf-99e4-4b5f-8e08-5814afceecf9 None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:58.333513 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a7ccf-99e4-4b5f-8e08-5814afceecf9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:58.333906 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a7ccf-99e4-4b5f-8e08-5814afceecf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:58.336286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a7ccf-99e4-4b5f-8e08-5814afceecf9 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:58.348128 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be05045b-8f21-4ef4-b300-a51254727e09 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:58.357292 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 465/933] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Jul 27 22:36:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:58.362625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a7ccf-99e4-4b5f-8e08-5814afceecf9 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:58.399790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2109f-9249-41ef-b370-84d154a0aa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:58.400889 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2109f-9249-41ef-b370-84d154a0aa81 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:58.400889 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2109f-9249-41ef-b370-84d154a0aa81 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:58.401073 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2109f-9249-41ef-b370-84d154a0aa81 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:58.401597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2109f-9249-41ef-b370-84d154a0aa81 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:58.402994 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2109f-9249-41ef-b370-84d154a0aa81 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:58.412377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-e0e2109f-9249-41ef-b370-84d154a0aa81 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 22:36:58.412377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:58.412377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:36:58.412377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:36:58.412377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:36:58.412377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:36:58.412377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:36:58.412377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:58.412377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 22:36:58.412377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:58.412377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:36:58.412377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:58.412377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:58.412377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:58.412377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:58.412377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:58.412377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:58.414220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:58.414220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:58.414220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:58.414220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:58.414220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:58.414220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:58.414220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:36:58.414220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:36:58.414220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:36:58.414220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:36:58.414220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:58.414220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:58.414220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:58.414220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:58.414220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:58.414220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:58.415319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:58.415319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:58.415319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:58.415319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:58.415319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:58.415319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:58.415319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:58.415319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:58.415319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:58.415319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:58.415319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:36:58.415319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:58.415319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 22:36:58.415319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:36:58.415319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 469/934] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 22:36:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:58.416302 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6321494-68b2-4ec0-a1f5-806dc8312104 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:58.416302 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6321494-68b2-4ec0-a1f5-806dc8312104 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:58.416302 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6321494-68b2-4ec0-a1f5-806dc8312104 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:58.417079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 470/935] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:36:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:36:58.422269 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c747f3-3b9b-478f-a8f4-b5ef78256204 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:58.422602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c747f3-3b9b-478f-a8f4-b5ef78256204 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:58.422885 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c747f3-3b9b-478f-a8f4-b5ef78256204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:58.440960 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-77c747f3-3b9b-478f-a8f4-b5ef78256204 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:36:58.442467 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-77c747f3-3b9b-478f-a8f4-b5ef78256204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:36:58.480630 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:58.486550 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a7ccf-99e4-4b5f-8e08-5814afceecf9 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:58.521121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 471/936] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:36:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:36:58.521773 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c747f3-3b9b-478f-a8f4-b5ef78256204 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:58.527351 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52774f4-b2f8-48de-98f5-aa5a81b4a5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:58.528237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52774f4-b2f8-48de-98f5-aa5a81b4a5eb None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:58.528750 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52774f4-b2f8-48de-98f5-aa5a81b4a5eb None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:58.529252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52774f4-b2f8-48de-98f5-aa5a81b4a5eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:58.546816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52774f4-b2f8-48de-98f5-aa5a81b4a5eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:58.548264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52774f4-b2f8-48de-98f5-aa5a81b4a5eb None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:58.564426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-e52774f4-b2f8-48de-98f5-aa5a81b4a5eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:58.564426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:58.564426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:58.564426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:58.564426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:58.564426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:58.564426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:58.564426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:58.564426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:58.564426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:58.564426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:58.564426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:58.564426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:36:58.564426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:36:58.564426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:36:58.565363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:36:58.565363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:58.565363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:58.565363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:58.565363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:58.565363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:58.565363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:58.565363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:58.565363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:58.565363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:58.565363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:58.565363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:58.565363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:58.565363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:58.565363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:58.565363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:58.565363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:58.566270 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:36:58.566270 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:36:58.566270 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:36:58.566270 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:58.566270 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 466/937] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:36:58.566608 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52774f4-b2f8-48de-98f5-aa5a81b4a5eb None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:58.583264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:58.643616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c747f3-3b9b-478f-a8f4-b5ef78256204 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:58.675171 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52774f4-b2f8-48de-98f5-aa5a81b4a5eb None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:58.679567 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d80d3-7bce-424a-a0b5-07f8933818c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:58.680187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d80d3-7bce-424a-a0b5-07f8933818c7 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:58.680464 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d80d3-7bce-424a-a0b5-07f8933818c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:58.680733 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d80d3-7bce-424a-a0b5-07f8933818c7 None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:58.681409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d80d3-7bce-424a-a0b5-07f8933818c7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:58.681706 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d80d3-7bce-424a-a0b5-07f8933818c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:58.683100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244d80d3-7bce-424a-a0b5-07f8933818c7 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:58.692663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 472/938] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jul 27 22:36:58 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:58.692663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d80d3-7bce-424a-a0b5-07f8933818c7 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:58.716517 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8232a3-5c38-4271-b56d-82a962a9bec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:58.717169 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8232a3-5c38-4271-b56d-82a962a9bec7 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:58.717460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8232a3-5c38-4271-b56d-82a962a9bec7 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:58.717737 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8232a3-5c38-4271-b56d-82a962a9bec7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:58.718399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8232a3-5c38-4271-b56d-82a962a9bec7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:58.719761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8232a3-5c38-4271-b56d-82a962a9bec7 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:58.729187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-dd8232a3-5c38-4271-b56d-82a962a9bec7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 22:36:58.729187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:58.729187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:36:58.729187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:36:58.729187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:36:58.729187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:36:58.729187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:36:58.729187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:58.729187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 22:36:58.729187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:58.729187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:36:58.729187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:58.729187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:58.729187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:58.729187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:58.729187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:58.730134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:58.730134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:58.730134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:58.730134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:58.730134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:58.730134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:58.730134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:58.730134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:36:58.730134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:36:58.730134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:36:58.730134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:36:58.730134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:58.730134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:58.730134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:58.730134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:58.730134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:58.731042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:58.731042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:58.731042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:58.731042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:58.731042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:58.731042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:58.731042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:58.731042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:58.731042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:58.731042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:58.731042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:58.731042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:36:58.731042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:36:58.731042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 22:36:58.731042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:58.735396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 467/939] 10.222.0.48 () {56 vars in 1132 bytes} [Wed Jul 27 22:36:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:58.736067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8232a3-5c38-4271-b56d-82a962a9bec7 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:58.751512 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:58.809468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d80d3-7bce-424a-a0b5-07f8933818c7 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:58.825401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:58.848083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8232a3-5c38-4271-b56d-82a962a9bec7 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:58.848360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e5864-aab8-44e3-9331-597f6a9718a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:58.848894 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e5864-aab8-44e3-9331-597f6a9718a0 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:58.849182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e5864-aab8-44e3-9331-597f6a9718a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:58.849464 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5e5864-aab8-44e3-9331-597f6a9718a0 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:58.850163 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e5864-aab8-44e3-9331-597f6a9718a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:58.850530 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e5864-aab8-44e3-9331-597f6a9718a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:58.851936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5e5864-aab8-44e3-9331-597f6a9718a0 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:58.868266 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 473/940] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:58.868266 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e5864-aab8-44e3-9331-597f6a9718a0 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:58.889713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a5fd5-f770-4d2d-bbca-b9a7ce2de205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:58.890773 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a5fd5-f770-4d2d-bbca-b9a7ce2de205 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:58.891063 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a5fd5-f770-4d2d-bbca-b9a7ce2de205 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:58.891490 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a5fd5-f770-4d2d-bbca-b9a7ce2de205 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:58.892168 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a5fd5-f770-4d2d-bbca-b9a7ce2de205 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:58.892485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a5fd5-f770-4d2d-bbca-b9a7ce2de205 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:58.893837 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a5fd5-f770-4d2d-bbca-b9a7ce2de205 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:58.904006 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 468/941] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jul 27 22:36:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:58.904006 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a5fd5-f770-4d2d-bbca-b9a7ce2de205 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:58.977930 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5e5864-aab8-44e3-9331-597f6a9718a0 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:58.985271 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:59.010648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a5fd5-f770-4d2d-bbca-b9a7ce2de205 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:59.015433 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68b7e9-8df3-49df-9bb0-0bc1de28ba59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:59.016278 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68b7e9-8df3-49df-9bb0-0bc1de28ba59 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:59.016768 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68b7e9-8df3-49df-9bb0-0bc1de28ba59 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:59.017261 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68b7e9-8df3-49df-9bb0-0bc1de28ba59 None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:59.018115 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68b7e9-8df3-49df-9bb0-0bc1de28ba59 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:59.018653 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68b7e9-8df3-49df-9bb0-0bc1de28ba59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:59.020193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68b7e9-8df3-49df-9bb0-0bc1de28ba59 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:59.026630 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 474/942] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 22:36:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:59.027631 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68b7e9-8df3-49df-9bb0-0bc1de28ba59 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:59.054620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081395b-29eb-470a-bbf8-c7e8b24c2a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:59.055582 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081395b-29eb-470a-bbf8-c7e8b24c2a09 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:59.056125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081395b-29eb-470a-bbf8-c7e8b24c2a09 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:59.056421 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081395b-29eb-470a-bbf8-c7e8b24c2a09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:59.064848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081395b-29eb-470a-bbf8-c7e8b24c2a09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:59.066202 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:59.066726 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5081395b-29eb-470a-bbf8-c7e8b24c2a09 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:59.079849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-5081395b-29eb-470a-bbf8-c7e8b24c2a09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:59.079849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:36:59.079849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:36:59.079849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:36:59.079849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:36:59.079849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:36:59.079849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:36:59.079849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:36:59.079849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:36:59.079849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:36:59.079849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:36:59.079849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:36:59.079849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:36:59.079849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:36:59.079849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:36:59.080806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:36:59.080806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:36:59.080806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:36:59.080806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:36:59.080806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:36:59.080806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:36:59.080806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:36:59.080806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:36:59.080806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:36:59.080806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:36:59.080806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:36:59.080806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:36:59.080806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:36:59.080806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:36:59.080806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:36:59.080806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:36:59.080806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:36:59.081734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:36:59.081734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:36:59.081734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:36:59.081734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:36:59.081734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:36:59.081734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:36:59.081734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:36:59.081734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:36:59.081734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 469/943] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:36:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:36:59.082222 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081395b-29eb-470a-bbf8-c7e8b24c2a09 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:59.141415 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68b7e9-8df3-49df-9bb0-0bc1de28ba59 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:59.176345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a3cf5-9c1d-42b5-816e-1b41accea106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:59.176962 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a3cf5-9c1d-42b5-816e-1b41accea106 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:59.177248 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a3cf5-9c1d-42b5-816e-1b41accea106 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:59.177528 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a3cf5-9c1d-42b5-816e-1b41accea106 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:59.178334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a3cf5-9c1d-42b5-816e-1b41accea106 None admin] RBAC: Adding query filter params (interface=public, service_id=359f04c24e494e599ab1ebe2dd3678b5, region_id=RegionOne) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:59.178739 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a3cf5-9c1d-42b5-816e-1b41accea106 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:59.180639 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44a3cf5-9c1d-42b5-816e-1b41accea106 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:59.189992 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 475/944] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jul 27 22:36:59 2022] GET /identity/v3/endpoints?service_id=359f04c24e494e599ab1ebe2dd3678b5&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:59.189992 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a3cf5-9c1d-42b5-816e-1b41accea106 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:59.190225 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081395b-29eb-470a-bbf8-c7e8b24c2a09 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:59.228366 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df075037-1c8f-4dc1-b865-f00357894cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:59.228989 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df075037-1c8f-4dc1-b865-f00357894cfa None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:59.229279 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df075037-1c8f-4dc1-b865-f00357894cfa None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:59.229609 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df075037-1c8f-4dc1-b865-f00357894cfa None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:59.230295 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df075037-1c8f-4dc1-b865-f00357894cfa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:59.230633 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df075037-1c8f-4dc1-b865-f00357894cfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:59.232498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df075037-1c8f-4dc1-b865-f00357894cfa None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:59.235760 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:59.245402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 470/945] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 22:36:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:59.246491 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df075037-1c8f-4dc1-b865-f00357894cfa None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:59.294236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a3cf5-9c1d-42b5-816e-1b41accea106 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:59.295790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:59.329502 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d604f96-aaad-4e3c-94c3-a97ec1704569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:59.330125 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d604f96-aaad-4e3c-94c3-a97ec1704569 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:59.330454 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d604f96-aaad-4e3c-94c3-a97ec1704569 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:59.330739 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d604f96-aaad-4e3c-94c3-a97ec1704569 None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:59.331495 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d604f96-aaad-4e3c-94c3-a97ec1704569 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:36:59.331808 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d604f96-aaad-4e3c-94c3-a97ec1704569 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:59.333237 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d604f96-aaad-4e3c-94c3-a97ec1704569 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:59.347484 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 476/946] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:36:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:36:59.348283 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d604f96-aaad-4e3c-94c3-a97ec1704569 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:59.365611 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df075037-1c8f-4dc1-b865-f00357894cfa None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:59.405938 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a53e9-62bd-405e-9419-a5d7524d4b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:59.406693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a53e9-62bd-405e-9419-a5d7524d4b17 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:59.406982 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a53e9-62bd-405e-9419-a5d7524d4b17 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:59.407263 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1a53e9-62bd-405e-9419-a5d7524d4b17 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:59.407929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a53e9-62bd-405e-9419-a5d7524d4b17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:59.409308 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1a53e9-62bd-405e-9419-a5d7524d4b17 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:59.426574 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 471/947] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jul 27 22:36:59 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:36:59.427717 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a53e9-62bd-405e-9419-a5d7524d4b17 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:36:59.461497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d604f96-aaad-4e3c-94c3-a97ec1704569 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:59.508505 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d124a-6f7c-4547-80c8-8b9330a33ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:59.509272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d124a-6f7c-4547-80c8-8b9330a33ad5 None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:59.509637 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d124a-6f7c-4547-80c8-8b9330a33ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:59.510242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d124a-6f7c-4547-80c8-8b9330a33ad5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:59.511076 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d124a-6f7c-4547-80c8-8b9330a33ad5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:59.513468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d124a-6f7c-4547-80c8-8b9330a33ad5 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:59.516315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:36:59.547301 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 477/948] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:36:59 2022] POST /identity/v3/endpoints => generated 347 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:36:59.570155 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1a53e9-62bd-405e-9419-a5d7524d4b17 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:36:59.627611 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddc05d-441d-44ea-8ed1-86ed258e375a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:36:59.628310 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddc05d-441d-44ea-8ed1-86ed258e375a None admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:36:59.628590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddc05d-441d-44ea-8ed1-86ed258e375a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:36:59.628862 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddc05d-441d-44ea-8ed1-86ed258e375a None admin] PATH_INFO: `/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/db10ad54ec9948a3bb8b04c708fc4ca7/roles/5b5390395eb544b8bf3d5d39591c987d` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:36:59.631274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ddc05d-441d-44ea-8ed1-86ed258e375a None admin] RBAC: Authorizing `identity:create_grant(project_id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user_id=db10ad54ec9948a3bb8b04c708fc4ca7, role_id=5b5390395eb544b8bf3d5d39591c987d)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:36:59.633245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ddc05d-441d-44ea-8ed1-86ed258e375a None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:36:59.650530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 472/949] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:36:59 2022] PUT /identity/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/db10ad54ec9948a3bb8b04c708fc4ca7/roles/5b5390395eb544b8bf3d5d39591c987d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:37:00.419435 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8cefa-df0e-4221-8384-56d42c18512e None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:00.419992 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8cefa-df0e-4221-8384-56d42c18512e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:00.419992 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8cefa-df0e-4221-8384-56d42c18512e None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:00.422084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 478/950] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:00.429937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bd3c8-51de-416a-8c07-e693395dc861 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:00.430391 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bd3c8-51de-416a-8c07-e693395dc861 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:00.430582 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bd3c8-51de-416a-8c07-e693395dc861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:00.450647 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-6c3bd3c8-51de-416a-8c07-e693395dc861 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:00.452108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6c3bd3c8-51de-416a-8c07-e693395dc861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:00.526702 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 473/951] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:00.550465 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8cefa-df0e-4221-8384-56d42c18512e None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:00.571545 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:00.669289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8cefa-df0e-4221-8384-56d42c18512e None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:00.706275 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aba99b-35ac-4c9f-a87d-1c99f132e4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:00.706855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aba99b-35ac-4c9f-a87d-1c99f132e4a3 None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:00.707144 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aba99b-35ac-4c9f-a87d-1c99f132e4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:00.707427 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aba99b-35ac-4c9f-a87d-1c99f132e4a3 None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:00.708124 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aba99b-35ac-4c9f-a87d-1c99f132e4a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:00.709570 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63aba99b-35ac-4c9f-a87d-1c99f132e4a3 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:00.725581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.sql.core [None req-63aba99b-35ac-4c9f-a87d-1c99f132e4a3 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 22:37:00.725581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 22:37:00.725581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [parameters: {'user_id': '5fab7956e1504031a1f167995c80f44b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 22:37:00.725581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86595) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 22:37:00.733765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-63aba99b-35ac-4c9f-a87d-1c99f132e4a3 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 22:37:00.733765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:00.733765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 22:37:00.733765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 22:37:00.733765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 22:37:00.733765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 22:37:00.733765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 22:37:00.733765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 22:37:00.733765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 22:37:00.733765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application conn.query(q) Jul 27 22:37:00.733765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 22:37:00.733765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 22:37:00.733765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 22:37:00.733765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application result.read() Jul 27 22:37:00.733765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 22:37:00.735045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 22:37:00.735045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 22:37:00.735045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 22:37:00.735045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 22:37:00.735045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 22:37:00.735045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 22:37:00.735045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 22:37:00.735045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 22:37:00.735045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:00.735045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 22:37:00.735045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:00.735045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:00.735045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 22:37:00.735045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 22:37:00.735045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 27 22:37:00.735045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 27 22:37:00.735045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 22:37:00.735045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application next(self.gen) Jul 27 22:37:00.736106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 22:37:00.736106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application yield resource Jul 27 22:37:00.736106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 22:37:00.736106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application next(self.gen) Jul 27 22:37:00.736106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 22:37:00.736106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 22:37:00.736106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 22:37:00.736106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 22:37:00.736106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 22:37:00.736106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise self.value Jul 27 22:37:00.736106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 22:37:00.736106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 22:37:00.736106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 22:37:00.736106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application session.commit() Jul 27 22:37:00.736106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 22:37:00.736106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 22:37:00.736106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 22:37:00.737079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 22:37:00.737079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 22:37:00.737079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self.session.flush() Jul 27 22:37:00.737079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 22:37:00.737079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 22:37:00.737079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 22:37:00.737079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 22:37:00.737079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 22:37:00.737079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application compat.raise_( Jul 27 22:37:00.737079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 22:37:00.737079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception Jul 27 22:37:00.737079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 22:37:00.737079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 22:37:00.737079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 22:37:00.737079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 22:37:00.737079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 22:37:00.737079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 22:37:00.739240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 22:37:00.739240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 22:37:00.739240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 27 22:37:00.739240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 27 22:37:00.739240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 22:37:00.739240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 22:37:00.739240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 22:37:00.739240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 22:37:00.739240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 22:37:00.739240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 22:37:00.739240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 22:37:00.739240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 22:37:00.739240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 22:37:00.739240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 22:37:00.739240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 22:37:00.739240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception Jul 27 22:37:00.741370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 22:37:00.741370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 22:37:00.741370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 22:37:00.741370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 22:37:00.741370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 22:37:00.741370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 22:37:00.741370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 22:37:00.741370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application conn.query(q) Jul 27 22:37:00.741370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 22:37:00.741370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 22:37:00.741370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 22:37:00.741370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application result.read() Jul 27 22:37:00.741370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 22:37:00.741370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 22:37:00.741370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 22:37:00.741370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 22:37:00.743507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 22:37:00.743507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 22:37:00.743507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 22:37:00.743507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 22:37:00.743507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 22:37:00.743507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 22:37:00.743507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [parameters: {'user_id': '5fab7956e1504031a1f167995c80f44b', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 22:37:00.743507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 22:37:00.743507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:00.743507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:37:00.743507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:00.743507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:00.743507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:00.743507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:00.743507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:00.745458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:00.745458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:00.745458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:00.745458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:00.745458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:00.745458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:00.745458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:00.745458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 27 22:37:00.745458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 27 22:37:00.745458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:00.745458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:00.745458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:37:00.745458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:37:00.745458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:37:00.745458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:37:00.745458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 27 22:37:00.745458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 27 22:37:00.747761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 27 22:37:00.747761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 27 22:37:00.747761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 22:37:00.747761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 22:37:00.747761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 22:37:00.747761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:00.747761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 479/952] 10.222.0.48 () {60 vars in 1131 bytes} [Wed Jul 27 22:37:00 2022] POST /identity/v3/users => generated 160 bytes in 185 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:00.748698 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3bd3c8-51de-416a-8c07-e693395dc861 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:00.798861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:00.854603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3bd3c8-51de-416a-8c07-e693395dc861 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:00.890305 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243b23de-876b-45eb-9208-72e8c392b9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:00.890978 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b23de-876b-45eb-9208-72e8c392b9bd None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:00.891264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b23de-876b-45eb-9208-72e8c392b9bd None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:00.891542 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b23de-876b-45eb-9208-72e8c392b9bd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:00.898693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b23de-876b-45eb-9208-72e8c392b9bd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:00.900117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243b23de-876b-45eb-9208-72e8c392b9bd None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:00.911794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-243b23de-876b-45eb-9208-72e8c392b9bd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 22:37:00.911794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:00.911794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:00.911794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:00.911794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:00.911794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:00.911794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:00.911794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:00.911794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:00.911794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:00.911794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:00.911794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:00.911794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:37:00.911794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:37:00.911794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:37:00.911794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:37:00.912745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:00.912745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:00.912745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:37:00.912745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:37:00.912745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:37:00.912745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:37:00.912745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:00.912745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:00.912745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:00.912745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:00.912745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:00.912745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:00.912745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:00.912745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:00.912745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:00.912745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:00.912745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:00.912745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:00.913809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:00.913809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:00.913809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:37:00.913809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:37:00.913809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:37:00.913809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:37:00.913809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:37:00.913809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:37:00.913809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 22:37:00.913809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:00.913809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 474/953] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:37:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:00.919089 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aba99b-35ac-4c9f-a87d-1c99f132e4a3 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:01.011798 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:01.029365 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aba99b-35ac-4c9f-a87d-1c99f132e4a3 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:01.065688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae4c6b-3a4b-4151-ac56-a65b75946f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:01.066681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae4c6b-3a4b-4151-ac56-a65b75946f85 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:01.067188 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae4c6b-3a4b-4151-ac56-a65b75946f85 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:01.067681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae4c6b-3a4b-4151-ac56-a65b75946f85 None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:01.068676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae4c6b-3a4b-4151-ac56-a65b75946f85 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:01.069187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae4c6b-3a4b-4151-ac56-a65b75946f85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:01.071065 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae4c6b-3a4b-4151-ac56-a65b75946f85 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:01.109565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 480/954] 10.222.0.48 () {56 vars in 1101 bytes} [Wed Jul 27 22:37:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:01.579724 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f025b0-8f5e-4224-8267-6fc9ae4e35a5 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:01.580266 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f025b0-8f5e-4224-8267-6fc9ae4e35a5 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:01.580266 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f025b0-8f5e-4224-8267-6fc9ae4e35a5 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:01.581772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 475/955] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:01.587386 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d35cb-db09-45e7-8db4-d81ca17b3fcf None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:01.587779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d35cb-db09-45e7-8db4-d81ca17b3fcf None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:01.587951 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18d35cb-db09-45e7-8db4-d81ca17b3fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:01.607330 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-c18d35cb-db09-45e7-8db4-d81ca17b3fcf None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:01.608936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c18d35cb-db09-45e7-8db4-d81ca17b3fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:01.677570 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 481/956] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:01.699267 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f025b0-8f5e-4224-8267-6fc9ae4e35a5 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:01.712053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d1483-65f3-4649-a186-0588648e9e2d None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:01.712348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d1483-65f3-4649-a186-0588648e9e2d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:01.712629 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d1483-65f3-4649-a186-0588648e9e2d None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:01.713989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 482/957] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:37:01.718885 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3f034-3f4f-49a3-b47e-bf46cf7dd856 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:01.719185 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3f034-3f4f-49a3-b47e-bf46cf7dd856 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:01.719472 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3f034-3f4f-49a3-b47e-bf46cf7dd856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:01.738760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-01b3f034-3f4f-49a3-b47e-bf46cf7dd856 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:01.740598 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-01b3f034-3f4f-49a3-b47e-bf46cf7dd856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:01.801055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:01.806946 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 483/958] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:37:01.807183 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f025b0-8f5e-4224-8267-6fc9ae4e35a5 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:01.808010 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee4559-ed1f-4d4c-92d7-613fd8ea92fe None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:01.808300 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee4559-ed1f-4d4c-92d7-613fd8ea92fe None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:01.808578 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee4559-ed1f-4d4c-92d7-613fd8ea92fe None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:01.809826 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 484/959] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:01.815094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3be693-54d2-4bad-9b54-716df6413880 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:01.815385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3be693-54d2-4bad-9b54-716df6413880 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:01.815665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3be693-54d2-4bad-9b54-716df6413880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:01.822206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:01.836524 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-7a3be693-54d2-4bad-9b54-716df6413880 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:01.837630 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-7a3be693-54d2-4bad-9b54-716df6413880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:01.849392 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eba208-8f78-4a75-8b5b-85d973a6fe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:01.850055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eba208-8f78-4a75-8b5b-85d973a6fe5e None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:01.850358 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eba208-8f78-4a75-8b5b-85d973a6fe5e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:01.850675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eba208-8f78-4a75-8b5b-85d973a6fe5e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:01.851323 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eba208-8f78-4a75-8b5b-85d973a6fe5e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:01.852705 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eba208-8f78-4a75-8b5b-85d973a6fe5e None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:01.864068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-61eba208-8f78-4a75-8b5b-85d973a6fe5e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 22:37:01.864068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:01.864068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:37:01.864068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:37:01.864068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:37:01.864068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:37:01.864068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:37:01.864068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:37:01.864068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 22:37:01.864068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:01.864068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:37:01.864068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:01.864068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:01.864068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:01.864068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:01.864068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:01.864068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:01.865364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:01.865364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:01.865364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:01.865364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:01.865364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:01.865364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:01.865364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:37:01.865364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:37:01.865364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:37:01.865364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:37:01.865364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:01.865364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:01.865364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:01.865364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:01.865364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:01.865364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:01.866284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:01.866284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:01.866284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:01.866284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:01.866284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:01.866284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:01.866284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:01.866284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:01.866284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:01.866284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:01.866284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:37:01.866284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:37:01.866284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 22:37:01.866284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:01.866284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 476/960] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 22:37:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:01.868203 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eba208-8f78-4a75-8b5b-85d973a6fe5e None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:01.912365 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 485/961] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:37:01.913238 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3be693-54d2-4bad-9b54-716df6413880 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:01.976551 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eba208-8f78-4a75-8b5b-85d973a6fe5e None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:02.009427 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3be693-54d2-4bad-9b54-716df6413880 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:02.009590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4237f-178d-46a2-8a34-813b381f82eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:02.010076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4237f-178d-46a2-8a34-813b381f82eb None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:02.010383 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4237f-178d-46a2-8a34-813b381f82eb None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:02.010665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4237f-178d-46a2-8a34-813b381f82eb None admin] PATH_INFO: `/v3/services/compute` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:02.011293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4237f-178d-46a2-8a34-813b381f82eb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:02.012642 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4237f-178d-46a2-8a34-813b381f82eb None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:02.021372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-38b4237f-178d-46a2-8a34-813b381f82eb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 22:37:02.021372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:02.021372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:37:02.021372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:37:02.021372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:37:02.021372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:37:02.021372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:37:02.021372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:37:02.021372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 22:37:02.021372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:02.021372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:37:02.021372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:02.021372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:02.021372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:02.021372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:02.021372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:02.021372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:02.022604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:02.022604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:02.022604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:02.022604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:02.022604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:02.022604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:02.022604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:37:02.022604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:37:02.022604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:37:02.022604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:37:02.022604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:02.022604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:02.022604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:02.022604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:02.022604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:02.022604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:02.023720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:02.023720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:02.023720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:02.023720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:02.023720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:02.023720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:02.023720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:02.023720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:02.023720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:02.023720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:02.023720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:37:02.023720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:37:02.023720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 22:37:02.023720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:02.023720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 477/962] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:37:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:02.024729 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4237f-178d-46a2-8a34-813b381f82eb None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:02.041035 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:02.049664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07735d6c-6cc4-4953-9770-37feafb183e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:02.050292 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07735d6c-6cc4-4953-9770-37feafb183e4 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:02.050610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07735d6c-6cc4-4953-9770-37feafb183e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:02.050890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07735d6c-6cc4-4953-9770-37feafb183e4 None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:02.051573 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07735d6c-6cc4-4953-9770-37feafb183e4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:02.051881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07735d6c-6cc4-4953-9770-37feafb183e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:02.053246 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07735d6c-6cc4-4953-9770-37feafb183e4 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:02.057927 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 486/963] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jul 27 22:37:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:02.062248 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:02.062995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07735d6c-6cc4-4953-9770-37feafb183e4 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:02.122073 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4237f-178d-46a2-8a34-813b381f82eb None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:02.156854 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4744a-d224-4ba7-bbf2-c183fea0de0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:02.157493 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4744a-d224-4ba7-bbf2-c183fea0de0c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:02.157774 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4744a-d224-4ba7-bbf2-c183fea0de0c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:02.158052 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c4744a-d224-4ba7-bbf2-c183fea0de0c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:02.161105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07735d6c-6cc4-4953-9770-37feafb183e4 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:02.168254 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c4744a-d224-4ba7-bbf2-c183fea0de0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:37:02.173245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-e9c4744a-d224-4ba7-bbf2-c183fea0de0c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 22:37:02.173245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:02.173245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:02.173245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:02.173245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:02.173245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:02.173245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:02.173245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:02.173245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:02.173245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:02.173245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:02.173245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:02.173245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:37:02.173245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:37:02.173245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:37:02.173245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:37:02.175304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:37:02.175304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:37:02.175304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:37:02.175304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:37:02.175304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:02.175304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:02.175304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:02.175304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:02.175304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:02.175304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:02.175304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:02.175304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:02.175304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:02.175304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:02.175304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:02.175304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:02.176910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:02.176910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:02.176910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:02.176910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:02.176910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:37:02.176910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:37:02.176910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:37:02.176910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:37:02.176910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:37:02.176910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:37:02.176910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 22:37:02.176910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:02.176910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 478/964] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Jul 27 22:37:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:02.176910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4744a-d224-4ba7-bbf2-c183fea0de0c None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:02.207985 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d5792-cc2a-4651-882b-c9f0f9944440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:02.208700 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d5792-cc2a-4651-882b-c9f0f9944440 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:02.208988 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d5792-cc2a-4651-882b-c9f0f9944440 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:02.209258 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d5792-cc2a-4651-882b-c9f0f9944440 None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:02.209953 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d5792-cc2a-4651-882b-c9f0f9944440 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:02.210260 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d5792-cc2a-4651-882b-c9f0f9944440 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:02.211669 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d5792-cc2a-4651-882b-c9f0f9944440 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:02.219304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 487/965] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 22:37:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:02.219304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d5792-cc2a-4651-882b-c9f0f9944440 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:02.277974 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:02.287768 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:02.291724 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c4744a-d224-4ba7-bbf2-c183fea0de0c None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:02.321751 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d5792-cc2a-4651-882b-c9f0f9944440 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:02.326284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f5c48-45a9-4839-8525-7d26d8add0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:02.327183 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f5c48-45a9-4839-8525-7d26d8add0c1 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:02.327468 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f5c48-45a9-4839-8525-7d26d8add0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:02.327747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f5c48-45a9-4839-8525-7d26d8add0c1 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:02.328426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f5c48-45a9-4839-8525-7d26d8add0c1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:02.328737 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f5c48-45a9-4839-8525-7d26d8add0c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:02.330099 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f5c48-45a9-4839-8525-7d26d8add0c1 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:02.334870 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 479/966] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jul 27 22:37:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:02.335669 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f5c48-45a9-4839-8525-7d26d8add0c1 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:02.356121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52eeb4-3c21-406d-80a5-825a84d8b24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:02.356765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52eeb4-3c21-406d-80a5-825a84d8b24d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:02.357057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52eeb4-3c21-406d-80a5-825a84d8b24d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:02.357337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c52eeb4-3c21-406d-80a5-825a84d8b24d None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:02.358054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52eeb4-3c21-406d-80a5-825a84d8b24d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:02.358394 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52eeb4-3c21-406d-80a5-825a84d8b24d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:02.359761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c52eeb4-3c21-406d-80a5-825a84d8b24d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:02.368293 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 488/967] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jul 27 22:37:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:02.369049 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52eeb4-3c21-406d-80a5-825a84d8b24d None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:02.437697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f5c48-45a9-4839-8525-7d26d8add0c1 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:02.464679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c52eeb4-3c21-406d-80a5-825a84d8b24d None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:02.471616 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f195a-a301-4c7c-bd85-c84984f59930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:02.472228 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f195a-a301-4c7c-bd85-c84984f59930 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:02.472506 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f195a-a301-4c7c-bd85-c84984f59930 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:02.472782 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f195a-a301-4c7c-bd85-c84984f59930 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:02.473446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f195a-a301-4c7c-bd85-c84984f59930 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:02.473967 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f195a-a301-4c7c-bd85-c84984f59930 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:02.475323 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f195a-a301-4c7c-bd85-c84984f59930 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:02.479993 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 480/968] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 22:37:02 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:02.480745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f195a-a301-4c7c-bd85-c84984f59930 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:02.498542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:02.511431 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:02.530024 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43778c2e-87b5-4725-88a3-2473063012c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:02.530024 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43778c2e-87b5-4725-88a3-2473063012c6 None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:02.530024 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43778c2e-87b5-4725-88a3-2473063012c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:02.530024 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43778c2e-87b5-4725-88a3-2473063012c6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:02.530542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43778c2e-87b5-4725-88a3-2473063012c6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:02.530542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43778c2e-87b5-4725-88a3-2473063012c6 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:02.558993 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 489/969] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:37:02 2022] POST /identity/v3/endpoints => generated 349 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:37:02.628034 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f195a-a301-4c7c-bd85-c84984f59930 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:02.678542 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f4759-c419-4d42-8711-c2d5ff0b4778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:02.679823 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f4759-c419-4d42-8711-c2d5ff0b4778 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:02.680109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f4759-c419-4d42-8711-c2d5ff0b4778 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:02.680386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f4759-c419-4d42-8711-c2d5ff0b4778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:02.692258 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f4759-c419-4d42-8711-c2d5ff0b4778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:02.693655 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f4759-c419-4d42-8711-c2d5ff0b4778 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:02.710444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-9c2f4759-c419-4d42-8711-c2d5ff0b4778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:37:02.710444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:02.710444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:02.710444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:02.710444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:02.710444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:02.710444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:02.710444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:02.710444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:02.710444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:02.710444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:02.710444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:02.710444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:37:02.710444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:37:02.710444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:37:02.711440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:37:02.711440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:02.711440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:02.711440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:02.711440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:02.711440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:02.711440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:02.711440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:02.711440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:02.711440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:02.711440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:02.711440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:02.711440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:02.711440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:02.711440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:02.711440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:02.711440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:02.712778 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:37:02.712778 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:37:02.712778 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:37:02.712778 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:02.712778 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 481/970] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:02.717657 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43778c2e-87b5-4725-88a3-2473063012c6 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:02.824020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43778c2e-87b5-4725-88a3-2473063012c6 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:02.866888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab1576-c728-46ef-b922-0b470cb63aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:02.867826 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab1576-c728-46ef-b922-0b470cb63aeb None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:02.868323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab1576-c728-46ef-b922-0b470cb63aeb None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:02.868800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab1576-c728-46ef-b922-0b470cb63aeb None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:02.869691 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab1576-c728-46ef-b922-0b470cb63aeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:02.870183 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab1576-c728-46ef-b922-0b470cb63aeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:02.871815 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab1576-c728-46ef-b922-0b470cb63aeb None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:02.884894 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 490/971] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:02.891733 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f4759-c419-4d42-8711-c2d5ff0b4778 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:02.972413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:02.999238 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f4759-c419-4d42-8711-c2d5ff0b4778 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:03.033244 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8db661-bc9b-46fb-911e-80c44d286cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:03.033941 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8db661-bc9b-46fb-911e-80c44d286cfe None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:03.034234 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8db661-bc9b-46fb-911e-80c44d286cfe None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:03.034548 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8db661-bc9b-46fb-911e-80c44d286cfe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:03.042682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8db661-bc9b-46fb-911e-80c44d286cfe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:03.044164 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8db661-bc9b-46fb-911e-80c44d286cfe None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:03.056347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-5e8db661-bc9b-46fb-911e-80c44d286cfe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 22:37:03.056347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:03.056347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:03.056347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:03.056347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:03.056347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:03.056347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:03.056347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:03.056347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:03.056347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:03.056347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:03.056347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:03.056347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:37:03.056347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:37:03.056347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:37:03.056347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:37:03.057369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:03.057369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:03.057369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:37:03.057369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:37:03.057369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:37:03.057369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:37:03.057369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:03.057369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:03.057369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:03.057369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:03.057369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:03.057369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:03.057369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:03.057369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:03.057369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:03.057369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:03.057369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:03.057369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:03.058367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:03.058367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:03.058367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:37:03.058367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:37:03.058367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:37:03.058367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:37:03.058367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:37:03.058367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:37:03.058367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 22:37:03.058367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:03.062386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 482/972] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jul 27 22:37:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:03.063582 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab1576-c728-46ef-b922-0b470cb63aeb None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:03.098766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:03.168930 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab1576-c728-46ef-b922-0b470cb63aeb None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:03.205611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c933a5-cc7b-410a-ab6a-c0f79a7f5b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:03.206554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c933a5-cc7b-410a-ab6a-c0f79a7f5b54 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:03.206988 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c933a5-cc7b-410a-ab6a-c0f79a7f5b54 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:03.207417 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c933a5-cc7b-410a-ab6a-c0f79a7f5b54 None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:03.208486 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c933a5-cc7b-410a-ab6a-c0f79a7f5b54 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:03.208965 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c933a5-cc7b-410a-ab6a-c0f79a7f5b54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:03.211092 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c933a5-cc7b-410a-ab6a-c0f79a7f5b54 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:03.229924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 491/973] 10.222.0.48 () {56 vars in 1149 bytes} [Wed Jul 27 22:37:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:03.235563 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8db661-bc9b-46fb-911e-80c44d286cfe None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:03.339825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8db661-bc9b-46fb-911e-80c44d286cfe None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:03.372881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fd97c-b7c6-4290-8c6c-3aa6991f874d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:03.373494 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fd97c-b7c6-4290-8c6c-3aa6991f874d None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:03.373776 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fd97c-b7c6-4290-8c6c-3aa6991f874d None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:03.374054 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382fd97c-b7c6-4290-8c6c-3aa6991f874d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:03.376598 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:03.440546 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fd97c-b7c6-4290-8c6c-3aa6991f874d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:03.441966 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382fd97c-b7c6-4290-8c6c-3aa6991f874d None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:03.538215 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 483/974] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:37:03 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 22:37:03.543455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c933a5-cc7b-410a-ab6a-c0f79a7f5b54 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:03.642403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:03.652745 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c933a5-cc7b-410a-ab6a-c0f79a7f5b54 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:03.686681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a7fd1-acdc-4178-9c78-1ea05aa564dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:03.687325 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a7fd1-acdc-4178-9c78-1ea05aa564dd None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:03.687605 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a7fd1-acdc-4178-9c78-1ea05aa564dd None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:03.687875 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a7fd1-acdc-4178-9c78-1ea05aa564dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:03.702461 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a7fd1-acdc-4178-9c78-1ea05aa564dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:03.702461 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a7fd1-acdc-4178-9c78-1ea05aa564dd None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:03.716971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-728a7fd1-acdc-4178-9c78-1ea05aa564dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:37:03.716971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:03.716971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:03.716971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:03.716971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:03.716971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:03.716971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:03.716971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:03.716971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:03.716971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:03.716971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:03.716971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:03.716971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:37:03.716971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:37:03.716971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:37:03.718663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:37:03.718663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:03.718663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:03.718663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:03.718663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:03.718663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:03.718663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:03.718663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:03.718663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:03.718663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:03.718663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:03.718663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:03.718663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:03.718663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:03.718663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:03.718663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:03.718663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:03.719628 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:37:03.719628 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:37:03.719628 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:37:03.719628 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:03.720255 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 492/975] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:03.723734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fd97c-b7c6-4290-8c6c-3aa6991f874d None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:03.758694 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:03.825899 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382fd97c-b7c6-4290-8c6c-3aa6991f874d None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:03.858847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4f5b0-b206-4e58-a0cd-fc4782b37e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:03.859467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4f5b0-b206-4e58-a0cd-fc4782b37e10 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:03.859755 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4f5b0-b206-4e58-a0cd-fc4782b37e10 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:03.860037 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4f5b0-b206-4e58-a0cd-fc4782b37e10 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:03.860784 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4f5b0-b206-4e58-a0cd-fc4782b37e10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:03.861118 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4f5b0-b206-4e58-a0cd-fc4782b37e10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:03.862570 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4f5b0-b206-4e58-a0cd-fc4782b37e10 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:03.878738 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 484/976] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:03.880168 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a7fd1-acdc-4178-9c78-1ea05aa564dd None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:03.982028 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a7fd1-acdc-4178-9c78-1ea05aa564dd None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:04.014948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c22a01-68c6-4c67-abcc-1a18500998eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:04.015590 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22a01-68c6-4c67-abcc-1a18500998eb None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:04.015871 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22a01-68c6-4c67-abcc-1a18500998eb None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:04.016146 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c22a01-68c6-4c67-abcc-1a18500998eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:04.022997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c22a01-68c6-4c67-abcc-1a18500998eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:04.024426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c22a01-68c6-4c67-abcc-1a18500998eb None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:04.035584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-58c22a01-68c6-4c67-abcc-1a18500998eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:37:04.035584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:04.035584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:04.035584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:04.035584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:04.035584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:04.035584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:04.035584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:04.035584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:04.035584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:04.035584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:04.035584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:04.035584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:37:04.035584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:37:04.035584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:37:04.036513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:37:04.036513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:04.036513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:04.036513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:04.036513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:04.036513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:04.036513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:04.036513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:04.036513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:04.036513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:04.036513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:04.036513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:04.036513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:04.036513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:04.036513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:04.036513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:04.036513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:04.037431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:37:04.037431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:37:04.037431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:37:04.037431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:37:04.037431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:37:04.037431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:37:04.037431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:37:04.037431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:04.039012 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 493/977] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:37:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:37:04.043082 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4f5b0-b206-4e58-a0cd-fc4782b37e10 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:04.139876 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:04.147318 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4f5b0-b206-4e58-a0cd-fc4782b37e10 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:04.181485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78779554-33ec-4ef4-9cec-b0815f4177ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:04.182108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78779554-33ec-4ef4-9cec-b0815f4177ed None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:04.182424 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78779554-33ec-4ef4-9cec-b0815f4177ed None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:04.182796 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78779554-33ec-4ef4-9cec-b0815f4177ed None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:04.183557 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78779554-33ec-4ef4-9cec-b0815f4177ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:04.184015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78779554-33ec-4ef4-9cec-b0815f4177ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:04.185448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78779554-33ec-4ef4-9cec-b0815f4177ed None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:04.202892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 485/978] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:37:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:04.204508 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c22a01-68c6-4c67-abcc-1a18500998eb None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:04.209215 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:04.308599 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c22a01-68c6-4c67-abcc-1a18500998eb None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:04.343092 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b287c-9bef-40e5-a204-eb09b428f79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:04.343710 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b287c-9bef-40e5-a204-eb09b428f79d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:04.343994 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b287c-9bef-40e5-a204-eb09b428f79d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:04.344273 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b287c-9bef-40e5-a204-eb09b428f79d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:04.345061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b287c-9bef-40e5-a204-eb09b428f79d None admin] RBAC: Adding query filter params (role.id=5b5390395eb544b8bf3d5d39591c987d, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=db10ad54ec9948a3bb8b04c708fc4ca7) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:04.345376 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b287c-9bef-40e5-a204-eb09b428f79d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:04.346840 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b287c-9bef-40e5-a204-eb09b428f79d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:04.353361 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 494/979] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:37:04 2022] GET /identity/v3/role_assignments?user.id=db10ad54ec9948a3bb8b04c708fc4ca7&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=5b5390395eb544b8bf3d5d39591c987d => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:04.522400 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855e03d-fcfe-4cba-8b34-97499a84145f None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:04.522400 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855e03d-fcfe-4cba-8b34-97499a84145f None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:04.523500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b855e03d-fcfe-4cba-8b34-97499a84145f None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:04.524747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 486/980] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:04.530147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c4707-049f-4229-8b80-11e67bc16452 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:04.530545 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c4707-049f-4229-8b80-11e67bc16452 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:04.530828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c4707-049f-4229-8b80-11e67bc16452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:04.550402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-1d2c4707-049f-4229-8b80-11e67bc16452 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:04.551665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-1d2c4707-049f-4229-8b80-11e67bc16452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:04.616860 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea0f1f-c27f-4e1a-896f-60938eb26574 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:04.617386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea0f1f-c27f-4e1a-896f-60938eb26574 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:04.617667 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ea0f1f-c27f-4e1a-896f-60938eb26574 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:04.619299 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 487/981] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:37:04.620233 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:04.624658 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eeb4d-8818-4442-b856-c5d65c345277 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:04.625019 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eeb4d-8818-4442-b856-c5d65c345277 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:04.625302 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eeb4d-8818-4442-b856-c5d65c345277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:04.628688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 495/982] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:04.646069 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-8e4eeb4d-8818-4442-b856-c5d65c345277 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:04.647923 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8e4eeb4d-8818-4442-b856-c5d65c345277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:04.650847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c4707-049f-4229-8b80-11e67bc16452 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:04.722679 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 488/983] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:37:04.743245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4eeb4d-8818-4442-b856-c5d65c345277 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:04.762774 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c4707-049f-4229-8b80-11e67bc16452 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:04.798513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc6d4c-d4e1-4e07-b748-6785fd1687f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:04.799464 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc6d4c-d4e1-4e07-b748-6785fd1687f4 None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:04.799967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc6d4c-d4e1-4e07-b748-6785fd1687f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:04.800310 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc6d4c-d4e1-4e07-b748-6785fd1687f4 None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:04.800999 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc6d4c-d4e1-4e07-b748-6785fd1687f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:04.802382 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbc6d4c-d4e1-4e07-b748-6785fd1687f4 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:04.817838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 496/984] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 22:37:04 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:37:04.851404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:04.871061 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4eeb4d-8818-4442-b856-c5d65c345277 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:04.916549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340b8a3-9b42-4dc2-a9f4-38a7a0408e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:04.917216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340b8a3-9b42-4dc2-a9f4-38a7a0408e50 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:04.917502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340b8a3-9b42-4dc2-a9f4-38a7a0408e50 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:04.917778 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340b8a3-9b42-4dc2-a9f4-38a7a0408e50 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:04.918445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340b8a3-9b42-4dc2-a9f4-38a7a0408e50 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:04.919839 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340b8a3-9b42-4dc2-a9f4-38a7a0408e50 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:04.929601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-c340b8a3-9b42-4dc2-a9f4-38a7a0408e50 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 22:37:04.929601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:04.929601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:37:04.929601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:37:04.929601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:37:04.929601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:37:04.929601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:37:04.929601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:37:04.929601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 22:37:04.929601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:04.929601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:37:04.929601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:04.929601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:04.929601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:04.929601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:04.929601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:04.929601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:04.930722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:04.930722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:04.930722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:04.930722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:04.930722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:04.930722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:04.930722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:37:04.930722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:37:04.930722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:37:04.930722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:37:04.930722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:04.930722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:04.930722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:04.930722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:04.930722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:04.930722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:04.936788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:04.936788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:04.936788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:04.936788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:04.936788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:04.936788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:04.936788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:04.936788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:04.936788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:04.936788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:04.936788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:37:04.936788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:37:04.936788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 22:37:04.936788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:04.936788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 489/985] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 22:37:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:37:04.939263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc6d4c-d4e1-4e07-b748-6785fd1687f4 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:05.004217 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:05.049929 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc6d4c-d4e1-4e07-b748-6785fd1687f4 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:05.083444 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc9fe5-1e7a-42a3-894f-1c500be5a24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:05.084073 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc9fe5-1e7a-42a3-894f-1c500be5a24a None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:05.084414 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc9fe5-1e7a-42a3-894f-1c500be5a24a None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:05.084699 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc9fe5-1e7a-42a3-894f-1c500be5a24a None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:05.085974 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc9fe5-1e7a-42a3-894f-1c500be5a24a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:05.086289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc9fe5-1e7a-42a3-894f-1c500be5a24a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:05.087677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bc9fe5-1e7a-42a3-894f-1c500be5a24a None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:05.097015 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 497/986] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jul 27 22:37:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:05.098651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340b8a3-9b42-4dc2-a9f4-38a7a0408e50 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:05.197991 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340b8a3-9b42-4dc2-a9f4-38a7a0408e50 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:05.231346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd0eb2-213b-4bd4-84b8-90a73004eeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:05.231967 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0eb2-213b-4bd4-84b8-90a73004eeeb None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:05.232256 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0eb2-213b-4bd4-84b8-90a73004eeeb None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:05.232538 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd0eb2-213b-4bd4-84b8-90a73004eeeb None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:05.233217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd0eb2-213b-4bd4-84b8-90a73004eeeb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:05.233553 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd0eb2-213b-4bd4-84b8-90a73004eeeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:05.235005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dd0eb2-213b-4bd4-84b8-90a73004eeeb None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:05.239941 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 490/987] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jul 27 22:37:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:05.246084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc9fe5-1e7a-42a3-894f-1c500be5a24a None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:05.350434 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bc9fe5-1e7a-42a3-894f-1c500be5a24a None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:05.372693 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:05.385111 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6db248-56e1-4901-950e-cd463b02c4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:05.385733 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6db248-56e1-4901-950e-cd463b02c4e3 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:05.386030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6db248-56e1-4901-950e-cd463b02c4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:05.386301 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6db248-56e1-4901-950e-cd463b02c4e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:05.388029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6db248-56e1-4901-950e-cd463b02c4e3 None admin] RBAC: Adding query filter params (interface=admin, service_id=359f04c24e494e599ab1ebe2dd3678b5, region_id=RegionOne) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:05.388345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6db248-56e1-4901-950e-cd463b02c4e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:05.389706 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6db248-56e1-4901-950e-cd463b02c4e3 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:05.399734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 498/988] 10.222.0.48 () {56 vars in 1249 bytes} [Wed Jul 27 22:37:05 2022] GET /identity/v3/endpoints?service_id=359f04c24e494e599ab1ebe2dd3678b5&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:05.401195 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd0eb2-213b-4bd4-84b8-90a73004eeeb None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:05.412568 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:05.506330 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dd0eb2-213b-4bd4-84b8-90a73004eeeb None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:05.541974 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84db31d-12b0-48c7-8022-0dfdf8333fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:05.542635 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84db31d-12b0-48c7-8022-0dfdf8333fbd None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:05.542924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84db31d-12b0-48c7-8022-0dfdf8333fbd None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:05.543202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84db31d-12b0-48c7-8022-0dfdf8333fbd None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:05.543866 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84db31d-12b0-48c7-8022-0dfdf8333fbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:05.545243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84db31d-12b0-48c7-8022-0dfdf8333fbd None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:05.558396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 491/989] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jul 27 22:37:05 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:37:06.372925 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc3541-66e0-420f-9b92-d261f5777783 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:06.373477 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc3541-66e0-420f-9b92-d261f5777783 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:06.373477 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc3541-66e0-420f-9b92-d261f5777783 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:06.374906 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 499/990] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:06.379843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b463fc1-a5ef-4d43-97a5-3447c12e8ef7 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:06.380231 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b463fc1-a5ef-4d43-97a5-3447c12e8ef7 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:06.380399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b463fc1-a5ef-4d43-97a5-3447c12e8ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:06.399423 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-3b463fc1-a5ef-4d43-97a5-3447c12e8ef7 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:06.400619 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-3b463fc1-a5ef-4d43-97a5-3447c12e8ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:06.468085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 492/991] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:06.489275 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc3541-66e0-420f-9b92-d261f5777783 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:06.595805 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc3541-66e0-420f-9b92-d261f5777783 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:06.637868 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3fbf6-74d7-46e4-8a73-b6acadb69197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:06.638549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3fbf6-74d7-46e4-8a73-b6acadb69197 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:06.638837 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3fbf6-74d7-46e4-8a73-b6acadb69197 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:06.639113 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3fbf6-74d7-46e4-8a73-b6acadb69197 None admin] PATH_INFO: `/v3/services/image` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:06.639740 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3fbf6-74d7-46e4-8a73-b6acadb69197 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:06.641105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3fbf6-74d7-46e4-8a73-b6acadb69197 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:06.650187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-13a3fbf6-74d7-46e4-8a73-b6acadb69197 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 22:37:06.650187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:06.650187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:37:06.650187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:37:06.650187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:37:06.650187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:37:06.650187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:37:06.650187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:37:06.650187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 22:37:06.650187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:06.650187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:37:06.650187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:06.650187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:06.650187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:06.650187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:06.650187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:06.650187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:06.651485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:06.651485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:06.651485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:06.651485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:06.651485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:06.651485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:06.651485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:37:06.651485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:37:06.651485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:37:06.651485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:37:06.651485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:06.651485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:06.651485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:06.651485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:06.651485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:06.651485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:06.652421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:06.652421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:06.652421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:06.652421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:06.652421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:06.652421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:06.652421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:06.652421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:06.652421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:06.652421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:06.652421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:37:06.652421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:37:06.652421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 22:37:06.652421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:06.653882 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 500/992] 10.222.0.48 () {56 vars in 1105 bytes} [Wed Jul 27 22:37:06 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:06.657699 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b463fc1-a5ef-4d43-97a5-3447c12e8ef7 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:06.659964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:06.761336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b463fc1-a5ef-4d43-97a5-3447c12e8ef7 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:06.794276 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3aaf8-53f8-49a1-9592-3dfa2da358b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:06.794928 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3aaf8-53f8-49a1-9592-3dfa2da358b7 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:06.795213 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3aaf8-53f8-49a1-9592-3dfa2da358b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:06.795490 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3aaf8-53f8-49a1-9592-3dfa2da358b7 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:06.796164 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3aaf8-53f8-49a1-9592-3dfa2da358b7 None admin] RBAC: Adding query filter params (name=image) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:06.796473 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3aaf8-53f8-49a1-9592-3dfa2da358b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:06.797832 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3aaf8-53f8-49a1-9592-3dfa2da358b7 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:06.807870 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 493/993] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:37:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:06.809138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3fbf6-74d7-46e4-8a73-b6acadb69197 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:06.847063 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf473e-8231-4963-a862-f237a10426aa None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:06.847375 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf473e-8231-4963-a862-f237a10426aa None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:06.847640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf473e-8231-4963-a862-f237a10426aa None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:06.849131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 494/994] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:37:06.853783 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c3c95-4922-4a6b-a3e0-22b97c39221c None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:06.854073 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c3c95-4922-4a6b-a3e0-22b97c39221c None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:06.854381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c3c95-4922-4a6b-a3e0-22b97c39221c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:06.862488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:06.873189 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-357c3c95-4922-4a6b-a3e0-22b97c39221c None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:06.874394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-357c3c95-4922-4a6b-a3e0-22b97c39221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:06.919463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3fbf6-74d7-46e4-8a73-b6acadb69197 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:06.945146 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:06.954431 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 495/995] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:37:06.960631 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f93a17-54af-4e0c-91f8-34bc5c8f08dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:06.961284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f93a17-54af-4e0c-91f8-34bc5c8f08dd None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:06.961573 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f93a17-54af-4e0c-91f8-34bc5c8f08dd None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:06.961854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f93a17-54af-4e0c-91f8-34bc5c8f08dd None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:06.962560 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f93a17-54af-4e0c-91f8-34bc5c8f08dd None admin] RBAC: Adding query filter params (type=image) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:06.962869 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f93a17-54af-4e0c-91f8-34bc5c8f08dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:06.964243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f93a17-54af-4e0c-91f8-34bc5c8f08dd None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:06.970386 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 501/996] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:37:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:06.977469 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c3c95-4922-4a6b-a3e0-22b97c39221c None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:07.086501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c3c95-4922-4a6b-a3e0-22b97c39221c None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:07.127080 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643a526-317c-4d1f-94ed-10822e6e3106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:07.127732 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643a526-317c-4d1f-94ed-10822e6e3106 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:07.128017 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643a526-317c-4d1f-94ed-10822e6e3106 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:07.128294 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643a526-317c-4d1f-94ed-10822e6e3106 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:07.128927 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643a526-317c-4d1f-94ed-10822e6e3106 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:07.130293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643a526-317c-4d1f-94ed-10822e6e3106 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:07.139413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-3643a526-317c-4d1f-94ed-10822e6e3106 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 22:37:07.139413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:07.139413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:37:07.139413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:37:07.139413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:37:07.139413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:37:07.139413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:37:07.139413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:37:07.139413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 22:37:07.139413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:07.139413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:37:07.139413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:07.139413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:07.139413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:07.139413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:07.139413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:07.139413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:07.140615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:07.140615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:07.140615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:07.140615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:07.140615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:07.140615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:07.140615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:37:07.140615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:37:07.140615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:37:07.140615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:37:07.140615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:07.140615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:07.140615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:07.140615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:07.140615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:07.140615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:07.141825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:07.141825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:07.141825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:07.141825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:07.141825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:07.141825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:07.141825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:07.141825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:07.141825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:07.141825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:07.141825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:37:07.141825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:37:07.141825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 22:37:07.141825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:07.141825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 496/997] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:37:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:07.146621 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f93a17-54af-4e0c-91f8-34bc5c8f08dd None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:07.249951 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f93a17-54af-4e0c-91f8-34bc5c8f08dd None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:07.264588 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:07.285823 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f14657-feff-40be-b732-c4d1f899807e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:07.286476 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f14657-feff-40be-b732-c4d1f899807e None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:07.286763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f14657-feff-40be-b732-c4d1f899807e None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:07.287042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f14657-feff-40be-b732-c4d1f899807e None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:07.287716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f14657-feff-40be-b732-c4d1f899807e None admin] RBAC: Adding query filter params (name=compute) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:07.288052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f14657-feff-40be-b732-c4d1f899807e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:07.289411 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f14657-feff-40be-b732-c4d1f899807e None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:07.294288 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 502/998] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 22:37:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:07.299976 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643a526-317c-4d1f-94ed-10822e6e3106 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:07.363131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:07.407718 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643a526-317c-4d1f-94ed-10822e6e3106 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:07.442654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658500b-e3fe-4490-a0f7-298a1f4283fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:07.443280 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658500b-e3fe-4490-a0f7-298a1f4283fd None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:07.443561 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658500b-e3fe-4490-a0f7-298a1f4283fd None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:07.443837 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658500b-e3fe-4490-a0f7-298a1f4283fd None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:07.445140 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658500b-e3fe-4490-a0f7-298a1f4283fd None admin] RBAC: Adding query filter params (type=compute) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:07.445443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658500b-e3fe-4490-a0f7-298a1f4283fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:07.446831 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658500b-e3fe-4490-a0f7-298a1f4283fd None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:07.456680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 497/999] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 22:37:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:07.457664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f14657-feff-40be-b732-c4d1f899807e None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:07.561724 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f14657-feff-40be-b732-c4d1f899807e None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:07.577334 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f6855-6542-41a0-a7ec-1fd7cbf77d9d None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:07.577620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f6855-6542-41a0-a7ec-1fd7cbf77d9d None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:07.577901 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f6855-6542-41a0-a7ec-1fd7cbf77d9d None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:07.579272 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 498/1000] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:07.584240 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b6ac3-117f-4d54-96d0-f45801562f0a None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:07.584534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b6ac3-117f-4d54-96d0-f45801562f0a None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:07.584849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b6ac3-117f-4d54-96d0-f45801562f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:07.602535 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccac627-acfb-4b48-a98f-b8f3e10f92fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:07.603008 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-e23b6ac3-117f-4d54-96d0-f45801562f0a None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:07.603561 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccac627-acfb-4b48-a98f-b8f3e10f92fe None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:07.603845 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccac627-acfb-4b48-a98f-b8f3e10f92fe None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:07.604119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccac627-acfb-4b48-a98f-b8f3e10f92fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:07.604213 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e23b6ac3-117f-4d54-96d0-f45801562f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:07.604878 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccac627-acfb-4b48-a98f-b8f3e10f92fe None admin] RBAC: Adding query filter params (interface=public, service_id=80e91e635178427d9b7e8b224a707a26, region_id=RegionOne) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:07.605190 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccac627-acfb-4b48-a98f-b8f3e10f92fe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:07.606794 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccac627-acfb-4b48-a98f-b8f3e10f92fe None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:07.618095 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 503/1001] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jul 27 22:37:07 2022] GET /identity/v3/endpoints?service_id=80e91e635178427d9b7e8b224a707a26&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:07.619314 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccac627-acfb-4b48-a98f-b8f3e10f92fe None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:07.663852 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:07.675138 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 499/1002] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:37:07.698232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b6ac3-117f-4d54-96d0-f45801562f0a None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:07.724055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccac627-acfb-4b48-a98f-b8f3e10f92fe None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:07.754854 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:07.763187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba72ec6-acec-4f65-8ead-6db4ddbdfb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:07.763807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba72ec6-acec-4f65-8ead-6db4ddbdfb51 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:07.764116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba72ec6-acec-4f65-8ead-6db4ddbdfb51 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:07.764378 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba72ec6-acec-4f65-8ead-6db4ddbdfb51 None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:07.764994 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba72ec6-acec-4f65-8ead-6db4ddbdfb51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:07.766359 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba72ec6-acec-4f65-8ead-6db4ddbdfb51 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:07.778836 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 504/1003] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jul 27 22:37:07 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:37:07.805247 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b6ac3-117f-4d54-96d0-f45801562f0a None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:07.843273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4bd71-d314-462d-8b15-350ea113f47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:07.843845 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4bd71-d314-462d-8b15-350ea113f47b None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:07.844129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4bd71-d314-462d-8b15-350ea113f47b None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:07.844407 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4bd71-d314-462d-8b15-350ea113f47b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:07.845044 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4bd71-d314-462d-8b15-350ea113f47b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:07.846465 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4bd71-d314-462d-8b15-350ea113f47b None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:07.856843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-4ad4bd71-d314-462d-8b15-350ea113f47b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 22:37:07.856843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:07.856843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:37:07.856843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:37:07.856843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:37:07.856843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:37:07.856843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:37:07.856843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:37:07.856843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 22:37:07.856843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:07.856843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:37:07.856843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:07.856843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:07.856843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:07.856843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:07.856843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:07.856843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:07.857951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:07.857951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:07.857951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:07.857951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:07.857951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:07.857951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:07.857951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:37:07.857951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:37:07.857951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:37:07.857951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:37:07.857951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:07.857951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:07.857951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:07.857951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:07.857951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:07.857951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:07.864446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:07.864446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:07.864446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:07.864446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:07.864446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:07.864446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:07.864446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:07.864446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:07.864446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:07.864446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:07.864446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:37:07.864446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:37:07.864446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 22:37:07.864446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:07.864446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 500/1004] 10.222.0.48 () {56 vars in 1126 bytes} [Wed Jul 27 22:37:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:37:07.865274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba72ec6-acec-4f65-8ead-6db4ddbdfb51 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:07.971309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba72ec6-acec-4f65-8ead-6db4ddbdfb51 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:07.979993 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:08.008469 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5a9c6-81be-450f-ba5b-4f9605135087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:08.009153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5a9c6-81be-450f-ba5b-4f9605135087 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:08.009440 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5a9c6-81be-450f-ba5b-4f9605135087 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:08.009757 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5a9c6-81be-450f-ba5b-4f9605135087 None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:08.010460 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5a9c6-81be-450f-ba5b-4f9605135087 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:08.010772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5a9c6-81be-450f-ba5b-4f9605135087 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:08.012134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5a9c6-81be-450f-ba5b-4f9605135087 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:08.017281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 505/1005] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jul 27 22:37:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:08.023064 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4bd71-d314-462d-8b15-350ea113f47b None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:08.129236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4bd71-d314-462d-8b15-350ea113f47b None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:08.146608 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:08.165478 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270dd784-2320-4cff-8cb7-7a467ec84e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:08.166130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd784-2320-4cff-8cb7-7a467ec84e48 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:08.166439 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd784-2320-4cff-8cb7-7a467ec84e48 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:08.166722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270dd784-2320-4cff-8cb7-7a467ec84e48 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:08.167398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dd784-2320-4cff-8cb7-7a467ec84e48 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:08.167707 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dd784-2320-4cff-8cb7-7a467ec84e48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:08.169071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270dd784-2320-4cff-8cb7-7a467ec84e48 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:08.178893 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 501/1006] 10.222.0.48 () {56 vars in 1122 bytes} [Wed Jul 27 22:37:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:08.180109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5a9c6-81be-450f-ba5b-4f9605135087 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:08.281470 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5a9c6-81be-450f-ba5b-4f9605135087 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:08.314723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d65c4b-1d5d-443b-817a-f65ed9a64dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:08.315342 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d65c4b-1d5d-443b-817a-f65ed9a64dc5 None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:08.315631 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d65c4b-1d5d-443b-817a-f65ed9a64dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:08.315907 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d65c4b-1d5d-443b-817a-f65ed9a64dc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:08.316613 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d65c4b-1d5d-443b-817a-f65ed9a64dc5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:08.317974 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d65c4b-1d5d-443b-817a-f65ed9a64dc5 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:08.342379 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 506/1007] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:37:08 2022] POST /identity/v3/endpoints => generated 325 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:37:08.989987 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19457133-ef32-4d20-8110-6f91133e2091 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:08.990572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19457133-ef32-4d20-8110-6f91133e2091 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:08.990572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19457133-ef32-4d20-8110-6f91133e2091 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:08.992581 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 502/1008] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:08.997818 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c183b1-0298-4a18-bea6-b1f644059f12 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:08.998233 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c183b1-0298-4a18-bea6-b1f644059f12 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:08.998426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c183b1-0298-4a18-bea6-b1f644059f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:09.016739 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-39c183b1-0298-4a18-bea6-b1f644059f12 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:09.017912 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-39c183b1-0298-4a18-bea6-b1f644059f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:09.041422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:09.093059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 507/1009] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:08 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:09.114843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19457133-ef32-4d20-8110-6f91133e2091 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:09.216230 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19457133-ef32-4d20-8110-6f91133e2091 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:09.249449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56160520-a90c-4a24-9b33-2bae0b00edce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:09.249998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56160520-a90c-4a24-9b33-2bae0b00edce None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:09.250284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56160520-a90c-4a24-9b33-2bae0b00edce None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:09.250590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56160520-a90c-4a24-9b33-2bae0b00edce None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:09.251272 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56160520-a90c-4a24-9b33-2bae0b00edce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:09.252621 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56160520-a90c-4a24-9b33-2bae0b00edce None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:09.269739 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 503/1010] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 22:37:09 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:37:09.771268 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881d3a0-5ffe-449b-9c6d-6aaa17e1b77e None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:09.771671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881d3a0-5ffe-449b-9c6d-6aaa17e1b77e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:09.771867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881d3a0-5ffe-449b-9c6d-6aaa17e1b77e None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:09.773222 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 508/1011] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:09.783014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d714ba-9411-4939-836f-7414db267c9c None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:09.783308 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d714ba-9411-4939-836f-7414db267c9c None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:09.783585 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d714ba-9411-4939-836f-7414db267c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:09.801889 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-d9d714ba-9411-4939-836f-7414db267c9c None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:09.803165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d9d714ba-9411-4939-836f-7414db267c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:09.838465 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:09.882593 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 504/1012] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:09 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:09.900822 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881d3a0-5ffe-449b-9c6d-6aaa17e1b77e None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:10.005172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881d3a0-5ffe-449b-9c6d-6aaa17e1b77e None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:10.039066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32711bc8-3afc-4ef6-831a-743bd38438cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:10.039714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32711bc8-3afc-4ef6-831a-743bd38438cb None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:10.039997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32711bc8-3afc-4ef6-831a-743bd38438cb None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:10.040271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32711bc8-3afc-4ef6-831a-743bd38438cb None admin] PATH_INFO: `/v3/services/compute` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:10.040897 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32711bc8-3afc-4ef6-831a-743bd38438cb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:10.042262 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32711bc8-3afc-4ef6-831a-743bd38438cb None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:10.051179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-32711bc8-3afc-4ef6-831a-743bd38438cb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 22:37:10.051179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:10.051179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:37:10.051179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:37:10.051179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:37:10.051179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:37:10.051179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:37:10.051179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:37:10.051179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 22:37:10.051179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:10.051179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:37:10.051179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:10.051179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:10.051179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:10.051179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:10.051179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:10.051179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:10.052165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:10.052165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:10.052165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:10.052165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:10.052165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:10.052165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:10.052165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:37:10.052165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:37:10.052165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:37:10.052165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:37:10.052165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:10.052165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:10.052165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:10.052165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:10.052165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:10.052165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:10.053022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:10.053022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:10.053022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:10.053022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:10.053022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:10.053022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:10.053022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:10.053022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:10.053022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:10.053022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:10.053022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:37:10.053022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:37:10.053022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 22:37:10.053022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:10.053022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 509/1013] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:37:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:10.060805 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d714ba-9411-4939-836f-7414db267c9c None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:10.159065 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d714ba-9411-4939-836f-7414db267c9c None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:10.192343 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4a2f67-d22d-4bcd-8d8f-f33f470669d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:10.192961 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a2f67-d22d-4bcd-8d8f-f33f470669d7 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:10.193239 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a2f67-d22d-4bcd-8d8f-f33f470669d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:10.193511 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4a2f67-d22d-4bcd-8d8f-f33f470669d7 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:10.194724 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a2f67-d22d-4bcd-8d8f-f33f470669d7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:10.195034 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a2f67-d22d-4bcd-8d8f-f33f470669d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:10.196380 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4a2f67-d22d-4bcd-8d8f-f33f470669d7 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:10.206216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 505/1014] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 22:37:10 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:10.207345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32711bc8-3afc-4ef6-831a-743bd38438cb None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:10.231666 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:10.310759 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32711bc8-3afc-4ef6-831a-743bd38438cb None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:10.346375 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50378a-0a58-4c01-b515-3b476c65d682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:10.346997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50378a-0a58-4c01-b515-3b476c65d682 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:10.347281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50378a-0a58-4c01-b515-3b476c65d682 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:10.347556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50378a-0a58-4c01-b515-3b476c65d682 None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:10.348233 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50378a-0a58-4c01-b515-3b476c65d682 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:10.348540 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50378a-0a58-4c01-b515-3b476c65d682 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:10.349956 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50378a-0a58-4c01-b515-3b476c65d682 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:10.354732 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc8e46-fb21-452f-9fa1-6823212112f2 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:10.355019 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc8e46-fb21-452f-9fa1-6823212112f2 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:10.355295 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fc8e46-fb21-452f-9fa1-6823212112f2 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:10.356749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 506/1015] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:37:10.357626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 510/1016] 10.222.0.48 () {56 vars in 1112 bytes} [Wed Jul 27 22:37:10 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:10.361966 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b0c48-8ada-4fcf-9b2c-714e331c1c2f None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:10.362264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b0c48-8ada-4fcf-9b2c-714e331c1c2f None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:10.362607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b0c48-8ada-4fcf-9b2c-714e331c1c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:10.363184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50378a-0a58-4c01-b515-3b476c65d682 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:10.383958 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-854b0c48-8ada-4fcf-9b2c-714e331c1c2f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:10.385195 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-854b0c48-8ada-4fcf-9b2c-714e331c1c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:10.414827 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:10.457196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:10.459509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 507/1017] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:10 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:37:10.475453 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50378a-0a58-4c01-b515-3b476c65d682 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:10.482362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b0c48-8ada-4fcf-9b2c-714e331c1c2f None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:10.512792 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d9eba-d03d-43c2-b320-9495630928cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:10.513375 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d9eba-d03d-43c2-b320-9495630928cd None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:10.513663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d9eba-d03d-43c2-b320-9495630928cd None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:10.514114 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931d9eba-d03d-43c2-b320-9495630928cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:10.514729 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d9eba-d03d-43c2-b320-9495630928cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:10.516042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931d9eba-d03d-43c2-b320-9495630928cd None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:10.538805 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 511/1018] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:37:10 2022] POST /identity/v3/endpoints => generated 334 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:37:10.598892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b0c48-8ada-4fcf-9b2c-714e331c1c2f None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:10.644688 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9a1f80-c30d-42e7-9428-579ae3cf983c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:10.645358 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a1f80-c30d-42e7-9428-579ae3cf983c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:10.645642 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a1f80-c30d-42e7-9428-579ae3cf983c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:10.645922 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9a1f80-c30d-42e7-9428-579ae3cf983c None admin] PATH_INFO: `/v3/domains/default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:10.647138 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a1f80-c30d-42e7-9428-579ae3cf983c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:10.648639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9a1f80-c30d-42e7-9428-579ae3cf983c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:10.650481 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 508/1019] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:37:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:10.656489 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d9eba-d03d-43c2-b320-9495630928cd None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:10.768740 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931d9eba-d03d-43c2-b320-9495630928cd None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:10.803387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee50d8e-263c-4cc7-8e9c-ec495a54115e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:10.804645 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee50d8e-263c-4cc7-8e9c-ec495a54115e None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:10.804932 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee50d8e-263c-4cc7-8e9c-ec495a54115e None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:10.805217 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee50d8e-263c-4cc7-8e9c-ec495a54115e None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:10.805902 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee50d8e-263c-4cc7-8e9c-ec495a54115e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:10.807409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee50d8e-263c-4cc7-8e9c-ec495a54115e None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:10.819566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:10.837846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 512/1020] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 22:37:10 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:37:11.288982 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cf63e-a717-4573-a096-f720b9b25367 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:11.289501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cf63e-a717-4573-a096-f720b9b25367 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:11.289501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cf63e-a717-4573-a096-f720b9b25367 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:11.291034 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 509/1021] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:11.295907 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871ba24-2d07-4182-a303-09459559a438 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:11.296288 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871ba24-2d07-4182-a303-09459559a438 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:11.296451 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871ba24-2d07-4182-a303-09459559a438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:11.313995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-4871ba24-2d07-4182-a303-09459559a438 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:11.315190 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-4871ba24-2d07-4182-a303-09459559a438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:11.386847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 513/1022] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:37:11.409234 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cf63e-a717-4573-a096-f720b9b25367 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:11.437676 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:11.512931 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cf63e-a717-4573-a096-f720b9b25367 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:11.546552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778149c8-84fb-4372-9b21-00ad236f7b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:11.547122 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778149c8-84fb-4372-9b21-00ad236f7b29 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:11.547406 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778149c8-84fb-4372-9b21-00ad236f7b29 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:11.547684 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778149c8-84fb-4372-9b21-00ad236f7b29 None admin] PATH_INFO: `/v3/services/image` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:11.548309 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778149c8-84fb-4372-9b21-00ad236f7b29 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:11.549670 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778149c8-84fb-4372-9b21-00ad236f7b29 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:11.558713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-778149c8-84fb-4372-9b21-00ad236f7b29 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 22:37:11.558713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:11.558713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:37:11.558713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:37:11.558713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:37:11.558713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:37:11.558713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:37:11.558713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:37:11.558713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 22:37:11.558713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:11.558713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:37:11.558713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:11.558713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:11.558713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:11.558713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:11.558713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:11.558713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:11.559697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:11.559697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:11.559697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:11.559697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:11.559697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:11.559697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:11.559697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:37:11.559697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:37:11.559697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:37:11.559697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:37:11.559697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:11.559697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:11.559697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:11.559697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:11.559697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:11.559697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:11.560564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:11.560564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:11.560564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:11.560564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:11.560564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:11.560564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:11.560564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:11.560564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:11.560564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:11.560564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:11.560564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:37:11.560564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:37:11.560564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 22:37:11.560564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:11.562493 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 510/1023] 10.222.0.48 () {56 vars in 1105 bytes} [Wed Jul 27 22:37:11 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:11.566061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871ba24-2d07-4182-a303-09459559a438 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:11.677145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871ba24-2d07-4182-a303-09459559a438 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:11.704248 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:11.719698 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d899448-113f-4ffe-8bc8-dd71f1e8ba6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:11.720325 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d899448-113f-4ffe-8bc8-dd71f1e8ba6d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:11.720610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d899448-113f-4ffe-8bc8-dd71f1e8ba6d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:11.721031 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d899448-113f-4ffe-8bc8-dd71f1e8ba6d None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:11.721718 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d899448-113f-4ffe-8bc8-dd71f1e8ba6d None admin] RBAC: Adding query filter params (name=image) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:11.722027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d899448-113f-4ffe-8bc8-dd71f1e8ba6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:11.723865 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d899448-113f-4ffe-8bc8-dd71f1e8ba6d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:11.729361 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 514/1024] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:37:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:11.736448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778149c8-84fb-4372-9b21-00ad236f7b29 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:11.829027 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:11.840499 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778149c8-84fb-4372-9b21-00ad236f7b29 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:11.874080 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7906e-0517-4088-bb89-98dfa7a7c51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:11.874747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7906e-0517-4088-bb89-98dfa7a7c51d None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:11.875033 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7906e-0517-4088-bb89-98dfa7a7c51d None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:11.875314 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7906e-0517-4088-bb89-98dfa7a7c51d None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:11.875986 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7906e-0517-4088-bb89-98dfa7a7c51d None admin] RBAC: Adding query filter params (type=image) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:11.876292 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7906e-0517-4088-bb89-98dfa7a7c51d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:11.877643 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7906e-0517-4088-bb89-98dfa7a7c51d None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:11.887868 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 511/1025] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:37:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:11.889041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d899448-113f-4ffe-8bc8-dd71f1e8ba6d None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:11.995005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d899448-113f-4ffe-8bc8-dd71f1e8ba6d None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:12.029217 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc775a35-0dc1-40bf-814e-d751e32dd440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:12.029832 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc775a35-0dc1-40bf-814e-d751e32dd440 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:12.030115 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc775a35-0dc1-40bf-814e-d751e32dd440 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:12.030415 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc775a35-0dc1-40bf-814e-d751e32dd440 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:12.031167 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc775a35-0dc1-40bf-814e-d751e32dd440 None admin] RBAC: Adding query filter params (interface=public, service_id=e2fc2e24c9c84d878df7009573a0d624, region_id=RegionOne) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:12.031478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc775a35-0dc1-40bf-814e-d751e32dd440 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:12.032846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc775a35-0dc1-40bf-814e-d751e32dd440 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:12.042640 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 515/1026] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jul 27 22:37:11 2022] GET /identity/v3/endpoints?service_id=e2fc2e24c9c84d878df7009573a0d624&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:12.043603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7906e-0517-4088-bb89-98dfa7a7c51d None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:12.142732 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7906e-0517-4088-bb89-98dfa7a7c51d None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:12.174911 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ad852-dd3d-4b96-9f4c-b6bc411fe305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:12.175527 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ad852-dd3d-4b96-9f4c-b6bc411fe305 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:12.175811 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ad852-dd3d-4b96-9f4c-b6bc411fe305 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:12.176089 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ad852-dd3d-4b96-9f4c-b6bc411fe305 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:12.176739 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ad852-dd3d-4b96-9f4c-b6bc411fe305 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:12.178151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9ad852-dd3d-4b96-9f4c-b6bc411fe305 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:12.194726 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 512/1027] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jul 27 22:37:12 2022] GET /identity/v3/services => generated 1957 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:37:12.684679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d7d06-3ee6-4e75-8dd5-2b7d0698d205 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:12.685184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d7d06-3ee6-4e75-8dd5-2b7d0698d205 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:12.685312 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d7d06-3ee6-4e75-8dd5-2b7d0698d205 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:12.686788 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 516/1028] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:12.691813 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf45d8-8019-4773-af71-7c51e0af3112 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:12.692190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf45d8-8019-4773-af71-7c51e0af3112 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:12.692365 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf45d8-8019-4773-af71-7c51e0af3112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:12.711105 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-cadf45d8-8019-4773-af71-7c51e0af3112 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:12.712299 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-cadf45d8-8019-4773-af71-7c51e0af3112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:12.726382 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:12.785640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 513/1029] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:12.808557 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d7d06-3ee6-4e75-8dd5-2b7d0698d205 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:12.865806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0bb37-4835-4de0-be62-01e4d5ff56cc None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:12.866154 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0bb37-4835-4de0-be62-01e4d5ff56cc None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:12.866380 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0bb37-4835-4de0-be62-01e4d5ff56cc None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:12.870508 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 514/1030] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:37:12.872871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaac61-0ff3-4376-a2c6-f61da9af8aa9 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:12.873348 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaac61-0ff3-4376-a2c6-f61da9af8aa9 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:12.873808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaac61-0ff3-4376-a2c6-f61da9af8aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:12.875041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:12.893216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-9eaaac61-0ff3-4376-a2c6-f61da9af8aa9 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:12.894443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-9eaaac61-0ff3-4376-a2c6-f61da9af8aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:12.927990 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d7d06-3ee6-4e75-8dd5-2b7d0698d205 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:12.962435 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71daee7f-ffdd-43d2-a167-238290202973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:12.963079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daee7f-ffdd-43d2-a167-238290202973 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:12.963365 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daee7f-ffdd-43d2-a167-238290202973 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:12.963642 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71daee7f-ffdd-43d2-a167-238290202973 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:12.966377 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 515/1031] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:37:12.975009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71daee7f-ffdd-43d2-a167-238290202973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:37:12.980563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-71daee7f-ffdd-43d2-a167-238290202973 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 22:37:12.980563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:12.980563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:12.980563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:12.980563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:12.980563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:12.980563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:12.980563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:12.980563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:12.980563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:12.980563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:12.980563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:12.980563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:37:12.980563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:37:12.980563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:37:12.980563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:37:12.981511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:37:12.981511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:37:12.981511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:37:12.981511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:37:12.981511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:12.981511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:12.981511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:12.981511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:12.981511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:12.981511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:12.981511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:12.981511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:12.981511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:12.981511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:12.981511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:12.981511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:12.982416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:12.982416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:12.982416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:12.982416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:12.982416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:37:12.982416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:37:12.982416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:37:12.982416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:37:12.982416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:37:12.982416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:37:12.982416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 22:37:12.982416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:12.982416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 517/1032] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Jul 27 22:37:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:12.987820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaac61-0ff3-4376-a2c6-f61da9af8aa9 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:12.989445 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71daee7f-ffdd-43d2-a167-238290202973 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:13.071530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:13.094617 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71daee7f-ffdd-43d2-a167-238290202973 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:13.095176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaac61-0ff3-4376-a2c6-f61da9af8aa9 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:13.105904 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:13.130266 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35422c-34b7-47bb-b950-88fcaf497327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:13.130893 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35422c-34b7-47bb-b950-88fcaf497327 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:13.131182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35422c-34b7-47bb-b950-88fcaf497327 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:13.131421 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ced32-3ea6-4e91-bac8-f4dbcb4c6127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:13.132042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35422c-34b7-47bb-b950-88fcaf497327 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:13.132554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ced32-3ea6-4e91-bac8-f4dbcb4c6127 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:13.132840 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ced32-3ea6-4e91-bac8-f4dbcb4c6127 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:13.133098 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35422c-34b7-47bb-b950-88fcaf497327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:13.133205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ced32-3ea6-4e91-bac8-f4dbcb4c6127 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:13.133822 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ced32-3ea6-4e91-bac8-f4dbcb4c6127 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:13.134133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ced32-3ea6-4e91-bac8-f4dbcb4c6127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:13.134565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35422c-34b7-47bb-b950-88fcaf497327 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:13.135514 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ced32-3ea6-4e91-bac8-f4dbcb4c6127 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:13.136322 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 518/1033] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:37:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:13.142013 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35422c-34b7-47bb-b950-88fcaf497327 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:13.149410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 516/1034] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jul 27 22:37:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:13.150092 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ced32-3ea6-4e91-bac8-f4dbcb4c6127 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:13.255812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ced32-3ea6-4e91-bac8-f4dbcb4c6127 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:13.256428 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35422c-34b7-47bb-b950-88fcaf497327 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:13.293087 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476702d7-3c07-45ef-b0da-7892495f8450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:13.293742 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476702d7-3c07-45ef-b0da-7892495f8450 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:13.294029 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476702d7-3c07-45ef-b0da-7892495f8450 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:13.294131 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08de24e-f46b-43ec-a90e-1eafbd88e93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:13.294376 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476702d7-3c07-45ef-b0da-7892495f8450 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:13.294688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08de24e-f46b-43ec-a90e-1eafbd88e93a None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:13.294975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08de24e-f46b-43ec-a90e-1eafbd88e93a None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:13.295252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08de24e-f46b-43ec-a90e-1eafbd88e93a None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:13.295936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08de24e-f46b-43ec-a90e-1eafbd88e93a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:13.297378 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08de24e-f46b-43ec-a90e-1eafbd88e93a None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:13.304210 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:13.307097 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476702d7-3c07-45ef-b0da-7892495f8450 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:13.308832 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476702d7-3c07-45ef-b0da-7892495f8450 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:13.320928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 519/1035] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 22:37:13 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:37:13.335388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-476702d7-3c07-45ef-b0da-7892495f8450 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:37:13.335388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:13.335388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:13.335388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:13.335388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:13.335388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:13.335388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:13.335388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:13.335388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:13.335388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:13.335388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:13.335388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:13.335388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:37:13.335388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:37:13.335388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:37:13.336393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:37:13.336393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:13.336393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:13.336393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:13.336393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:13.336393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:13.336393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:13.336393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:13.336393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:13.336393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:13.336393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:13.336393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:13.336393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:13.336393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:13.336393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:13.336393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:13.336393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:13.337308 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:37:13.337308 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:37:13.337308 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:37:13.337308 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:13.341622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 517/1036] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:37:13.343009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08de24e-f46b-43ec-a90e-1eafbd88e93a None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:13.387156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:13.461043 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08de24e-f46b-43ec-a90e-1eafbd88e93a None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:13.497196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1d7bf-713a-4b72-9cb3-ebddf1676226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:13.497838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1d7bf-713a-4b72-9cb3-ebddf1676226 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:13.498122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1d7bf-713a-4b72-9cb3-ebddf1676226 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:13.498439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a1d7bf-713a-4b72-9cb3-ebddf1676226 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:13.499136 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1d7bf-713a-4b72-9cb3-ebddf1676226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:13.499465 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1d7bf-713a-4b72-9cb3-ebddf1676226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:13.500846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a1d7bf-713a-4b72-9cb3-ebddf1676226 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:13.513490 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 520/1037] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:13.519069 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476702d7-3c07-45ef-b0da-7892495f8450 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:13.626264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476702d7-3c07-45ef-b0da-7892495f8450 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:13.660249 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce6b77-dbf8-48c8-8b4b-8ea5a49abaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:13.660823 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce6b77-dbf8-48c8-8b4b-8ea5a49abaee None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:13.661112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce6b77-dbf8-48c8-8b4b-8ea5a49abaee None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:13.661391 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ce6b77-dbf8-48c8-8b4b-8ea5a49abaee None admin] PATH_INFO: `/v3/users/nova` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:13.668938 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce6b77-dbf8-48c8-8b4b-8ea5a49abaee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:13.670408 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ce6b77-dbf8-48c8-8b4b-8ea5a49abaee None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:13.682535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-89ce6b77-dbf8-48c8-8b4b-8ea5a49abaee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 22:37:13.682535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:13.682535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:13.682535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:13.682535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:13.682535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:13.682535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:13.682535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:13.682535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:13.682535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:13.682535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:13.682535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:13.682535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:37:13.682535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:37:13.682535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:37:13.682535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:37:13.683526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:13.683526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:13.683526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:37:13.683526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:37:13.683526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:37:13.683526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:37:13.683526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:13.683526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:13.683526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:13.683526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:13.683526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:13.683526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:13.683526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:13.683526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:13.683526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:13.683526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:13.683526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:13.683526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:13.684498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:13.684498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:13.684498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:37:13.684498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:37:13.684498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:37:13.684498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:37:13.684498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:37:13.684498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:37:13.684498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 22:37:13.684498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:13.684498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 518/1038] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jul 27 22:37:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:37:13.689356 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1d7bf-713a-4b72-9cb3-ebddf1676226 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:13.783530 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:13.792187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a1d7bf-713a-4b72-9cb3-ebddf1676226 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:13.826908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e3fcb-3609-4f0c-847a-9cf8d8bcd231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:13.827617 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e3fcb-3609-4f0c-847a-9cf8d8bcd231 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:13.827986 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e3fcb-3609-4f0c-847a-9cf8d8bcd231 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:13.828320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e3fcb-3609-4f0c-847a-9cf8d8bcd231 None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:13.829176 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e3fcb-3609-4f0c-847a-9cf8d8bcd231 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:13.829550 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e3fcb-3609-4f0c-847a-9cf8d8bcd231 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:13.831123 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e3fcb-3609-4f0c-847a-9cf8d8bcd231 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:13.848377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 521/1039] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jul 27 22:37:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:13.854332 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce6b77-dbf8-48c8-8b4b-8ea5a49abaee None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:13.906513 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:13.955610 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ce6b77-dbf8-48c8-8b4b-8ea5a49abaee None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:13.988154 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677becf6-3e5e-44ae-91c9-ba9f0b941f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:13.988771 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677becf6-3e5e-44ae-91c9-ba9f0b941f60 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:13.989050 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677becf6-3e5e-44ae-91c9-ba9f0b941f60 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:13.989323 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677becf6-3e5e-44ae-91c9-ba9f0b941f60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:14.055879 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677becf6-3e5e-44ae-91c9-ba9f0b941f60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:14.057314 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677becf6-3e5e-44ae-91c9-ba9f0b941f60 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:14.107831 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:14.160334 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 519/1040] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:37:13 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 22:37:14.162024 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e3fcb-3609-4f0c-847a-9cf8d8bcd231 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:14.192489 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db13d38-9051-4bcc-985c-07d64a2cdbfc None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:14.192866 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db13d38-9051-4bcc-985c-07d64a2cdbfc None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:14.193307 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db13d38-9051-4bcc-985c-07d64a2cdbfc None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:14.194774 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 520/1041] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:14.199536 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048519b-c4e1-4b1f-b82d-6b378e979439 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:14.199821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048519b-c4e1-4b1f-b82d-6b378e979439 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:14.200098 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5048519b-c4e1-4b1f-b82d-6b378e979439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:14.218614 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-5048519b-c4e1-4b1f-b82d-6b378e979439 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:14.219730 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-5048519b-c4e1-4b1f-b82d-6b378e979439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:14.267010 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e3fcb-3609-4f0c-847a-9cf8d8bcd231 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:14.286550 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 521/1042] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:37:14.302299 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510a55f-6390-486d-a15f-44662ff7d598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:14.303201 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510a55f-6390-486d-a15f-44662ff7d598 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:14.303696 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510a55f-6390-486d-a15f-44662ff7d598 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:14.304157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510a55f-6390-486d-a15f-44662ff7d598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:14.308683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048519b-c4e1-4b1f-b82d-6b378e979439 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:14.315528 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510a55f-6390-486d-a15f-44662ff7d598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:14.317198 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510a55f-6390-486d-a15f-44662ff7d598 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:14.332695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-4510a55f-6390-486d-a15f-44662ff7d598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:37:14.332695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:14.332695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:14.332695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:14.332695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:14.332695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:14.332695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:14.332695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:14.332695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:14.332695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:14.332695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:14.332695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:14.332695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:37:14.332695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:37:14.332695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:37:14.333619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:37:14.333619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:14.333619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:14.333619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:14.333619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:14.333619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:14.333619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:14.333619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:14.333619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:14.333619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:14.333619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:14.333619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:14.333619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:14.333619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:14.333619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:14.333619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:14.333619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:14.335182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:37:14.335182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:37:14.335182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:37:14.335182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:14.336742 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 522/1043] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:37:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:37:14.342090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510a55f-6390-486d-a15f-44662ff7d598 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:14.346023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:14.395130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:14.420023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5048519b-c4e1-4b1f-b82d-6b378e979439 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:14.447623 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510a55f-6390-486d-a15f-44662ff7d598 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:14.456530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983bd3b-165e-4e1e-be04-a636efe5f956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:14.457185 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983bd3b-165e-4e1e-be04-a636efe5f956 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:14.457474 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983bd3b-165e-4e1e-be04-a636efe5f956 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:14.457749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983bd3b-165e-4e1e-be04-a636efe5f956 None admin] PATH_INFO: `/v3/services/image` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:14.458528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983bd3b-165e-4e1e-be04-a636efe5f956 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:14.460418 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983bd3b-165e-4e1e-be04-a636efe5f956 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:14.470112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-0983bd3b-165e-4e1e-be04-a636efe5f956 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 22:37:14.470112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:14.470112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:37:14.470112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:37:14.470112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:37:14.470112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:37:14.470112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:37:14.470112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:37:14.470112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 22:37:14.470112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:14.470112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:37:14.470112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:14.470112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:14.470112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:14.470112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:14.470112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:14.470112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:14.471296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:14.471296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:14.471296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:14.471296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:14.471296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:14.471296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:14.471296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:37:14.471296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:37:14.471296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:37:14.471296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:37:14.471296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:14.471296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:14.471296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:14.471296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:14.471296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:14.471296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:14.472174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:14.472174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:14.472174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:14.472174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:14.472174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:14.472174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:14.472174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:14.472174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:14.472174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:14.472174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:14.472174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:37:14.472174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:37:14.472174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 22:37:14.472174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:14.472174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 522/1044] 10.222.0.48 () {56 vars in 1105 bytes} [Wed Jul 27 22:37:14 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:37:14.478146 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983bd3b-165e-4e1e-be04-a636efe5f956 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:14.485940 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f81aa-b032-430e-976c-d7645f179c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:14.486599 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f81aa-b032-430e-976c-d7645f179c3f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:14.486888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f81aa-b032-430e-976c-d7645f179c3f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:14.487166 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f81aa-b032-430e-976c-d7645f179c3f None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:14.487876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f81aa-b032-430e-976c-d7645f179c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:14.488191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f81aa-b032-430e-976c-d7645f179c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:14.489606 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f81aa-b032-430e-976c-d7645f179c3f None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:14.502544 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 523/1045] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:14.508831 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f81aa-b032-430e-976c-d7645f179c3f None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:14.571398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:14.588329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983bd3b-165e-4e1e-be04-a636efe5f956 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:14.616632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f81aa-b032-430e-976c-d7645f179c3f None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:14.624564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c6d91-fe7e-4252-bcb9-7ee4b78796ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:14.625187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c6d91-fe7e-4252-bcb9-7ee4b78796ab None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:14.625472 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c6d91-fe7e-4252-bcb9-7ee4b78796ab None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:14.625751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c6d91-fe7e-4252-bcb9-7ee4b78796ab None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:14.626457 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c6d91-fe7e-4252-bcb9-7ee4b78796ab None admin] RBAC: Adding query filter params (name=image) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:14.626767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c6d91-fe7e-4252-bcb9-7ee4b78796ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:14.628135 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c6d91-fe7e-4252-bcb9-7ee4b78796ab None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:14.633669 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 523/1046] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:37:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:14.638985 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c6d91-fe7e-4252-bcb9-7ee4b78796ab None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:14.652362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:14.654561 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55165f-6790-48f3-8cf9-bba859fc5a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:14.655206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55165f-6790-48f3-8cf9-bba859fc5a9d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:14.655497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55165f-6790-48f3-8cf9-bba859fc5a9d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:14.655786 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55165f-6790-48f3-8cf9-bba859fc5a9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:14.662618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55165f-6790-48f3-8cf9-bba859fc5a9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:14.664079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b55165f-6790-48f3-8cf9-bba859fc5a9d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:14.677286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-1b55165f-6790-48f3-8cf9-bba859fc5a9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:37:14.677286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:14.677286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:14.677286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:14.677286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:14.677286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:14.677286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:14.677286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:14.677286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:14.677286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:14.677286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:14.677286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:14.677286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:37:14.677286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:37:14.677286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:37:14.678224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:37:14.678224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:14.678224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:14.678224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:14.678224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:14.678224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:14.678224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:14.678224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:14.678224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:14.678224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:14.678224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:14.678224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:14.678224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:14.678224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:14.678224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:14.678224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:14.678224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:14.684348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:37:14.684348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:37:14.684348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:37:14.684348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:37:14.684348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:37:14.684348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:37:14.684348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:37:14.684348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:14.684348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 524/1047] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:37:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:37:14.684348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55165f-6790-48f3-8cf9-bba859fc5a9d None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:14.747448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c6d91-fe7e-4252-bcb9-7ee4b78796ab None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:14.788408 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f59e59-ea32-4f6c-a375-d04cab16c430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:14.789032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f59e59-ea32-4f6c-a375-d04cab16c430 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:14.789320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f59e59-ea32-4f6c-a375-d04cab16c430 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:14.789601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f59e59-ea32-4f6c-a375-d04cab16c430 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:14.790283 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f59e59-ea32-4f6c-a375-d04cab16c430 None admin] RBAC: Adding query filter params (type=image) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:14.790727 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f59e59-ea32-4f6c-a375-d04cab16c430 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:14.790891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b55165f-6790-48f3-8cf9-bba859fc5a9d None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:14.792109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f59e59-ea32-4f6c-a375-d04cab16c430 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:14.797864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 524/1048] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:37:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:14.803383 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f59e59-ea32-4f6c-a375-d04cab16c430 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:14.817325 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:14.830196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc31fc-ba0f-4e47-8adc-cc03bf9bfe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:14.830862 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc31fc-ba0f-4e47-8adc-cc03bf9bfe3f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:14.831150 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc31fc-ba0f-4e47-8adc-cc03bf9bfe3f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:14.831432 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc31fc-ba0f-4e47-8adc-cc03bf9bfe3f None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:14.832186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc31fc-ba0f-4e47-8adc-cc03bf9bfe3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:14.832495 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc31fc-ba0f-4e47-8adc-cc03bf9bfe3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:14.833925 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc31fc-ba0f-4e47-8adc-cc03bf9bfe3f None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:14.846738 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 525/1049] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:37:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:14.852675 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc31fc-ba0f-4e47-8adc-cc03bf9bfe3f None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:14.888313 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:14.915679 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f59e59-ea32-4f6c-a375-d04cab16c430 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:14.953086 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf2a089-0c20-42bf-94af-408d3d1b6547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:14.953711 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2a089-0c20-42bf-94af-408d3d1b6547 None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:14.953998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2a089-0c20-42bf-94af-408d3d1b6547 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:14.954276 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf2a089-0c20-42bf-94af-408d3d1b6547 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:14.955025 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2a089-0c20-42bf-94af-408d3d1b6547 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:14.956379 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf2a089-0c20-42bf-94af-408d3d1b6547 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:14.957338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc31fc-ba0f-4e47-8adc-cc03bf9bfe3f None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:14.977028 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 525/1050] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:37:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:37:15.003506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4508bd3a-4746-4483-9858-618b8c07ed2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:15.004065 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508bd3a-4746-4483-9858-618b8c07ed2a None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:15.004354 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508bd3a-4746-4483-9858-618b8c07ed2a None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:15.004633 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4508bd3a-4746-4483-9858-618b8c07ed2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:15.005504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508bd3a-4746-4483-9858-618b8c07ed2a None admin] RBAC: Adding query filter params (role.id=5b5390395eb544b8bf3d5d39591c987d, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=c621601261e44ca8a7938862d6578639) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:15.005829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508bd3a-4746-4483-9858-618b8c07ed2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:15.008105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4508bd3a-4746-4483-9858-618b8c07ed2a None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:15.022423 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 526/1051] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:37:14 2022] GET /identity/v3/role_assignments?user.id=c621601261e44ca8a7938862d6578639&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=5b5390395eb544b8bf3d5d39591c987d => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:15.405389 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad653750-0723-4955-9589-e5be0c8146be None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:15.405789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad653750-0723-4955-9589-e5be0c8146be None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:15.405983 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad653750-0723-4955-9589-e5be0c8146be None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:15.407393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 526/1052] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:15.412432 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc1f05-4a55-4a5b-8494-35df099fbab0 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:15.413256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc1f05-4a55-4a5b-8494-35df099fbab0 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:15.413541 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc1f05-4a55-4a5b-8494-35df099fbab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:15.432060 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-6cbc1f05-4a55-4a5b-8494-35df099fbab0 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:15.433244 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-6cbc1f05-4a55-4a5b-8494-35df099fbab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:15.477527 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:15.506940 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 527/1053] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:15.529749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad653750-0723-4955-9589-e5be0c8146be None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:15.636897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad653750-0723-4955-9589-e5be0c8146be None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:15.666981 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:15.673190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0bfc9-675b-486f-87cb-fea5fba2a38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:15.673833 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0bfc9-675b-486f-87cb-fea5fba2a38e None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:15.674658 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0bfc9-675b-486f-87cb-fea5fba2a38e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:15.674900 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d0bfc9-675b-486f-87cb-fea5fba2a38e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:15.685811 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d0bfc9-675b-486f-87cb-fea5fba2a38e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:37:15.690980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-96d0bfc9-675b-486f-87cb-fea5fba2a38e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:37:15.690980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:15.690980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:15.690980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:15.690980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:15.690980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:15.690980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:15.690980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:15.690980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:15.690980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:15.690980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:15.690980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:15.690980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:37:15.690980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:37:15.690980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:37:15.690980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:37:15.692020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:37:15.692020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:37:15.692020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:37:15.692020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:37:15.692020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:15.692020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:15.692020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:15.692020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:15.692020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:15.692020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:15.692020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:15.692020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:15.692020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:15.692020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:15.692020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:15.692020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:15.692937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:15.692937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:15.692937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:15.692937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:15.692937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:37:15.692937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:37:15.692937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:37:15.692937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:37:15.692937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:37:15.692937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:37:15.692937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:37:15.692937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:15.694229 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 527/1054] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:37:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:15.698295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc1f05-4a55-4a5b-8494-35df099fbab0 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:15.799411 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc1f05-4a55-4a5b-8494-35df099fbab0 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:15.832213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6980f83-87d3-4631-ac90-aab92b696d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:15.832831 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6980f83-87d3-4631-ac90-aab92b696d91 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:15.833115 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6980f83-87d3-4631-ac90-aab92b696d91 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:15.833391 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6980f83-87d3-4631-ac90-aab92b696d91 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:15.834101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6980f83-87d3-4631-ac90-aab92b696d91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:15.834432 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6980f83-87d3-4631-ac90-aab92b696d91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:15.836296 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6980f83-87d3-4631-ac90-aab92b696d91 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:15.848592 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 528/1055] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:37:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:15.850902 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0bfc9-675b-486f-87cb-fea5fba2a38e None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:15.949249 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d0bfc9-675b-486f-87cb-fea5fba2a38e None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:15.983351 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc466520-f83d-4b72-84cc-ac70a9d871bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:15.983987 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc466520-f83d-4b72-84cc-ac70a9d871bb None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:15.984269 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc466520-f83d-4b72-84cc-ac70a9d871bb None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:15.984598 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc466520-f83d-4b72-84cc-ac70a9d871bb None admin] PATH_INFO: `/v3/users/04aefd2cdbae4dbda009b17407565e6b` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:15.997468 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc466520-f83d-4b72-84cc-ac70a9d871bb None admin] RBAC: Authorizing `identity:get_user(user_id=04aefd2cdbae4dbda009b17407565e6b)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:15.998917 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc466520-f83d-4b72-84cc-ac70a9d871bb None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:16.000791 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 528/1056] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:37:15 2022] GET /identity/v3/users/04aefd2cdbae4dbda009b17407565e6b => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:16.006261 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6980f83-87d3-4631-ac90-aab92b696d91 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:16.043674 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:16.112438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6980f83-87d3-4631-ac90-aab92b696d91 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:16.149093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fc609-e9e9-464a-b323-9b9edd8026ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:16.149717 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fc609-e9e9-464a-b323-9b9edd8026ba None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:16.150004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fc609-e9e9-464a-b323-9b9edd8026ba None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:16.150282 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57fc609-e9e9-464a-b323-9b9edd8026ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:16.217103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fc609-e9e9-464a-b323-9b9edd8026ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:16.218511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57fc609-e9e9-464a-b323-9b9edd8026ba None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:16.252818 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:16.327095 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 529/1057] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:37:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 22:37:16.332716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc466520-f83d-4b72-84cc-ac70a9d871bb None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:16.384225 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:16.436729 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc466520-f83d-4b72-84cc-ac70a9d871bb None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:16.471629 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b54b11b-60a6-4947-91a0-caf570bdf847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:16.472233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54b11b-60a6-4947-91a0-caf570bdf847 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:16.472520 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54b11b-60a6-4947-91a0-caf570bdf847 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:16.472803 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b54b11b-60a6-4947-91a0-caf570bdf847 None admin] PATH_INFO: `/v3/projects/b7a93858f72d4ed79c9adc4d7920cce1` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:16.473969 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54b11b-60a6-4947-91a0-caf570bdf847 None admin] RBAC: Authorizing `identity:get_project(project_id=b7a93858f72d4ed79c9adc4d7920cce1)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:16.475468 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b54b11b-60a6-4947-91a0-caf570bdf847 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:16.477278 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 529/1058] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:37:16 2022] GET /identity/v3/projects/b7a93858f72d4ed79c9adc4d7920cce1 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:16.483163 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fc609-e9e9-464a-b323-9b9edd8026ba None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:16.592362 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57fc609-e9e9-464a-b323-9b9edd8026ba None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:16.636203 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8bce1b-2b14-43ba-8f7e-b463f56f367d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:16.636837 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bce1b-2b14-43ba-8f7e-b463f56f367d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:16.637120 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bce1b-2b14-43ba-8f7e-b463f56f367d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:16.637406 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8bce1b-2b14-43ba-8f7e-b463f56f367d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:16.638204 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8bce1b-2b14-43ba-8f7e-b463f56f367d None admin] RBAC: Adding query filter params (role.id=49e0ba8d8c9f4824892b61f05d0036e8, scope.project.id=b7a93858f72d4ed79c9adc4d7920cce1, user.id=04aefd2cdbae4dbda009b17407565e6b) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:16.638554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8bce1b-2b14-43ba-8f7e-b463f56f367d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:16.640000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8bce1b-2b14-43ba-8f7e-b463f56f367d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:16.643649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:16.654869 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 530/1059] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:37:16 2022] GET /identity/v3/role_assignments?user.id=04aefd2cdbae4dbda009b17407565e6b&scope.project.id=b7a93858f72d4ed79c9adc4d7920cce1&role.id=49e0ba8d8c9f4824892b61f05d0036e8 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:17.015815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a777ce-642b-4960-90c7-bf673c746868 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:17.016333 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a777ce-642b-4960-90c7-bf673c746868 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:17.016410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a777ce-642b-4960-90c7-bf673c746868 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:17.017850 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 530/1060] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:17.023005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4699028-cef5-4eca-8ca3-68c62f05d288 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:17.023380 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4699028-cef5-4eca-8ca3-68c62f05d288 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:17.023571 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4699028-cef5-4eca-8ca3-68c62f05d288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:17.042116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-e4699028-cef5-4eca-8ca3-68c62f05d288 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:17.043331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e4699028-cef5-4eca-8ca3-68c62f05d288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:17.060015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29554684-473d-4601-aee5-fef3918a24c7 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:17.060300 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29554684-473d-4601-aee5-fef3918a24c7 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:17.060579 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29554684-473d-4601-aee5-fef3918a24c7 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:17.062202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 531/1061] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:37:17.066996 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437593f4-c20c-49e9-8cbc-cb2513738308 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:17.067515 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437593f4-c20c-49e9-8cbc-cb2513738308 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:17.067994 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437593f4-c20c-49e9-8cbc-cb2513738308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:17.087002 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-437593f4-c20c-49e9-8cbc-cb2513738308 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:17.088460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-437593f4-c20c-49e9-8cbc-cb2513738308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:17.118019 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 531/1062] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:17.139429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4699028-cef5-4eca-8ca3-68c62f05d288 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:17.159225 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 532/1063] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:37:17.181167 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437593f4-c20c-49e9-8cbc-cb2513738308 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:17.232127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:17.248424 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4699028-cef5-4eca-8ca3-68c62f05d288 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:17.282774 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:17.292452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e93008-d0b2-4ff2-b087-aec6a625ebe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:17.295048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e93008-d0b2-4ff2-b087-aec6a625ebe3 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:17.295048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e93008-d0b2-4ff2-b087-aec6a625ebe3 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:17.295048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e93008-d0b2-4ff2-b087-aec6a625ebe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:17.307778 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437593f4-c20c-49e9-8cbc-cb2513738308 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:17.345734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8d96b-9d04-414b-aaf3-b90cbb20aabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:17.346411 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8d96b-9d04-414b-aaf3-b90cbb20aabd None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:17.346690 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8d96b-9d04-414b-aaf3-b90cbb20aabd None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:17.346975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8d96b-9d04-414b-aaf3-b90cbb20aabd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:17.357605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8d96b-9d04-414b-aaf3-b90cbb20aabd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:37:17.362549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-46e8d96b-9d04-414b-aaf3-b90cbb20aabd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 22:37:17.362549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:17.362549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:17.362549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:17.362549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:17.362549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:17.362549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:17.362549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:17.362549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:17.362549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:17.362549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:17.362549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:17.362549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:37:17.362549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:37:17.362549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:37:17.362549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:37:17.363483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:37:17.363483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:37:17.363483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:37:17.363483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:37:17.363483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:17.363483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:17.363483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:17.363483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:17.363483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:17.363483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:17.363483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:17.363483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:17.363483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:17.363483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:17.363483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:17.363483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:17.364596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:17.364596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:17.364596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:17.364596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:17.364596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:37:17.364596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:37:17.364596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:37:17.364596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:37:17.364596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:37:17.364596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:37:17.364596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 22:37:17.364596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:17.364596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 533/1064] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Jul 27 22:37:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:37:17.369532 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8d96b-9d04-414b-aaf3-b90cbb20aabd None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:17.377835 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e93008-d0b2-4ff2-b087-aec6a625ebe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:17.379571 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e93008-d0b2-4ff2-b087-aec6a625ebe3 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:17.466469 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8d96b-9d04-414b-aaf3-b90cbb20aabd None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:17.473637 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:17.486125 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 532/1065] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:37:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 22:37:17.492030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e93008-d0b2-4ff2-b087-aec6a625ebe3 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:17.509647 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dfa6e-49b5-4046-92b7-cc87d100018a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:17.510324 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dfa6e-49b5-4046-92b7-cc87d100018a None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:17.510640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dfa6e-49b5-4046-92b7-cc87d100018a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:17.510949 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dfa6e-49b5-4046-92b7-cc87d100018a None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:17.511666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dfa6e-49b5-4046-92b7-cc87d100018a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:17.511977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dfa6e-49b5-4046-92b7-cc87d100018a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:17.513342 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dfa6e-49b5-4046-92b7-cc87d100018a None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:17.521831 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 534/1066] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jul 27 22:37:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:17.523610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:17.528393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dfa6e-49b5-4046-92b7-cc87d100018a None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:17.605863 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e93008-d0b2-4ff2-b087-aec6a625ebe3 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:17.647810 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dfa6e-49b5-4046-92b7-cc87d100018a None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:17.654170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d219a95-66b0-4a34-82f0-b9ab29562fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:17.654847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d219a95-66b0-4a34-82f0-b9ab29562fb3 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:17.655131 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d219a95-66b0-4a34-82f0-b9ab29562fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:17.655407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d219a95-66b0-4a34-82f0-b9ab29562fb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:17.667274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d219a95-66b0-4a34-82f0-b9ab29562fb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:17.668716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d219a95-66b0-4a34-82f0-b9ab29562fb3 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:17.684105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-3d219a95-66b0-4a34-82f0-b9ab29562fb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:37:17.684105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:17.684105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:17.684105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:17.684105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:17.684105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:17.684105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:17.684105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:17.684105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:17.684105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:17.684105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:17.684105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:17.684105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:37:17.684105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:37:17.684105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:37:17.685223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:37:17.685223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:17.685223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:17.685223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:17.685223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:17.685223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:17.685223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:17.685223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:17.685223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:17.685223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:17.685223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:17.685223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:17.685223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:17.685223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:17.685223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:17.685223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:17.685223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:17.686334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:37:17.686334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:37:17.686334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:37:17.686334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:17.686334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 533/1067] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:37:17.688840 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a5c98-824b-4ab6-a567-35638ae8aec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:17.689695 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a5c98-824b-4ab6-a567-35638ae8aec2 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:17.690123 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a5c98-824b-4ab6-a567-35638ae8aec2 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:17.690809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a5c98-824b-4ab6-a567-35638ae8aec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:17.691315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d219a95-66b0-4a34-82f0-b9ab29562fb3 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:17.703565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a5c98-824b-4ab6-a567-35638ae8aec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:17.705273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a5c98-824b-4ab6-a567-35638ae8aec2 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:17.722794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-296a5c98-824b-4ab6-a567-35638ae8aec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:37:17.722794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:17.722794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:17.722794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:17.722794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:17.722794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:17.722794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:17.722794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:17.722794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:17.722794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:17.722794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:17.722794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:17.722794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:37:17.722794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:37:17.722794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:37:17.723890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:37:17.723890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:17.723890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:17.723890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:17.723890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:17.723890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:17.723890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:17.723890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:17.723890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:17.723890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:17.723890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:17.723890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:17.723890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:17.723890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:17.723890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:17.723890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:17.723890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:17.725020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:37:17.725020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:37:17.725020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:37:17.725020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:17.726804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 535/1068] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:37:17.732230 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a5c98-824b-4ab6-a567-35638ae8aec2 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:17.756145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:17.782382 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:17.800919 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d219a95-66b0-4a34-82f0-b9ab29562fb3 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:17.836135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657aef91-f61f-48d8-913e-fef59b4f03ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:17.836755 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657aef91-f61f-48d8-913e-fef59b4f03ad None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:17.837041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657aef91-f61f-48d8-913e-fef59b4f03ad None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:17.837343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657aef91-f61f-48d8-913e-fef59b4f03ad None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:17.838011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657aef91-f61f-48d8-913e-fef59b4f03ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:17.838318 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657aef91-f61f-48d8-913e-fef59b4f03ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:17.839759 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657aef91-f61f-48d8-913e-fef59b4f03ad None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:17.843607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a5c98-824b-4ab6-a567-35638ae8aec2 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:17.851477 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 534/1069] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:17.879735 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40eafa-1fb7-4ad1-a3df-2c9f87dcd030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:17.880304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40eafa-1fb7-4ad1-a3df-2c9f87dcd030 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:17.880586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40eafa-1fb7-4ad1-a3df-2c9f87dcd030 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:17.880860 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40eafa-1fb7-4ad1-a3df-2c9f87dcd030 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:17.882127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40eafa-1fb7-4ad1-a3df-2c9f87dcd030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:17.882470 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40eafa-1fb7-4ad1-a3df-2c9f87dcd030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:17.883943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d40eafa-1fb7-4ad1-a3df-2c9f87dcd030 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:17.901914 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 536/1070] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:17.903175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657aef91-f61f-48d8-913e-fef59b4f03ad None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:18.012597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657aef91-f61f-48d8-913e-fef59b4f03ad None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:18.050268 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adbd3c-f316-4f39-8fe3-80cd0adbbc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:18.051086 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adbd3c-f316-4f39-8fe3-80cd0adbbc52 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:18.051371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adbd3c-f316-4f39-8fe3-80cd0adbbc52 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:18.051650 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adbd3c-f316-4f39-8fe3-80cd0adbbc52 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:18.059362 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adbd3c-f316-4f39-8fe3-80cd0adbbc52 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:18.060797 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adbd3c-f316-4f39-8fe3-80cd0adbbc52 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:18.074854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-48adbd3c-f316-4f39-8fe3-80cd0adbbc52 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 22:37:18.074854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:18.074854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:18.074854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:18.074854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:18.074854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:18.074854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:18.074854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:18.074854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:18.074854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:18.074854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:18.074854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:18.074854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:37:18.074854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:37:18.074854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:37:18.074854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:37:18.075846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:18.075846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:18.075846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:37:18.075846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:37:18.075846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:37:18.075846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:37:18.075846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:18.075846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:18.075846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:18.075846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:18.075846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:18.075846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:18.075846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:18.075846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:18.075846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:18.075846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:18.075846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:18.075846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:18.077104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:18.077104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:18.077104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:37:18.077104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:37:18.077104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:37:18.077104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:37:18.077104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:37:18.077104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:37:18.077104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 22:37:18.077104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:18.077104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 535/1071] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jul 27 22:37:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:18.082316 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40eafa-1fb7-4ad1-a3df-2c9f87dcd030 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:18.164841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:18.184047 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d40eafa-1fb7-4ad1-a3df-2c9f87dcd030 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:18.217216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cf46a-9791-43f0-97a6-510e58c7ec87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:18.217828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cf46a-9791-43f0-97a6-510e58c7ec87 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:18.218111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cf46a-9791-43f0-97a6-510e58c7ec87 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:18.218438 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cf46a-9791-43f0-97a6-510e58c7ec87 None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:18.219235 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cf46a-9791-43f0-97a6-510e58c7ec87 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:18.219542 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cf46a-9791-43f0-97a6-510e58c7ec87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:18.220961 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cf46a-9791-43f0-97a6-510e58c7ec87 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:18.237930 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 537/1072] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jul 27 22:37:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:18.244161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adbd3c-f316-4f39-8fe3-80cd0adbbc52 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:18.247064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:18.354134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adbd3c-f316-4f39-8fe3-80cd0adbbc52 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:18.386713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1265c6a-4e9a-486d-b492-651365e5959b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:18.387348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1265c6a-4e9a-486d-b492-651365e5959b None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:18.387633 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1265c6a-4e9a-486d-b492-651365e5959b None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:18.387910 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1265c6a-4e9a-486d-b492-651365e5959b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:18.398097 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1265c6a-4e9a-486d-b492-651365e5959b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:18.399560 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1265c6a-4e9a-486d-b492-651365e5959b None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:18.413781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-c1265c6a-4e9a-486d-b492-651365e5959b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:37:18.413781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:18.413781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:18.413781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:18.413781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:18.413781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:18.413781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:18.413781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:18.413781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:18.413781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:18.413781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:18.413781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:18.413781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:37:18.413781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:37:18.413781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:37:18.414903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:37:18.414903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:18.414903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:18.414903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:18.414903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:18.414903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:18.414903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:18.414903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:18.414903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:18.414903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:18.414903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:18.414903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:18.414903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:18.414903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:18.414903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:18.414903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:18.414903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:18.420333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:37:18.420333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:37:18.420333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:37:18.420333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:18.420333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 536/1073] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:37:18.420627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cf46a-9791-43f0-97a6-510e58c7ec87 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:18.516400 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cf46a-9791-43f0-97a6-510e58c7ec87 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:18.549150 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd80251-31ea-4705-8e1b-7cfdf8c5c7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:18.549768 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd80251-31ea-4705-8e1b-7cfdf8c5c7b6 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:18.550051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd80251-31ea-4705-8e1b-7cfdf8c5c7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:18.550325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd80251-31ea-4705-8e1b-7cfdf8c5c7b6 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:18.551042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd80251-31ea-4705-8e1b-7cfdf8c5c7b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:18.551347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd80251-31ea-4705-8e1b-7cfdf8c5c7b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:18.552704 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd80251-31ea-4705-8e1b-7cfdf8c5c7b6 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:18.559651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:18.565463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 538/1074] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:18.571229 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1265c6a-4e9a-486d-b492-651365e5959b None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:18.628850 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:18.659696 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b7161-bec4-440d-8f5c-f6eb49764f1b None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:18.659979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b7161-bec4-440d-8f5c-f6eb49764f1b None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:18.660255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7b7161-bec4-440d-8f5c-f6eb49764f1b None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:18.661582 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 539/1075] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:37:18.667034 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b4f59-7c9d-4dd2-a78b-e756caf66a93 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:18.667259 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b4f59-7c9d-4dd2-a78b-e756caf66a93 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:18.667538 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b4f59-7c9d-4dd2-a78b-e756caf66a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:18.672998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1265c6a-4e9a-486d-b492-651365e5959b None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:18.685558 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-e77b4f59-7c9d-4dd2-a78b-e756caf66a93 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:18.686767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e77b4f59-7c9d-4dd2-a78b-e756caf66a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:18.706713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21960a-db49-4657-ac58-b996a79e3175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:18.707367 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21960a-db49-4657-ac58-b996a79e3175 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:18.707651 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21960a-db49-4657-ac58-b996a79e3175 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:18.707931 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21960a-db49-4657-ac58-b996a79e3175 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:18.714944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21960a-db49-4657-ac58-b996a79e3175 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:18.716385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21960a-db49-4657-ac58-b996a79e3175 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:18.728900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-9a21960a-db49-4657-ac58-b996a79e3175 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:37:18.728900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:18.728900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:18.728900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:18.728900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:18.728900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:18.728900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:18.728900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:18.728900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:18.728900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:18.728900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:18.728900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:18.728900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:37:18.728900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:37:18.728900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:37:18.729801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:37:18.729801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:18.729801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:18.729801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:18.729801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:18.729801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:18.729801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:18.729801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:18.729801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:18.729801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:18.729801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:18.729801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:18.729801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:18.729801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:18.729801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:18.729801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:18.729801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:18.730936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:37:18.730936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:37:18.730936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:37:18.730936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:37:18.730936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:37:18.730936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:37:18.730936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:37:18.730936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:18.730936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 537/1076] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:37:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:18.735795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21960a-db49-4657-ac58-b996a79e3175 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:18.754261 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 540/1077] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:37:18.776950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b4f59-7c9d-4dd2-a78b-e756caf66a93 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:18.836501 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21960a-db49-4657-ac58-b996a79e3175 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:18.849606 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:18.871104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8142f03-9a41-4869-8189-e0e293074a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:18.871719 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8142f03-9a41-4869-8189-e0e293074a52 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:18.872002 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8142f03-9a41-4869-8189-e0e293074a52 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:18.872278 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8142f03-9a41-4869-8189-e0e293074a52 None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:18.873022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8142f03-9a41-4869-8189-e0e293074a52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:18.873326 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8142f03-9a41-4869-8189-e0e293074a52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:18.874788 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8142f03-9a41-4869-8189-e0e293074a52 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:18.876322 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b4f59-7c9d-4dd2-a78b-e756caf66a93 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:18.886441 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 538/1078] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:37:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:18.892274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8142f03-9a41-4869-8189-e0e293074a52 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:18.902971 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:18.911761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c838e-8076-47ab-bc4b-f17cac14f093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:18.912410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c838e-8076-47ab-bc4b-f17cac14f093 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:18.913309 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c838e-8076-47ab-bc4b-f17cac14f093 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:18.913597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6c838e-8076-47ab-bc4b-f17cac14f093 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:18.923628 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6c838e-8076-47ab-bc4b-f17cac14f093 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:37:18.928530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-4d6c838e-8076-47ab-bc4b-f17cac14f093 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:37:18.928530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:18.928530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:18.928530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:18.928530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:18.928530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:18.928530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:18.928530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:18.928530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:18.928530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:18.928530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:18.928530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:18.928530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:37:18.928530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:37:18.928530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:37:18.928530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:37:18.929689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:37:18.929689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:37:18.929689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:37:18.929689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:37:18.929689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:18.929689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:18.929689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:18.929689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:18.929689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:18.929689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:18.929689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:18.929689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:18.929689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:18.929689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:18.929689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:18.929689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:18.930781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:18.930781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:18.930781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:18.930781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:18.930781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:37:18.930781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:37:18.930781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:37:18.930781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:37:18.930781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:37:18.930781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:37:18.930781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:37:18.930781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:18.930781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 541/1079] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:37:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:37:18.935528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c838e-8076-47ab-bc4b-f17cac14f093 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:18.990885 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8142f03-9a41-4869-8189-e0e293074a52 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:19.024151 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddb401-64e8-4f93-9277-c59e94863676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:19.024804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddb401-64e8-4f93-9277-c59e94863676 None admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:19.025090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddb401-64e8-4f93-9277-c59e94863676 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:19.025362 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddb401-64e8-4f93-9277-c59e94863676 None admin] PATH_INFO: `/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/c621601261e44ca8a7938862d6578639/roles/5b5390395eb544b8bf3d5d39591c987d` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:19.027573 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddb401-64e8-4f93-9277-c59e94863676 None admin] RBAC: Authorizing `identity:create_grant(project_id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user_id=c621601261e44ca8a7938862d6578639, role_id=5b5390395eb544b8bf3d5d39591c987d)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:19.028996 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddb401-64e8-4f93-9277-c59e94863676 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:19.034876 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6c838e-8076-47ab-bc4b-f17cac14f093 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:19.041375 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 539/1080] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:37:18 2022] PUT /identity/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/c621601261e44ca8a7938862d6578639/roles/5b5390395eb544b8bf3d5d39591c987d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:37:19.070150 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6fde5-8a0a-4f66-8d67-7b6d28958d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:19.070833 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6fde5-8a0a-4f66-8d67-7b6d28958d3e None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:19.071120 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6fde5-8a0a-4f66-8d67-7b6d28958d3e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:19.071398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc6fde5-8a0a-4f66-8d67-7b6d28958d3e None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:19.072138 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6fde5-8a0a-4f66-8d67-7b6d28958d3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:19.072451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6fde5-8a0a-4f66-8d67-7b6d28958d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:19.073873 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc6fde5-8a0a-4f66-8d67-7b6d28958d3e None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:19.084273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 542/1081] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:37:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:19.091001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddb401-64e8-4f93-9277-c59e94863676 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:19.126145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:19.196755 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddb401-64e8-4f93-9277-c59e94863676 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:19.231638 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165c486-d378-4dd5-958b-f427b781c918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:19.232281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165c486-d378-4dd5-958b-f427b781c918 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:19.232565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165c486-d378-4dd5-958b-f427b781c918 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:19.232842 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165c486-d378-4dd5-958b-f427b781c918 None admin] PATH_INFO: `/v3/users/04aefd2cdbae4dbda009b17407565e6b` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:19.234006 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165c486-d378-4dd5-958b-f427b781c918 None admin] RBAC: Authorizing `identity:get_user(user_id=04aefd2cdbae4dbda009b17407565e6b)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:19.235460 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9165c486-d378-4dd5-958b-f427b781c918 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:19.237097 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 540/1082] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:37:19 2022] GET /identity/v3/users/04aefd2cdbae4dbda009b17407565e6b => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:19.242933 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6fde5-8a0a-4f66-8d67-7b6d28958d3e None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:19.291692 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:19.341975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc6fde5-8a0a-4f66-8d67-7b6d28958d3e None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:19.374853 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a3652-064d-4032-bfc3-47f0cd7734c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:19.375492 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a3652-064d-4032-bfc3-47f0cd7734c5 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:19.375774 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a3652-064d-4032-bfc3-47f0cd7734c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:19.376049 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a3652-064d-4032-bfc3-47f0cd7734c5 None admin] PATH_INFO: `/v3/projects/b7a93858f72d4ed79c9adc4d7920cce1` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:19.377187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a3652-064d-4032-bfc3-47f0cd7734c5 None admin] RBAC: Authorizing `identity:get_project(project_id=b7a93858f72d4ed79c9adc4d7920cce1)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:19.378645 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8a3652-064d-4032-bfc3-47f0cd7734c5 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:19.380284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 543/1083] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:37:19 2022] GET /identity/v3/projects/b7a93858f72d4ed79c9adc4d7920cce1 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:19.386928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165c486-d378-4dd5-958b-f427b781c918 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:19.482932 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9165c486-d378-4dd5-958b-f427b781c918 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:19.484420 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:19.519693 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d9d178-8703-4cac-975c-1e1722333cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:19.520386 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9d178-8703-4cac-975c-1e1722333cd7 None admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:19.520671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9d178-8703-4cac-975c-1e1722333cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:19.520978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d9d178-8703-4cac-975c-1e1722333cd7 None admin] PATH_INFO: `/v3/projects/b7a93858f72d4ed79c9adc4d7920cce1/users/04aefd2cdbae4dbda009b17407565e6b/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:19.522941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9d178-8703-4cac-975c-1e1722333cd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7a93858f72d4ed79c9adc4d7920cce1, user_id=04aefd2cdbae4dbda009b17407565e6b, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:19.524397 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d9d178-8703-4cac-975c-1e1722333cd7 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:19.536864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 541/1084] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:37:19 2022] PUT /identity/v3/projects/b7a93858f72d4ed79c9adc4d7920cce1/users/04aefd2cdbae4dbda009b17407565e6b/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:37:21.046000 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26eaa0-4d0f-4982-ab00-c292eb880d14 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:21.046583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26eaa0-4d0f-4982-ab00-c292eb880d14 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:21.046583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26eaa0-4d0f-4982-ab00-c292eb880d14 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:21.047938 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 544/1085] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:21.053655 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a9a52-3c62-4fac-8de5-49363a32ca82 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:21.054030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a9a52-3c62-4fac-8de5-49363a32ca82 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:21.054334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a9a52-3c62-4fac-8de5-49363a32ca82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:21.072513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-3b0a9a52-3c62-4fac-8de5-49363a32ca82 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:21.073690 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-3b0a9a52-3c62-4fac-8de5-49363a32ca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:21.138782 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 542/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:21.161666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26eaa0-4d0f-4982-ab00-c292eb880d14 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:21.260561 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26eaa0-4d0f-4982-ab00-c292eb880d14 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:21.277096 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:21.294616 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238397f-bec1-4474-a4f7-fcd54bfb713e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:21.295260 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238397f-bec1-4474-a4f7-fcd54bfb713e None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:21.295605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238397f-bec1-4474-a4f7-fcd54bfb713e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:21.295891 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c238397f-bec1-4474-a4f7-fcd54bfb713e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:21.306367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c238397f-bec1-4474-a4f7-fcd54bfb713e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:37:21.311264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-c238397f-bec1-4474-a4f7-fcd54bfb713e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 22:37:21.311264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:21.311264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:21.311264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:21.311264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:21.311264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:21.311264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:21.311264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:21.311264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:21.311264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:21.311264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:21.311264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:21.311264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:37:21.311264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:37:21.311264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:37:21.311264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:37:21.312396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:37:21.312396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:37:21.312396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:37:21.312396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:37:21.312396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:21.312396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:21.312396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:21.312396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:21.312396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:21.312396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:21.312396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:21.312396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:21.312396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:21.312396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:21.312396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:21.312396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:21.313275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:21.313275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:21.313275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:21.313275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:21.313275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:37:21.313275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:37:21.313275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:37:21.313275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:37:21.313275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:37:21.313275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:37:21.313275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 22:37:21.313275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:21.313275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 545/1087] 10.222.0.48 () {56 vars in 1120 bytes} [Wed Jul 27 22:37:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:21.318565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a9a52-3c62-4fac-8de5-49363a32ca82 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:21.407942 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:21.418151 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a9a52-3c62-4fac-8de5-49363a32ca82 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:21.451513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf603f-9754-4120-9270-a67816b0b375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:21.452395 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf603f-9754-4120-9270-a67816b0b375 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:21.452683 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf603f-9754-4120-9270-a67816b0b375 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:21.452961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf603f-9754-4120-9270-a67816b0b375 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:21.453674 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf603f-9754-4120-9270-a67816b0b375 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:21.453982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf603f-9754-4120-9270-a67816b0b375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:21.455380 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf603f-9754-4120-9270-a67816b0b375 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:21.463187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 543/1088] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jul 27 22:37:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:21.468888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238397f-bec1-4474-a4f7-fcd54bfb713e None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:21.523536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65460984-c2c0-4561-8681-a57136a906c4 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:21.523942 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65460984-c2c0-4561-8681-a57136a906c4 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:21.524099 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65460984-c2c0-4561-8681-a57136a906c4 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:21.525443 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 544/1089] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:37:21.530197 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e584e-7484-4064-98a2-6dcab8a12e80 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:21.530520 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e584e-7484-4064-98a2-6dcab8a12e80 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:21.530804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e584e-7484-4064-98a2-6dcab8a12e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:21.548683 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-674e584e-7484-4064-98a2-6dcab8a12e80 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:21.549868 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-674e584e-7484-4064-98a2-6dcab8a12e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:21.568440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c238397f-bec1-4474-a4f7-fcd54bfb713e None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:21.606390 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46367f-056c-4664-8e1c-972dd133319f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:21.607040 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46367f-056c-4664-8e1c-972dd133319f None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:21.607325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46367f-056c-4664-8e1c-972dd133319f None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:21.607604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46367f-056c-4664-8e1c-972dd133319f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:21.616886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 545/1090] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:37:21.617524 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46367f-056c-4664-8e1c-972dd133319f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:21.619001 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46367f-056c-4664-8e1c-972dd133319f None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:21.633255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-bb46367f-056c-4664-8e1c-972dd133319f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:37:21.633255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:21.633255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:21.633255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:21.633255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:21.633255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:21.633255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:21.633255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:21.633255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:21.633255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:21.633255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:21.633255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:21.633255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:37:21.633255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:37:21.633255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:37:21.634217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:37:21.634217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:21.634217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:21.634217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:21.634217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:21.634217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:21.634217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:21.634217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:21.634217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:21.634217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:21.634217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:21.634217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:21.634217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:21.634217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:21.634217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:21.634217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:21.634217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:21.635565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:37:21.635565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:37:21.635565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:37:21.635565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:21.635565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 546/1091] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:21.639840 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46367f-056c-4664-8e1c-972dd133319f None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:21.639976 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e584e-7484-4064-98a2-6dcab8a12e80 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:21.669742 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:21.723218 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:21.739461 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46367f-056c-4664-8e1c-972dd133319f None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:21.739929 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e584e-7484-4064-98a2-6dcab8a12e80 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:21.771827 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5b944-93be-4bfc-a27e-3a99022581f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:21.772925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5b944-93be-4bfc-a27e-3a99022581f1 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:21.773041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9143d-4b9a-4677-9e40-f0c434c5fa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:21.773213 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5b944-93be-4bfc-a27e-3a99022581f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:21.773494 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5b944-93be-4bfc-a27e-3a99022581f1 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:21.773588 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9143d-4b9a-4677-9e40-f0c434c5fa76 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:21.773834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9143d-4b9a-4677-9e40-f0c434c5fa76 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:21.774113 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9143d-4b9a-4677-9e40-f0c434c5fa76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:21.774210 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5b944-93be-4bfc-a27e-3a99022581f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:21.774519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5b944-93be-4bfc-a27e-3a99022581f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:21.775887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5b944-93be-4bfc-a27e-3a99022581f1 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:21.784021 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9143d-4b9a-4677-9e40-f0c434c5fa76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:37:21.787300 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 547/1092] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:21.789536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-1ad9143d-4b9a-4677-9e40-f0c434c5fa76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:37:21.789536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:21.789536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:21.789536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:21.789536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:21.789536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:21.789536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:21.789536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:21.789536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:21.789536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:21.789536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:21.789536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:21.789536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:37:21.789536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:37:21.789536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:37:21.789536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:37:21.790677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:37:21.790677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:37:21.790677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:37:21.790677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:37:21.790677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:21.790677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:21.790677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:21.790677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:21.790677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:21.790677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:21.790677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:21.790677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:21.790677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:21.790677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:21.790677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:21.790677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:21.791542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:21.791542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:21.791542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:21.791542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:21.791542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:37:21.791542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:37:21.791542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:37:21.791542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:37:21.791542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:37:21.791542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:37:21.791542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:37:21.791542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:21.791542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 546/1093] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:37:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:21.793534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5b944-93be-4bfc-a27e-3a99022581f1 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:21.796399 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9143d-4b9a-4677-9e40-f0c434c5fa76 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:21.880862 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:21.891231 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5b944-93be-4bfc-a27e-3a99022581f1 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:21.893512 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9143d-4b9a-4677-9e40-f0c434c5fa76 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:21.924872 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34491502-bf2e-4b91-b2e1-d57692bd2f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:21.925506 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34491502-bf2e-4b91-b2e1-d57692bd2f04 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:21.925787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34491502-bf2e-4b91-b2e1-d57692bd2f04 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:21.926061 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34491502-bf2e-4b91-b2e1-d57692bd2f04 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:21.927478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36784e30-f0d5-4e77-8cfa-0ee11039d2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:21.928092 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36784e30-f0d5-4e77-8cfa-0ee11039d2e6 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:21.928754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36784e30-f0d5-4e77-8cfa-0ee11039d2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:21.929042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36784e30-f0d5-4e77-8cfa-0ee11039d2e6 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:21.929757 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36784e30-f0d5-4e77-8cfa-0ee11039d2e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:21.930066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36784e30-f0d5-4e77-8cfa-0ee11039d2e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:21.931484 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36784e30-f0d5-4e77-8cfa-0ee11039d2e6 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:21.932991 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34491502-bf2e-4b91-b2e1-d57692bd2f04 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:21.934435 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34491502-bf2e-4b91-b2e1-d57692bd2f04 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:21.939457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 547/1094] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:37:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:21.945179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36784e30-f0d5-4e77-8cfa-0ee11039d2e6 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:21.945904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-34491502-bf2e-4b91-b2e1-d57692bd2f04 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 22:37:21.945904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:21.945904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:21.945904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:21.945904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:21.945904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:21.945904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:21.945904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:21.945904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:21.945904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:21.945904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:21.945904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:21.945904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:37:21.945904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:37:21.945904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:37:21.945904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:37:21.947083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:21.947083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:21.947083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:37:21.947083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:37:21.947083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:37:21.947083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:37:21.947083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:21.947083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:21.947083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:21.947083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:21.947083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:21.947083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:21.947083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:21.947083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:21.947083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:21.947083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:21.947083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:21.947083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:21.948286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:21.948286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:21.948286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:37:21.948286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:37:21.948286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:37:21.948286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:37:21.948286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:37:21.948286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:37:21.948286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 22:37:21.948286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:21.950489 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 548/1095] 10.222.0.48 () {56 vars in 1093 bytes} [Wed Jul 27 22:37:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:21.952700 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34491502-bf2e-4b91-b2e1-d57692bd2f04 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:21.955726 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:22.045931 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36784e30-f0d5-4e77-8cfa-0ee11039d2e6 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:22.048861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34491502-bf2e-4b91-b2e1-d57692bd2f04 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:22.078904 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7e7ef-1025-4942-8930-7876eca62529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:22.079542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7e7ef-1025-4942-8930-7876eca62529 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:22.079826 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7e7ef-1025-4942-8930-7876eca62529 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:22.080106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7e7ef-1025-4942-8930-7876eca62529 None admin] PATH_INFO: `/v3/users/04aefd2cdbae4dbda009b17407565e6b` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:22.081251 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7e7ef-1025-4942-8930-7876eca62529 None admin] RBAC: Authorizing `identity:get_user(user_id=04aefd2cdbae4dbda009b17407565e6b)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:22.081889 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050a639-b09d-4c2a-aeb8-cf7978ef623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:22.082562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050a639-b09d-4c2a-aeb8-cf7978ef623b None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:22.082711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7e7ef-1025-4942-8930-7876eca62529 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:22.082852 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050a639-b09d-4c2a-aeb8-cf7978ef623b None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:22.083131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050a639-b09d-4c2a-aeb8-cf7978ef623b None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:22.083922 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050a639-b09d-4c2a-aeb8-cf7978ef623b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:22.084241 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050a639-b09d-4c2a-aeb8-cf7978ef623b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:22.084364 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 548/1096] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:37:21 2022] GET /identity/v3/users/04aefd2cdbae4dbda009b17407565e6b => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:22.086289 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050a639-b09d-4c2a-aeb8-cf7978ef623b None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:22.090519 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7e7ef-1025-4942-8930-7876eca62529 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:22.105225 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 549/1097] 10.222.0.48 () {56 vars in 1133 bytes} [Wed Jul 27 22:37:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:22.110712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050a639-b09d-4c2a-aeb8-cf7978ef623b None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:22.120348 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:22.168662 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:22.193410 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7e7ef-1025-4942-8930-7876eca62529 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:22.207505 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050a639-b09d-4c2a-aeb8-cf7978ef623b None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:22.226677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153a268-dee6-4a6e-a786-1da5c16aa292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:22.227288 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153a268-dee6-4a6e-a786-1da5c16aa292 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:22.227568 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153a268-dee6-4a6e-a786-1da5c16aa292 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:22.227838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7153a268-dee6-4a6e-a786-1da5c16aa292 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:22.240578 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d0a9d-a25b-446e-86f7-ffb3c7a58f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:22.241216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d0a9d-a25b-446e-86f7-ffb3c7a58f83 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:22.241504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d0a9d-a25b-446e-86f7-ffb3c7a58f83 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:22.241783 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d0a9d-a25b-446e-86f7-ffb3c7a58f83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:22.293422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153a268-dee6-4a6e-a786-1da5c16aa292 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:22.294905 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7153a268-dee6-4a6e-a786-1da5c16aa292 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:22.316555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d0a9d-a25b-446e-86f7-ffb3c7a58f83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:22.318010 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d0a9d-a25b-446e-86f7-ffb3c7a58f83 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:22.328221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:22.374014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:22.399315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 549/1098] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:37:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 22:37:22.405017 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153a268-dee6-4a6e-a786-1da5c16aa292 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:22.419715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 550/1099] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:37:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 22:37:22.425348 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d0a9d-a25b-446e-86f7-ffb3c7a58f83 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:22.500416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7153a268-dee6-4a6e-a786-1da5c16aa292 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:22.519703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d0a9d-a25b-446e-86f7-ffb3c7a58f83 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:22.529219 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:22.534169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379de819-f630-4659-8291-626a45f599c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:22.534838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379de819-f630-4659-8291-626a45f599c4 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:22.535122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379de819-f630-4659-8291-626a45f599c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:22.535397 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379de819-f630-4659-8291-626a45f599c4 None admin] PATH_INFO: `/v3/projects/b7a93858f72d4ed79c9adc4d7920cce1` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:22.536538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379de819-f630-4659-8291-626a45f599c4 None admin] RBAC: Authorizing `identity:get_project(project_id=b7a93858f72d4ed79c9adc4d7920cce1)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:22.538590 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379de819-f630-4659-8291-626a45f599c4 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:22.540243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 550/1100] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:37:22 2022] GET /identity/v3/projects/b7a93858f72d4ed79c9adc4d7920cce1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:22.546108 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379de819-f630-4659-8291-626a45f599c4 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:22.555117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64694590-f271-481d-a86d-19013001a86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:22.555758 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64694590-f271-481d-a86d-19013001a86a None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:22.556042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64694590-f271-481d-a86d-19013001a86a None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:22.556313 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64694590-f271-481d-a86d-19013001a86a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:22.566060 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64694590-f271-481d-a86d-19013001a86a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:22.567517 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64694590-f271-481d-a86d-19013001a86a None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:22.582251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-64694590-f271-481d-a86d-19013001a86a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:37:22.582251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:22.582251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:22.582251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:22.582251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:22.582251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:22.582251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:22.582251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:22.582251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:22.582251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:22.582251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:22.582251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:22.582251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:37:22.582251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:37:22.582251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:37:22.583398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:37:22.583398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:22.583398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:22.583398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:22.583398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:22.583398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:22.583398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:22.583398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:22.583398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:22.583398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:22.583398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:22.583398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:22.583398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:22.583398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:22.583398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:22.583398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:22.583398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:22.585002 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:37:22.585002 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:37:22.585002 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:37:22.585002 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:22.588775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 551/1101] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:37:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:37:22.589535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64694590-f271-481d-a86d-19013001a86a None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:22.589629 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:22.652536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379de819-f630-4659-8291-626a45f599c4 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:22.685507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cc19f-6d6b-47da-9371-4f12d2cbf129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:22.686043 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cc19f-6d6b-47da-9371-4f12d2cbf129 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:22.686331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cc19f-6d6b-47da-9371-4f12d2cbf129 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:22.686633 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340cc19f-6d6b-47da-9371-4f12d2cbf129 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:22.687418 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340cc19f-6d6b-47da-9371-4f12d2cbf129 None admin] RBAC: Adding query filter params (role.id=49e0ba8d8c9f4824892b61f05d0036e8, scope.project.id=b7a93858f72d4ed79c9adc4d7920cce1, user.id=04aefd2cdbae4dbda009b17407565e6b) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:22.687730 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340cc19f-6d6b-47da-9371-4f12d2cbf129 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:22.689147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340cc19f-6d6b-47da-9371-4f12d2cbf129 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:22.694876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 551/1102] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:37:22 2022] GET /identity/v3/role_assignments?user.id=04aefd2cdbae4dbda009b17407565e6b&scope.project.id=b7a93858f72d4ed79c9adc4d7920cce1&role.id=49e0ba8d8c9f4824892b61f05d0036e8 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:37:22.695432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64694590-f271-481d-a86d-19013001a86a None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:22.731570 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f80f25-52fc-4c3e-b9b0-204a9eb99d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:22.732205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f80f25-52fc-4c3e-b9b0-204a9eb99d50 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:22.732491 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f80f25-52fc-4c3e-b9b0-204a9eb99d50 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:22.732765 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f80f25-52fc-4c3e-b9b0-204a9eb99d50 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:22.733468 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f80f25-52fc-4c3e-b9b0-204a9eb99d50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:22.733776 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f80f25-52fc-4c3e-b9b0-204a9eb99d50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:22.735199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f80f25-52fc-4c3e-b9b0-204a9eb99d50 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:22.748303 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 552/1103] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:22.754162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cc19f-6d6b-47da-9371-4f12d2cbf129 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:22.858999 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340cc19f-6d6b-47da-9371-4f12d2cbf129 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:22.866132 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:22.896768 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea8aeb-5952-41f3-94f1-960ce908d3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:22.898020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea8aeb-5952-41f3-94f1-960ce908d3f4 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:22.898307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea8aeb-5952-41f3-94f1-960ce908d3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:22.898613 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea8aeb-5952-41f3-94f1-960ce908d3f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:22.905307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea8aeb-5952-41f3-94f1-960ce908d3f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:22.906785 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea8aeb-5952-41f3-94f1-960ce908d3f4 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:22.917975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-bfea8aeb-5952-41f3-94f1-960ce908d3f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:37:22.917975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:22.917975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:22.917975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:22.917975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:22.917975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:22.917975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:22.917975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:22.917975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:22.917975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:22.917975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:22.917975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:22.917975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:37:22.917975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:37:22.917975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:37:22.919138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:37:22.919138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:22.919138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:22.919138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:22.919138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:22.919138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:22.919138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:22.919138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:22.919138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:22.919138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:22.919138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:22.919138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:22.919138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:22.919138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:22.919138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:22.919138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:22.919138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:22.920102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:37:22.920102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:37:22.920102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:37:22.920102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:37:22.920102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:37:22.920102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:37:22.920102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:37:22.920102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:22.920102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 552/1104] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:37:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:37:22.924894 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f80f25-52fc-4c3e-b9b0-204a9eb99d50 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:22.946659 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:23.023132 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f80f25-52fc-4c3e-b9b0-204a9eb99d50 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:23.055734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29366057-d8f6-47c5-b0d8-e289963454da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:23.056357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29366057-d8f6-47c5-b0d8-e289963454da None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:23.056628 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29366057-d8f6-47c5-b0d8-e289963454da None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:23.056910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29366057-d8f6-47c5-b0d8-e289963454da None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:23.057664 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29366057-d8f6-47c5-b0d8-e289963454da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:23.057978 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29366057-d8f6-47c5-b0d8-e289963454da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:23.059440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29366057-d8f6-47c5-b0d8-e289963454da None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:23.071244 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 553/1105] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:37:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:23.077581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea8aeb-5952-41f3-94f1-960ce908d3f4 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:23.174441 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea8aeb-5952-41f3-94f1-960ce908d3f4 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:23.207839 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287359e-b8bf-463b-8565-d27637598742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:23.208385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287359e-b8bf-463b-8565-d27637598742 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:23.208668 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287359e-b8bf-463b-8565-d27637598742 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:23.208944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287359e-b8bf-463b-8565-d27637598742 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:23.209722 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287359e-b8bf-463b-8565-d27637598742 None admin] RBAC: Adding query filter params (role.id=5b5390395eb544b8bf3d5d39591c987d, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=c621601261e44ca8a7938862d6578639) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:23.210032 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287359e-b8bf-463b-8565-d27637598742 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:23.211489 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287359e-b8bf-463b-8565-d27637598742 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:23.217142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 553/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:37:23 2022] GET /identity/v3/role_assignments?user.id=c621601261e44ca8a7938862d6578639&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=5b5390395eb544b8bf3d5d39591c987d => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:24.699201 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9655ac-f653-4114-b621-940f452ac7c6 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:24.699699 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9655ac-f653-4114-b621-940f452ac7c6 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:24.699812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9655ac-f653-4114-b621-940f452ac7c6 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:24.701144 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 554/1107] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:24.706725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ae3d3-d82d-46cc-abdc-fa246b648b1b None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:24.707153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ae3d3-d82d-46cc-abdc-fa246b648b1b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:24.707284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8ae3d3-d82d-46cc-abdc-fa246b648b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:24.724781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-fa8ae3d3-d82d-46cc-abdc-fa246b648b1b None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:24.725984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-fa8ae3d3-d82d-46cc-abdc-fa246b648b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:24.748970 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:24.790577 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 554/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:24.820958 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9655ac-f653-4114-b621-940f452ac7c6 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:24.906580 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:24.931749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9655ac-f653-4114-b621-940f452ac7c6 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:24.966975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee43aad7-0a44-40a4-91df-6b715b4773e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:24.967602 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43aad7-0a44-40a4-91df-6b715b4773e6 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:24.967881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43aad7-0a44-40a4-91df-6b715b4773e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:24.968157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee43aad7-0a44-40a4-91df-6b715b4773e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:24.969285 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43aad7-0a44-40a4-91df-6b715b4773e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:24.970738 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee43aad7-0a44-40a4-91df-6b715b4773e6 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:24.972297 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 555/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:37:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:24.978547 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ae3d3-d82d-46cc-abdc-fa246b648b1b None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:25.071643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8ae3d3-d82d-46cc-abdc-fa246b648b1b None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:25.103948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f6d93-6638-4827-ba0f-25428adf971c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:25.104554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f6d93-6638-4827-ba0f-25428adf971c None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:25.104839 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f6d93-6638-4827-ba0f-25428adf971c None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:25.105115 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f6d93-6638-4827-ba0f-25428adf971c None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:25.105786 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f6d93-6638-4827-ba0f-25428adf971c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:25.107229 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f6d93-6638-4827-ba0f-25428adf971c None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:25.128254 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 555/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 22:37:24 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:37:27.124050 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647c6da-ef72-4e95-b32c-131af0d68aa4 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:27.124597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647c6da-ef72-4e95-b32c-131af0d68aa4 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:27.124597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647c6da-ef72-4e95-b32c-131af0d68aa4 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:27.125943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 556/1111] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:27.131832 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee2879-107d-4480-b6ba-5941885d4363 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:27.132235 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee2879-107d-4480-b6ba-5941885d4363 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:27.132382 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee2879-107d-4480-b6ba-5941885d4363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:27.149934 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-31ee2879-107d-4480-b6ba-5941885d4363 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:27.151136 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-31ee2879-107d-4480-b6ba-5941885d4363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:27.161361 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:27.216229 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 556/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:27.239440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647c6da-ef72-4e95-b32c-131af0d68aa4 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:27.338432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647c6da-ef72-4e95-b32c-131af0d68aa4 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:27.371626 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bffc7-2f55-469b-ab1e-36c3f60fdb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:27.372251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bffc7-2f55-469b-ab1e-36c3f60fdb02 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:27.372534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bffc7-2f55-469b-ab1e-36c3f60fdb02 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:27.372812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bffc7-2f55-469b-ab1e-36c3f60fdb02 None admin] PATH_INFO: `/v3/roles/d4ee54c077084dcea38d7476927b61df` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:27.374266 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bffc7-2f55-469b-ab1e-36c3f60fdb02 None admin] RBAC: Authorizing `identity:get_role(role_id=d4ee54c077084dcea38d7476927b61df)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:27.375611 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bffc7-2f55-469b-ab1e-36c3f60fdb02 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:27.376913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 557/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:37:27 2022] GET /identity/v3/roles/d4ee54c077084dcea38d7476927b61df => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:27.382586 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee2879-107d-4480-b6ba-5941885d4363 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:27.477228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee2879-107d-4480-b6ba-5941885d4363 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:27.509688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f20c46-bfba-442f-9b74-c7613c6d8073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:27.510313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f20c46-bfba-442f-9b74-c7613c6d8073 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:27.510629 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f20c46-bfba-442f-9b74-c7613c6d8073 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:27.510905 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f20c46-bfba-442f-9b74-c7613c6d8073 None admin] PATH_INFO: `/v3/users/3e12dbe48c4c49358ccb3c4ceba88198` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:27.523344 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f20c46-bfba-442f-9b74-c7613c6d8073 None admin] RBAC: Authorizing `identity:get_user(user_id=3e12dbe48c4c49358ccb3c4ceba88198)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:27.524766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f20c46-bfba-442f-9b74-c7613c6d8073 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:27.526350 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 557/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:37:27 2022] GET /identity/v3/users/3e12dbe48c4c49358ccb3c4ceba88198 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:27.531852 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bffc7-2f55-469b-ab1e-36c3f60fdb02 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:27.549628 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:27.631733 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bffc7-2f55-469b-ab1e-36c3f60fdb02 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:27.664746 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b0091-66a3-4132-b8d7-4d5d9cb2c390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:27.665358 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b0091-66a3-4132-b8d7-4d5d9cb2c390 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:27.665653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b0091-66a3-4132-b8d7-4d5d9cb2c390 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:27.665935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b0091-66a3-4132-b8d7-4d5d9cb2c390 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:27.730276 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b0091-66a3-4132-b8d7-4d5d9cb2c390 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:27.731750 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b0091-66a3-4132-b8d7-4d5d9cb2c390 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:27.747396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:27.825014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 558/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:37:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 22:37:27.831110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f20c46-bfba-442f-9b74-c7613c6d8073 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:27.835315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:27.927585 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f20c46-bfba-442f-9b74-c7613c6d8073 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:27.960408 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3465a-ec45-4186-9dfe-cf2ca42d7235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:27.961032 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3465a-ec45-4186-9dfe-cf2ca42d7235 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:27.961311 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3465a-ec45-4186-9dfe-cf2ca42d7235 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:27.961582 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3465a-ec45-4186-9dfe-cf2ca42d7235 None admin] PATH_INFO: `/v3/projects/b7a93858f72d4ed79c9adc4d7920cce1` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:27.962732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3465a-ec45-4186-9dfe-cf2ca42d7235 None admin] RBAC: Authorizing `identity:get_project(project_id=b7a93858f72d4ed79c9adc4d7920cce1)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:27.964137 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3465a-ec45-4186-9dfe-cf2ca42d7235 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:27.965769 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 558/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:37:27 2022] GET /identity/v3/projects/b7a93858f72d4ed79c9adc4d7920cce1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:27.972000 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b0091-66a3-4132-b8d7-4d5d9cb2c390 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:28.069432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b0091-66a3-4132-b8d7-4d5d9cb2c390 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:28.085875 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:28.103361 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4546a-e64d-4457-bc48-0fab789b4b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:28.103967 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4546a-e64d-4457-bc48-0fab789b4b56 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:28.104253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4546a-e64d-4457-bc48-0fab789b4b56 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:28.104530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4546a-e64d-4457-bc48-0fab789b4b56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:28.105311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4546a-e64d-4457-bc48-0fab789b4b56 None admin] RBAC: Adding query filter params (role.id=d4ee54c077084dcea38d7476927b61df, scope.project.id=b7a93858f72d4ed79c9adc4d7920cce1, user.id=3e12dbe48c4c49358ccb3c4ceba88198) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:28.105630 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4546a-e64d-4457-bc48-0fab789b4b56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:28.107078 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4546a-e64d-4457-bc48-0fab789b4b56 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:28.112275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 559/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:37:27 2022] GET /identity/v3/role_assignments?user.id=3e12dbe48c4c49358ccb3c4ceba88198&scope.project.id=b7a93858f72d4ed79c9adc4d7920cce1&role.id=d4ee54c077084dcea38d7476927b61df => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:30.083756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb9f3b-2a8d-4f6f-b9ee-24078277c463 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:30.084272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb9f3b-2a8d-4f6f-b9ee-24078277c463 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:30.084501 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb9f3b-2a8d-4f6f-b9ee-24078277c463 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:30.085992 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 559/1118] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:30.091241 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dea37-8afc-47cc-bd8b-a0c292b69226 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:30.091677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dea37-8afc-47cc-bd8b-a0c292b69226 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:30.091805 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0dea37-8afc-47cc-bd8b-a0c292b69226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:30.109362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-8d0dea37-8afc-47cc-bd8b-a0c292b69226 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:30.110561 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8d0dea37-8afc-47cc-bd8b-a0c292b69226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:30.174564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 560/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:30.197602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb9f3b-2a8d-4f6f-b9ee-24078277c463 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:30.267087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:30.296447 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb9f3b-2a8d-4f6f-b9ee-24078277c463 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:30.329008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d8db6-48f8-44e4-a070-407500295160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:30.329636 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d8db6-48f8-44e4-a070-407500295160 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:30.329920 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d8db6-48f8-44e4-a070-407500295160 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:30.330195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695d8db6-48f8-44e4-a070-407500295160 None admin] PATH_INFO: `/v3/roles/d4ee54c077084dcea38d7476927b61df` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:30.331644 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d8db6-48f8-44e4-a070-407500295160 None admin] RBAC: Authorizing `identity:get_role(role_id=d4ee54c077084dcea38d7476927b61df)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:30.333000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695d8db6-48f8-44e4-a070-407500295160 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:30.334377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 560/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:37:30 2022] GET /identity/v3/roles/d4ee54c077084dcea38d7476927b61df => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:30.339998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dea37-8afc-47cc-bd8b-a0c292b69226 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:30.438946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0dea37-8afc-47cc-bd8b-a0c292b69226 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:30.449816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:30.472620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36075ab-4f03-454d-972c-dfb5189f7b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:30.473248 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36075ab-4f03-454d-972c-dfb5189f7b52 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:30.473527 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36075ab-4f03-454d-972c-dfb5189f7b52 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:30.473798 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36075ab-4f03-454d-972c-dfb5189f7b52 None admin] PATH_INFO: `/v3/users/3e12dbe48c4c49358ccb3c4ceba88198` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:30.475482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36075ab-4f03-454d-972c-dfb5189f7b52 None admin] RBAC: Authorizing `identity:get_user(user_id=3e12dbe48c4c49358ccb3c4ceba88198)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:30.476890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36075ab-4f03-454d-972c-dfb5189f7b52 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:30.478465 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 561/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:37:30 2022] GET /identity/v3/users/3e12dbe48c4c49358ccb3c4ceba88198 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:30.484209 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d8db6-48f8-44e4-a070-407500295160 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:30.581505 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695d8db6-48f8-44e4-a070-407500295160 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:30.615470 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d10f6-6beb-4b87-ac0b-71cea0ac34ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:30.616109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d10f6-6beb-4b87-ac0b-71cea0ac34ba None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:30.616396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d10f6-6beb-4b87-ac0b-71cea0ac34ba None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:30.616676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d10f6-6beb-4b87-ac0b-71cea0ac34ba None admin] PATH_INFO: `/v3/projects/b7a93858f72d4ed79c9adc4d7920cce1` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:30.617818 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d10f6-6beb-4b87-ac0b-71cea0ac34ba None admin] RBAC: Authorizing `identity:get_project(project_id=b7a93858f72d4ed79c9adc4d7920cce1)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:30.619284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d10f6-6beb-4b87-ac0b-71cea0ac34ba None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:30.620949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 561/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:37:30 2022] GET /identity/v3/projects/b7a93858f72d4ed79c9adc4d7920cce1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:30.626799 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36075ab-4f03-454d-972c-dfb5189f7b52 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:30.722457 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36075ab-4f03-454d-972c-dfb5189f7b52 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:30.754935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817ee9c-3d77-43f4-817d-2955d93ecac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:30.755594 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817ee9c-3d77-43f4-817d-2955d93ecac7 None admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:30.755879 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817ee9c-3d77-43f4-817d-2955d93ecac7 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:30.756159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817ee9c-3d77-43f4-817d-2955d93ecac7 None admin] PATH_INFO: `/v3/projects/b7a93858f72d4ed79c9adc4d7920cce1/users/3e12dbe48c4c49358ccb3c4ceba88198/roles/d4ee54c077084dcea38d7476927b61df` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:30.758319 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817ee9c-3d77-43f4-817d-2955d93ecac7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b7a93858f72d4ed79c9adc4d7920cce1, user_id=3e12dbe48c4c49358ccb3c4ceba88198, role_id=d4ee54c077084dcea38d7476927b61df)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:30.759763 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817ee9c-3d77-43f4-817d-2955d93ecac7 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:30.772575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 562/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:37:30 2022] PUT /identity/v3/projects/b7a93858f72d4ed79c9adc4d7920cce1/users/3e12dbe48c4c49358ccb3c4ceba88198/roles/d4ee54c077084dcea38d7476927b61df => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:37:32.759851 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b67ab-ac52-42d3-84ac-977e84da1f74 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:32.760398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b67ab-ac52-42d3-84ac-977e84da1f74 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:32.760398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b67ab-ac52-42d3-84ac-977e84da1f74 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:32.761758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 562/1124] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:32.766808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869398ec-4c59-46be-8e15-06456a48f488 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:32.767188 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869398ec-4c59-46be-8e15-06456a48f488 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:32.767377 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869398ec-4c59-46be-8e15-06456a48f488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:32.785612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-869398ec-4c59-46be-8e15-06456a48f488 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:32.786829 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-869398ec-4c59-46be-8e15-06456a48f488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:32.814989 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:32.854421 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 563/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:32.877477 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b67ab-ac52-42d3-84ac-977e84da1f74 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:32.888742 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:32.977045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b67ab-ac52-42d3-84ac-977e84da1f74 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:33.023689 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7505d8a-7d95-4c82-9c9e-25bede3d40ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:33.024343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7505d8a-7d95-4c82-9c9e-25bede3d40ae None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:33.024629 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7505d8a-7d95-4c82-9c9e-25bede3d40ae None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:33.024910 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7505d8a-7d95-4c82-9c9e-25bede3d40ae None admin] PATH_INFO: `/v3/roles/d4ee54c077084dcea38d7476927b61df` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:33.026389 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7505d8a-7d95-4c82-9c9e-25bede3d40ae None admin] RBAC: Authorizing `identity:get_role(role_id=d4ee54c077084dcea38d7476927b61df)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:33.027768 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7505d8a-7d95-4c82-9c9e-25bede3d40ae None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:33.029128 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 563/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:37:32 2022] GET /identity/v3/roles/d4ee54c077084dcea38d7476927b61df => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:33.035012 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869398ec-4c59-46be-8e15-06456a48f488 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:33.130106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869398ec-4c59-46be-8e15-06456a48f488 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:33.162457 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a313ae5-3bb1-48b7-ad49-1a583d24c3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:33.163086 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a313ae5-3bb1-48b7-ad49-1a583d24c3d4 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:33.163368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a313ae5-3bb1-48b7-ad49-1a583d24c3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:33.163647 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a313ae5-3bb1-48b7-ad49-1a583d24c3d4 None admin] PATH_INFO: `/v3/users/3e12dbe48c4c49358ccb3c4ceba88198` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:33.164787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a313ae5-3bb1-48b7-ad49-1a583d24c3d4 None admin] RBAC: Authorizing `identity:get_user(user_id=3e12dbe48c4c49358ccb3c4ceba88198)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:33.166209 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a313ae5-3bb1-48b7-ad49-1a583d24c3d4 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:33.167795 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 564/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:37:33 2022] GET /identity/v3/users/3e12dbe48c4c49358ccb3c4ceba88198 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:33.173453 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7505d8a-7d95-4c82-9c9e-25bede3d40ae None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:33.250719 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:33.273498 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7505d8a-7d95-4c82-9c9e-25bede3d40ae None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:33.308529 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb929d-2646-4e51-99ad-a9fb70124915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:33.309149 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb929d-2646-4e51-99ad-a9fb70124915 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:33.309435 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb929d-2646-4e51-99ad-a9fb70124915 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:33.309715 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb929d-2646-4e51-99ad-a9fb70124915 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:33.381917 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb929d-2646-4e51-99ad-a9fb70124915 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:33.383312 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb929d-2646-4e51-99ad-a9fb70124915 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:33.454066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:33.477567 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 564/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:37:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 22:37:33.483438 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a313ae5-3bb1-48b7-ad49-1a583d24c3d4 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:33.517122 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:33.579152 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a313ae5-3bb1-48b7-ad49-1a583d24c3d4 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:33.613464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ceaef2-e32f-4599-84b6-74cb1ba5e1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:33.614105 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceaef2-e32f-4599-84b6-74cb1ba5e1ec None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:33.614412 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceaef2-e32f-4599-84b6-74cb1ba5e1ec None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:33.614693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ceaef2-e32f-4599-84b6-74cb1ba5e1ec None admin] PATH_INFO: `/v3/projects/b7a93858f72d4ed79c9adc4d7920cce1` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:33.615852 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ceaef2-e32f-4599-84b6-74cb1ba5e1ec None admin] RBAC: Authorizing `identity:get_project(project_id=b7a93858f72d4ed79c9adc4d7920cce1)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:33.617274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ceaef2-e32f-4599-84b6-74cb1ba5e1ec None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:33.618955 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 565/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:37:33 2022] GET /identity/v3/projects/b7a93858f72d4ed79c9adc4d7920cce1 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:33.625730 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb929d-2646-4e51-99ad-a9fb70124915 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:33.723212 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb929d-2646-4e51-99ad-a9fb70124915 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:33.756716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d1f02-af5f-42fb-8ab6-e5bde59dceed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:33.757323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d1f02-af5f-42fb-8ab6-e5bde59dceed None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:33.757607 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d1f02-af5f-42fb-8ab6-e5bde59dceed None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:33.757883 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d1f02-af5f-42fb-8ab6-e5bde59dceed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:33.758696 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d1f02-af5f-42fb-8ab6-e5bde59dceed None admin] RBAC: Adding query filter params (role.id=d4ee54c077084dcea38d7476927b61df, scope.project.id=b7a93858f72d4ed79c9adc4d7920cce1, user.id=3e12dbe48c4c49358ccb3c4ceba88198) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:33.759008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d1f02-af5f-42fb-8ab6-e5bde59dceed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:33.760430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d1f02-af5f-42fb-8ab6-e5bde59dceed None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:33.766043 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 565/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:37:33 2022] GET /identity/v3/role_assignments?user.id=3e12dbe48c4c49358ccb3c4ceba88198&scope.project.id=b7a93858f72d4ed79c9adc4d7920cce1&role.id=d4ee54c077084dcea38d7476927b61df => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:35.751741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8710011-36d4-4fe5-96ce-13eb22ebe416 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:35.752296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8710011-36d4-4fe5-96ce-13eb22ebe416 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:35.752296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8710011-36d4-4fe5-96ce-13eb22ebe416 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:35.753629 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 566/1131] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:35.759241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c4341-a1ce-4f3d-8740-029d6eb52175 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:35.759629 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c4341-a1ce-4f3d-8740-029d6eb52175 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:35.759796 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c4341-a1ce-4f3d-8740-029d6eb52175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:35.777869 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-a41c4341-a1ce-4f3d-8740-029d6eb52175 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:35.779083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a41c4341-a1ce-4f3d-8740-029d6eb52175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:35.811575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:35.844755 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 566/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:35.867935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8710011-36d4-4fe5-96ce-13eb22ebe416 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:35.965278 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8710011-36d4-4fe5-96ce-13eb22ebe416 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:35.967512 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:35.998099 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf86556-a4c9-4019-a7d3-b7bb83ebb892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:35.998744 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf86556-a4c9-4019-a7d3-b7bb83ebb892 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:35.999028 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf86556-a4c9-4019-a7d3-b7bb83ebb892 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:35.999305 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf86556-a4c9-4019-a7d3-b7bb83ebb892 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:36.000438 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf86556-a4c9-4019-a7d3-b7bb83ebb892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:36.001851 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf86556-a4c9-4019-a7d3-b7bb83ebb892 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:36.003416 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 567/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:37:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:36.009735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c4341-a1ce-4f3d-8740-029d6eb52175 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:36.105540 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c4341-a1ce-4f3d-8740-029d6eb52175 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:36.138549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6500f3-4c92-42c0-bcff-72f7b1023487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:36.139163 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6500f3-4c92-42c0-bcff-72f7b1023487 None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:36.139450 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6500f3-4c92-42c0-bcff-72f7b1023487 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:36.139730 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6500f3-4c92-42c0-bcff-72f7b1023487 None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:36.140405 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6500f3-4c92-42c0-bcff-72f7b1023487 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:36.141831 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6500f3-4c92-42c0-bcff-72f7b1023487 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:36.167373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 567/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 22:37:36 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:37:38.169417 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7152e88-23de-41ff-b10f-2428793ab347 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:38.169970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7152e88-23de-41ff-b10f-2428793ab347 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:38.169970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7152e88-23de-41ff-b10f-2428793ab347 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:38.171357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 568/1135] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:38.176522 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e30b2-a195-4dfd-bada-b2fd0b5553e3 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:38.176899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e30b2-a195-4dfd-bada-b2fd0b5553e3 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:38.177087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e30b2-a195-4dfd-bada-b2fd0b5553e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:38.194743 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-6f1e30b2-a195-4dfd-bada-b2fd0b5553e3 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:38.195920 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-6f1e30b2-a195-4dfd-bada-b2fd0b5553e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:38.212635 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:38.262722 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 568/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:38.287852 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7152e88-23de-41ff-b10f-2428793ab347 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:38.394868 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7152e88-23de-41ff-b10f-2428793ab347 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:38.428923 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa654f1-0c95-45e7-8a9c-a38a840e40f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:38.429489 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa654f1-0c95-45e7-8a9c-a38a840e40f0 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:38.429769 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa654f1-0c95-45e7-8a9c-a38a840e40f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:38.430043 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa654f1-0c95-45e7-8a9c-a38a840e40f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:38.431200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa654f1-0c95-45e7-8a9c-a38a840e40f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:38.432616 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa654f1-0c95-45e7-8a9c-a38a840e40f0 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:38.434180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 569/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:37:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:38.439897 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e30b2-a195-4dfd-bada-b2fd0b5553e3 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:38.535606 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e30b2-a195-4dfd-bada-b2fd0b5553e3 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:38.568506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8163c-0788-4fea-aac1-97f32ec7d731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:38.569114 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8163c-0788-4fea-aac1-97f32ec7d731 None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:38.569401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8163c-0788-4fea-aac1-97f32ec7d731 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:38.569681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8163c-0788-4fea-aac1-97f32ec7d731 None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:38.570384 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8163c-0788-4fea-aac1-97f32ec7d731 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:38.571801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8163c-0788-4fea-aac1-97f32ec7d731 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:38.592784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 569/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 22:37:38 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:37:40.617118 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929946e6-278a-4868-ba18-3d52523fdabf None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:40.617575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929946e6-278a-4868-ba18-3d52523fdabf None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:40.617668 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929946e6-278a-4868-ba18-3d52523fdabf None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:40.619056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 570/1139] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:40.624007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edbaff-26e6-4d2c-99cd-933785df952f None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:40.624425 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edbaff-26e6-4d2c-99cd-933785df952f None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:40.624569 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1edbaff-26e6-4d2c-99cd-933785df952f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:40.642225 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-b1edbaff-26e6-4d2c-99cd-933785df952f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:40.643428 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-b1edbaff-26e6-4d2c-99cd-933785df952f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:40.645342 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:40.710518 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 570/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:40.733680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929946e6-278a-4868-ba18-3d52523fdabf None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:40.774755 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:40.830714 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929946e6-278a-4868-ba18-3d52523fdabf None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:40.865768 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d51357-db30-4eb9-8b62-42f3ef72432d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:40.866375 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d51357-db30-4eb9-8b62-42f3ef72432d None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:40.866664 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d51357-db30-4eb9-8b62-42f3ef72432d None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:40.866940 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d51357-db30-4eb9-8b62-42f3ef72432d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:40.876741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d51357-db30-4eb9-8b62-42f3ef72432d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:37:40.881639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-75d51357-db30-4eb9-8b62-42f3ef72432d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:37:40.881639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:40.881639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:40.881639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:40.881639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:40.881639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:40.881639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:40.881639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:40.881639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:40.881639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:40.881639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:40.881639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:40.881639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:37:40.881639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:37:40.881639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:37:40.881639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:37:40.882859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:37:40.882859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:37:40.882859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:37:40.882859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:37:40.882859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:40.882859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:40.882859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:40.882859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:40.882859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:40.882859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:40.882859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:40.882859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:40.882859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:40.882859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:40.882859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:40.882859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:40.883979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:40.883979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:40.883979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:40.883979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:40.883979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:37:40.883979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:37:40.883979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:37:40.883979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:37:40.883979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:37:40.883979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:37:40.883979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:37:40.883979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:40.883979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 571/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:37:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:40.888932 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edbaff-26e6-4d2c-99cd-933785df952f None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:40.984978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1edbaff-26e6-4d2c-99cd-933785df952f None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:41.017659 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f448e-0890-4d88-aa64-9c96dd9385d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:41.018264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f448e-0890-4d88-aa64-9c96dd9385d2 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:41.018579 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f448e-0890-4d88-aa64-9c96dd9385d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:41.018860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4f448e-0890-4d88-aa64-9c96dd9385d2 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:41.019570 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f448e-0890-4d88-aa64-9c96dd9385d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:41.019877 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f448e-0890-4d88-aa64-9c96dd9385d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:41.021234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4f448e-0890-4d88-aa64-9c96dd9385d2 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:41.026599 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:41.030257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 571/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:37:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:41.035753 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d51357-db30-4eb9-8b62-42f3ef72432d None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:41.132398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:41.135576 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d51357-db30-4eb9-8b62-42f3ef72432d None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:41.168850 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da984d3-2228-4cbe-bdd4-b028f4004294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:41.169482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da984d3-2228-4cbe-bdd4-b028f4004294 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:41.169765 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da984d3-2228-4cbe-bdd4-b028f4004294 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:41.170041 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da984d3-2228-4cbe-bdd4-b028f4004294 None admin] PATH_INFO: `/v3/users/81002d31a00c432983a70257dcc7d3ab` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:41.182559 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da984d3-2228-4cbe-bdd4-b028f4004294 None admin] RBAC: Authorizing `identity:get_user(user_id=81002d31a00c432983a70257dcc7d3ab)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:41.183986 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da984d3-2228-4cbe-bdd4-b028f4004294 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:41.185578 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 572/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:37:41 2022] GET /identity/v3/users/81002d31a00c432983a70257dcc7d3ab => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:41.191379 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f448e-0890-4d88-aa64-9c96dd9385d2 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:41.288435 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4f448e-0890-4d88-aa64-9c96dd9385d2 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:41.320658 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4aaa58-12f5-4138-a550-75fef3d39de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:41.321264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4aaa58-12f5-4138-a550-75fef3d39de2 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:41.321552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4aaa58-12f5-4138-a550-75fef3d39de2 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:41.321829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4aaa58-12f5-4138-a550-75fef3d39de2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:41.386197 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:41.388713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4aaa58-12f5-4138-a550-75fef3d39de2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:41.390506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4aaa58-12f5-4138-a550-75fef3d39de2 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:41.485173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 572/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:37:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 22:37:41.491015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da984d3-2228-4cbe-bdd4-b028f4004294 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:41.588141 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da984d3-2228-4cbe-bdd4-b028f4004294 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:41.620984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2669b034-f942-4d7f-8c38-c8fbc6a01f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:41.621623 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b034-f942-4d7f-8c38-c8fbc6a01f18 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:41.621909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b034-f942-4d7f-8c38-c8fbc6a01f18 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:41.622187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2669b034-f942-4d7f-8c38-c8fbc6a01f18 None admin] PATH_INFO: `/v3/projects/f54863d3c8f14fe18b210870dba68808` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:41.623368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669b034-f942-4d7f-8c38-c8fbc6a01f18 None admin] RBAC: Authorizing `identity:get_project(project_id=f54863d3c8f14fe18b210870dba68808)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:41.624787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2669b034-f942-4d7f-8c38-c8fbc6a01f18 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:41.626452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 573/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:37:41 2022] GET /identity/v3/projects/f54863d3c8f14fe18b210870dba68808 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:41.633119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4aaa58-12f5-4138-a550-75fef3d39de2 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:41.725484 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:41.728619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4aaa58-12f5-4138-a550-75fef3d39de2 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:41.762440 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a89085-d8c4-470f-8bf9-0723a7841de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:41.763054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a89085-d8c4-470f-8bf9-0723a7841de0 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:41.763340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a89085-d8c4-470f-8bf9-0723a7841de0 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:41.763621 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a89085-d8c4-470f-8bf9-0723a7841de0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:41.764404 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a89085-d8c4-470f-8bf9-0723a7841de0 None admin] RBAC: Adding query filter params (role.id=49e0ba8d8c9f4824892b61f05d0036e8, scope.project.id=f54863d3c8f14fe18b210870dba68808, user.id=81002d31a00c432983a70257dcc7d3ab) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:41.764719 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a89085-d8c4-470f-8bf9-0723a7841de0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:41.766134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a89085-d8c4-470f-8bf9-0723a7841de0 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:41.771437 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 573/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:37:41 2022] GET /identity/v3/role_assignments?user.id=81002d31a00c432983a70257dcc7d3ab&scope.project.id=f54863d3c8f14fe18b210870dba68808&role.id=49e0ba8d8c9f4824892b61f05d0036e8 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:43.715661 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28754480-d699-4239-8e41-bb66d83a8266 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:43.716188 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28754480-d699-4239-8e41-bb66d83a8266 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:43.716299 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28754480-d699-4239-8e41-bb66d83a8266 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:43.717549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 574/1147] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:43.722599 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba3c1a-36db-41d8-888e-672c132cd06f None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:43.722978 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba3c1a-36db-41d8-888e-672c132cd06f None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:43.723150 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba3c1a-36db-41d8-888e-672c132cd06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:43.741291 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-2bba3c1a-36db-41d8-888e-672c132cd06f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:43.742521 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-2bba3c1a-36db-41d8-888e-672c132cd06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:43.806216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 574/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:37:43.827856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28754480-d699-4239-8e41-bb66d83a8266 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:43.855315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:43.928034 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28754480-d699-4239-8e41-bb66d83a8266 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:43.960491 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1058a-32e4-417d-94fd-4fa5dfc858fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:43.961646 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1058a-32e4-417d-94fd-4fa5dfc858fe None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:43.961930 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1058a-32e4-417d-94fd-4fa5dfc858fe None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:43.962205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1058a-32e4-417d-94fd-4fa5dfc858fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:43.971968 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1058a-32e4-417d-94fd-4fa5dfc858fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:37:43.977496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-23c1058a-32e4-417d-94fd-4fa5dfc858fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:37:43.977496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:43.977496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:43.977496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:43.977496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:43.977496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:43.977496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:43.977496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:43.977496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:43.977496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:43.977496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:43.977496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:43.977496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:37:43.977496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:37:43.977496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:37:43.977496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:37:43.978605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:37:43.978605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:37:43.978605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:37:43.978605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:37:43.978605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:43.978605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:43.978605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:43.978605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:43.978605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:43.978605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:43.978605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:43.978605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:43.978605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:43.978605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:43.978605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:43.978605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:43.979651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:43.979651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:43.979651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:43.979651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:43.979651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:37:43.979651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:37:43.979651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:37:43.979651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:37:43.979651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:37:43.979651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:37:43.979651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:37:43.979651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:43.979651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 575/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:37:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:43.984704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba3c1a-36db-41d8-888e-672c132cd06f None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:44.073711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:44.080988 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba3c1a-36db-41d8-888e-672c132cd06f None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:44.113871 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41211d8b-2488-434a-9900-14a9fad57728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:44.114450 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41211d8b-2488-434a-9900-14a9fad57728 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:44.114738 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41211d8b-2488-434a-9900-14a9fad57728 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:44.115015 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41211d8b-2488-434a-9900-14a9fad57728 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:44.115723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41211d8b-2488-434a-9900-14a9fad57728 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:44.116031 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41211d8b-2488-434a-9900-14a9fad57728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:44.117401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41211d8b-2488-434a-9900-14a9fad57728 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:44.125133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 575/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:37:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:44.130850 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1058a-32e4-417d-94fd-4fa5dfc858fe None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:44.214711 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:44.229022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1058a-32e4-417d-94fd-4fa5dfc858fe None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:44.261439 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef8f6d-c313-49e3-abb5-741c4ce32e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:44.262062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef8f6d-c313-49e3-abb5-741c4ce32e79 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:44.262374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef8f6d-c313-49e3-abb5-741c4ce32e79 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:44.262647 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef8f6d-c313-49e3-abb5-741c4ce32e79 None admin] PATH_INFO: `/v3/users/81002d31a00c432983a70257dcc7d3ab` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:44.263787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef8f6d-c313-49e3-abb5-741c4ce32e79 None admin] RBAC: Authorizing `identity:get_user(user_id=81002d31a00c432983a70257dcc7d3ab)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:44.265198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef8f6d-c313-49e3-abb5-741c4ce32e79 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:44.266790 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 576/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:37:44 2022] GET /identity/v3/users/81002d31a00c432983a70257dcc7d3ab => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:44.272508 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41211d8b-2488-434a-9900-14a9fad57728 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:44.369576 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41211d8b-2488-434a-9900-14a9fad57728 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:44.402446 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab267eb8-6f6a-4567-94b7-c0cd3e6e833c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:44.403074 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab267eb8-6f6a-4567-94b7-c0cd3e6e833c None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:44.403360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab267eb8-6f6a-4567-94b7-c0cd3e6e833c None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:44.403640 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab267eb8-6f6a-4567-94b7-c0cd3e6e833c None admin] PATH_INFO: `/v3/projects/f54863d3c8f14fe18b210870dba68808` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:44.404788 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab267eb8-6f6a-4567-94b7-c0cd3e6e833c None admin] RBAC: Authorizing `identity:get_project(project_id=f54863d3c8f14fe18b210870dba68808)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:44.406210 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab267eb8-6f6a-4567-94b7-c0cd3e6e833c None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:44.407866 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 576/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:37:44 2022] GET /identity/v3/projects/f54863d3c8f14fe18b210870dba68808 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:44.413457 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef8f6d-c313-49e3-abb5-741c4ce32e79 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:44.509504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef8f6d-c313-49e3-abb5-741c4ce32e79 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:44.541419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d451e-3bbd-4846-82bc-ee0d3aa217a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:44.542070 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d451e-3bbd-4846-82bc-ee0d3aa217a5 None admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:44.542366 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d451e-3bbd-4846-82bc-ee0d3aa217a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:44.542651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d451e-3bbd-4846-82bc-ee0d3aa217a5 None admin] PATH_INFO: `/v3/projects/f54863d3c8f14fe18b210870dba68808/users/81002d31a00c432983a70257dcc7d3ab/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:44.544552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d451e-3bbd-4846-82bc-ee0d3aa217a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f54863d3c8f14fe18b210870dba68808, user_id=81002d31a00c432983a70257dcc7d3ab, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:44.545955 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d451e-3bbd-4846-82bc-ee0d3aa217a5 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:44.558919 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 577/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:37:44 2022] PUT /identity/v3/projects/f54863d3c8f14fe18b210870dba68808/users/81002d31a00c432983a70257dcc7d3ab/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:37:46.493817 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9985c97-da1e-4934-883c-ecd45fa6e354 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:46.494396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9985c97-da1e-4934-883c-ecd45fa6e354 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:46.494396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9985c97-da1e-4934-883c-ecd45fa6e354 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:46.495745 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 577/1154] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:46.500830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc452b0-dea3-4b61-a90a-12af59ea818a None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:46.501228 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc452b0-dea3-4b61-a90a-12af59ea818a None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:46.501393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc452b0-dea3-4b61-a90a-12af59ea818a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:46.519005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-7fc452b0-dea3-4b61-a90a-12af59ea818a None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:46.520190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-7fc452b0-dea3-4b61-a90a-12af59ea818a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:46.529596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:46.587322 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 578/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:46.610364 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9985c97-da1e-4934-883c-ecd45fa6e354 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:46.635678 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:46.709068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9985c97-da1e-4934-883c-ecd45fa6e354 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:46.743463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2d583-e95c-4cff-b5c0-868dd74f72fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:46.744145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2d583-e95c-4cff-b5c0-868dd74f72fb None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:46.744378 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2d583-e95c-4cff-b5c0-868dd74f72fb None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:46.744656 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2d583-e95c-4cff-b5c0-868dd74f72fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:46.754752 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2d583-e95c-4cff-b5c0-868dd74f72fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:37:46.759756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-26c2d583-e95c-4cff-b5c0-868dd74f72fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:37:46.759756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:46.759756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:46.759756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:46.759756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:46.759756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:46.759756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:46.759756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:46.759756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:46.759756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:46.759756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:46.759756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:46.759756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:37:46.759756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:37:46.759756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:37:46.759756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:37:46.761575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:37:46.761575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:37:46.761575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:37:46.761575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:37:46.761575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:46.761575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:46.761575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:46.761575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:46.761575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:46.761575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:46.761575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:46.761575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:46.761575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:46.761575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:46.761575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:46.761575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:46.763404 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:46.763404 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:46.763404 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:46.763404 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:46.763404 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:37:46.763404 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:37:46.763404 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:37:46.763404 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:37:46.763404 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:37:46.763404 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:37:46.763404 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:37:46.763404 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:46.763404 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 578/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:37:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:46.766945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc452b0-dea3-4b61-a90a-12af59ea818a None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:46.861313 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc452b0-dea3-4b61-a90a-12af59ea818a None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:46.894043 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197cce9-5d2a-43c9-920e-9f50df9cf308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:46.894684 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197cce9-5d2a-43c9-920e-9f50df9cf308 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:46.894967 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197cce9-5d2a-43c9-920e-9f50df9cf308 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:46.895243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197cce9-5d2a-43c9-920e-9f50df9cf308 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:46.895957 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197cce9-5d2a-43c9-920e-9f50df9cf308 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:46.896264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197cce9-5d2a-43c9-920e-9f50df9cf308 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:46.897613 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197cce9-5d2a-43c9-920e-9f50df9cf308 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:46.905875 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 579/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:37:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:46.911532 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2d583-e95c-4cff-b5c0-868dd74f72fb None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:46.993284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:47.008757 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2d583-e95c-4cff-b5c0-868dd74f72fb None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:47.041070 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af54a73-6fd8-4aea-8749-baf7cdbb095c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:47.041695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af54a73-6fd8-4aea-8749-baf7cdbb095c None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:47.041975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af54a73-6fd8-4aea-8749-baf7cdbb095c None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:47.042249 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af54a73-6fd8-4aea-8749-baf7cdbb095c None admin] PATH_INFO: `/v3/users/81002d31a00c432983a70257dcc7d3ab` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:47.043420 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af54a73-6fd8-4aea-8749-baf7cdbb095c None admin] RBAC: Authorizing `identity:get_user(user_id=81002d31a00c432983a70257dcc7d3ab)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:47.044833 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af54a73-6fd8-4aea-8749-baf7cdbb095c None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:47.046422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 579/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:37:46 2022] GET /identity/v3/users/81002d31a00c432983a70257dcc7d3ab => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:47.052128 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197cce9-5d2a-43c9-920e-9f50df9cf308 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:47.061057 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:47.148602 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197cce9-5d2a-43c9-920e-9f50df9cf308 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:47.180241 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b8391-2768-4246-9ce5-a7df590bb584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:47.180845 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b8391-2768-4246-9ce5-a7df590bb584 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:47.181129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b8391-2768-4246-9ce5-a7df590bb584 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:47.181405 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b8391-2768-4246-9ce5-a7df590bb584 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:47.246916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b8391-2768-4246-9ce5-a7df590bb584 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:47.248346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b8391-2768-4246-9ce5-a7df590bb584 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:47.255514 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:47.343714 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 580/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:37:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 22:37:47.349443 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af54a73-6fd8-4aea-8749-baf7cdbb095c None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:47.442904 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af54a73-6fd8-4aea-8749-baf7cdbb095c None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:47.475245 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85d5b1-f90b-42a4-908c-e7c30774415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:47.475863 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85d5b1-f90b-42a4-908c-e7c30774415f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:47.476177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85d5b1-f90b-42a4-908c-e7c30774415f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:47.476453 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85d5b1-f90b-42a4-908c-e7c30774415f None admin] PATH_INFO: `/v3/projects/f54863d3c8f14fe18b210870dba68808` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:47.477574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85d5b1-f90b-42a4-908c-e7c30774415f None admin] RBAC: Authorizing `identity:get_project(project_id=f54863d3c8f14fe18b210870dba68808)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:47.479010 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85d5b1-f90b-42a4-908c-e7c30774415f None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:47.480611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 580/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:37:47 2022] GET /identity/v3/projects/f54863d3c8f14fe18b210870dba68808 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:47.486463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b8391-2768-4246-9ce5-a7df590bb584 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:47.582700 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b8391-2768-4246-9ce5-a7df590bb584 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:47.590058 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:47.616135 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb83789-a0ce-4b05-8b8b-3fbddf58cecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:47.617300 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb83789-a0ce-4b05-8b8b-3fbddf58cecd None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:47.617586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb83789-a0ce-4b05-8b8b-3fbddf58cecd None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:47.617861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb83789-a0ce-4b05-8b8b-3fbddf58cecd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:47.618684 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb83789-a0ce-4b05-8b8b-3fbddf58cecd None admin] RBAC: Adding query filter params (role.id=49e0ba8d8c9f4824892b61f05d0036e8, scope.project.id=f54863d3c8f14fe18b210870dba68808, user.id=81002d31a00c432983a70257dcc7d3ab) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:47.618998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb83789-a0ce-4b05-8b8b-3fbddf58cecd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:47.620419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb83789-a0ce-4b05-8b8b-3fbddf58cecd None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:47.626025 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 581/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:37:47 2022] GET /identity/v3/role_assignments?user.id=81002d31a00c432983a70257dcc7d3ab&scope.project.id=f54863d3c8f14fe18b210870dba68808&role.id=49e0ba8d8c9f4824892b61f05d0036e8 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:49.645909 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38413bf6-43f1-41e4-9412-5062ec5cf003 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:49.646494 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38413bf6-43f1-41e4-9412-5062ec5cf003 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:49.646494 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38413bf6-43f1-41e4-9412-5062ec5cf003 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:49.652570 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 581/1162] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:49.658042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07ac5b-707a-4e1b-b48b-637a8f826f43 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:49.658521 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07ac5b-707a-4e1b-b48b-637a8f826f43 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:49.658620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07ac5b-707a-4e1b-b48b-637a8f826f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:49.676469 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-8c07ac5b-707a-4e1b-b48b-637a8f826f43 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:49.677661 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8c07ac5b-707a-4e1b-b48b-637a8f826f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:49.745969 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 582/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:37:49.768317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38413bf6-43f1-41e4-9412-5062ec5cf003 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:49.789790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:49.868653 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38413bf6-43f1-41e4-9412-5062ec5cf003 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:49.901095 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6392d38-3b8c-445e-9e0d-cf751890479e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:49.901701 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6392d38-3b8c-445e-9e0d-cf751890479e None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:49.901989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6392d38-3b8c-445e-9e0d-cf751890479e None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:49.902270 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6392d38-3b8c-445e-9e0d-cf751890479e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:49.971513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6392d38-3b8c-445e-9e0d-cf751890479e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:49.973458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6392d38-3b8c-445e-9e0d-cf751890479e None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:49.997431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:50.073153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 582/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:37:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 22:37:50.079518 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07ac5b-707a-4e1b-b48b-637a8f826f43 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:50.171658 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:50.174714 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07ac5b-707a-4e1b-b48b-637a8f826f43 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:50.207633 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d17e1f-37b0-4cfc-bb54-e8045bcdbefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:50.208267 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d17e1f-37b0-4cfc-bb54-e8045bcdbefa None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:50.208551 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d17e1f-37b0-4cfc-bb54-e8045bcdbefa None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:50.208828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d17e1f-37b0-4cfc-bb54-e8045bcdbefa None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:50.215476 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d17e1f-37b0-4cfc-bb54-e8045bcdbefa None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:50.216905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d17e1f-37b0-4cfc-bb54-e8045bcdbefa None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:50.228603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-c4d17e1f-37b0-4cfc-bb54-e8045bcdbefa None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 22:37:50.228603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:50.228603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 27 22:37:50.228603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 27 22:37:50.228603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:37:50.228603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:37:50.228603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:37:50.228603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:37:50.228603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 27 22:37:50.228603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:50.228603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:37:50.228603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:50.228603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:50.228603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:50.228603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:50.228603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:50.228603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:50.229878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:50.229878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:50.229878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:50.229878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:50.229878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:50.229878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:50.229878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:37:50.229878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:37:50.229878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:37:50.229878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:37:50.229878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:50.229878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:50.229878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:50.229878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:50.229878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:50.229878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:50.231085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:50.231085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:50.231085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:50.231085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:50.231085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:50.231085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:50.231085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:50.231085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:50.231085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:50.231085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:50.231085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 27 22:37:50.231085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:37:50.231085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 22:37:50.231085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:37:50.231085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 583/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jul 27 22:37:50 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:50.235576 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6392d38-3b8c-445e-9e0d-cf751890479e None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:50.339547 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6392d38-3b8c-445e-9e0d-cf751890479e None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:50.358999 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:50.373080 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5ff5f9-a8e5-43f4-beb7-2b8fcc02e21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:50.373696 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ff5f9-a8e5-43f4-beb7-2b8fcc02e21a None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:50.373983 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ff5f9-a8e5-43f4-beb7-2b8fcc02e21a None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:50.374263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5ff5f9-a8e5-43f4-beb7-2b8fcc02e21a None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:50.374982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ff5f9-a8e5-43f4-beb7-2b8fcc02e21a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:50.375297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ff5f9-a8e5-43f4-beb7-2b8fcc02e21a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:50.376654 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5ff5f9-a8e5-43f4-beb7-2b8fcc02e21a None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:50.383635 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 583/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Wed Jul 27 22:37:50 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:52.362849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650dffe-4882-4d71-9754-24e83bd1ca45 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:52.363408 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650dffe-4882-4d71-9754-24e83bd1ca45 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:52.363408 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650dffe-4882-4d71-9754-24e83bd1ca45 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:52.364748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 584/1167] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:52.369820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ea9f9-09b1-4a31-923d-28265c7151f2 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:52.370243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ea9f9-09b1-4a31-923d-28265c7151f2 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:52.370408 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ea9f9-09b1-4a31-923d-28265c7151f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:52.388394 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-c54ea9f9-09b1-4a31-923d-28265c7151f2 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:52.389585 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c54ea9f9-09b1-4a31-923d-28265c7151f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:52.453281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 584/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:52.475079 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650dffe-4882-4d71-9754-24e83bd1ca45 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:52.573070 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650dffe-4882-4d71-9754-24e83bd1ca45 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:52.606888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09390c-c48f-4af6-8321-b7078a8972fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:52.607508 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09390c-c48f-4af6-8321-b7078a8972fc None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:52.607795 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09390c-c48f-4af6-8321-b7078a8972fc None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:52.608077 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09390c-c48f-4af6-8321-b7078a8972fc None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:52.608795 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09390c-c48f-4af6-8321-b7078a8972fc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:52.610155 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09390c-c48f-4af6-8321-b7078a8972fc None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:52.625679 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 585/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Wed Jul 27 22:37:52 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:37:54.634711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143a53-8503-4f0d-b0d2-a7a8950eabd3 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:54.635241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143a53-8503-4f0d-b0d2-a7a8950eabd3 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:54.635241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54143a53-8503-4f0d-b0d2-a7a8950eabd3 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:54.636622 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 585/1170] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:54.641912 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f8d8c-52ce-43e1-b611-a06e2eb7a81e None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:54.642364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f8d8c-52ce-43e1-b611-a06e2eb7a81e None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:54.642527 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f8d8c-52ce-43e1-b611-a06e2eb7a81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:54.661085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-ee3f8d8c-52ce-43e1-b611-a06e2eb7a81e None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:54.662282 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ee3f8d8c-52ce-43e1-b611-a06e2eb7a81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:54.676538 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:54.731980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 586/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:54.754758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54143a53-8503-4f0d-b0d2-a7a8950eabd3 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:54.857915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54143a53-8503-4f0d-b0d2-a7a8950eabd3 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:54.871449 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:54.891650 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035cce1e-ab70-4345-a4f9-495d1dba1bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:54.892294 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cce1e-ab70-4345-a4f9-495d1dba1bc8 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:54.892580 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cce1e-ab70-4345-a4f9-495d1dba1bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:54.892859 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035cce1e-ab70-4345-a4f9-495d1dba1bc8 None admin] PATH_INFO: `/v3/domains/7f461ca01c6643ec8633db43a983b4cd` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:54.903606 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cce1e-ab70-4345-a4f9-495d1dba1bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=7f461ca01c6643ec8633db43a983b4cd)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:54.905043 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035cce1e-ab70-4345-a4f9-495d1dba1bc8 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:54.906672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 586/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Wed Jul 27 22:37:54 2022] GET /identity/v3/domains/7f461ca01c6643ec8633db43a983b4cd => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:54.912665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f8d8c-52ce-43e1-b611-a06e2eb7a81e None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:55.011000 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3f8d8c-52ce-43e1-b611-a06e2eb7a81e None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:55.043444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2152cc-ed95-4391-8b23-c212414ccdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:55.044050 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2152cc-ed95-4391-8b23-c212414ccdf7 None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:55.044328 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2152cc-ed95-4391-8b23-c212414ccdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:55.044598 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2152cc-ed95-4391-8b23-c212414ccdf7 None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:55.045263 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2152cc-ed95-4391-8b23-c212414ccdf7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:55.046693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2152cc-ed95-4391-8b23-c212414ccdf7 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:55.072608 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 587/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 22:37:54 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:37:57.071981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baf610-62f1-4200-917d-8753905055f9 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:57.072507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baf610-62f1-4200-917d-8753905055f9 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:57.072507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baf610-62f1-4200-917d-8753905055f9 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:57.073863 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 587/1174] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:57.079301 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135f55d-a82e-443b-9732-6cb9b673f683 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:57.079744 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135f55d-a82e-443b-9732-6cb9b673f683 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:57.079870 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135f55d-a82e-443b-9732-6cb9b673f683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:57.086140 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:57.099221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-6135f55d-a82e-443b-9732-6cb9b673f683 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:57.100407 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6135f55d-a82e-443b-9732-6cb9b673f683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:57.169689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 588/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:57.194366 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baf610-62f1-4200-917d-8753905055f9 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:57.293082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baf610-62f1-4200-917d-8753905055f9 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:57.324396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b4b53-d66f-451e-95b8-1b01e11aae9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:57.324983 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b4b53-d66f-451e-95b8-1b01e11aae9c None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:57.325264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b4b53-d66f-451e-95b8-1b01e11aae9c None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:57.325537 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b4b53-d66f-451e-95b8-1b01e11aae9c None admin] PATH_INFO: `/v3/domains/7f461ca01c6643ec8633db43a983b4cd` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:57.326698 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b4b53-d66f-451e-95b8-1b01e11aae9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=7f461ca01c6643ec8633db43a983b4cd)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:57.328362 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b4b53-d66f-451e-95b8-1b01e11aae9c None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:57.329894 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 588/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Wed Jul 27 22:37:57 2022] GET /identity/v3/domains/7f461ca01c6643ec8633db43a983b4cd => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:57.335925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135f55d-a82e-443b-9732-6cb9b673f683 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:57.429802 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135f55d-a82e-443b-9732-6cb9b673f683 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:57.457330 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:57.462711 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750e677-2a88-43e1-8898-4286c6f73592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:57.463320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750e677-2a88-43e1-8898-4286c6f73592 None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:57.463600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750e677-2a88-43e1-8898-4286c6f73592 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:57.463875 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750e677-2a88-43e1-8898-4286c6f73592 None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:57.464553 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750e677-2a88-43e1-8898-4286c6f73592 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:57.465966 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a750e677-2a88-43e1-8898-4286c6f73592 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:57.486281 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 589/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 22:37:57 2022] POST /identity/v3/users => generated 311 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:37:59.506848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e21c15-9ab9-4f86-8650-638abb078bbf None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:59.507378 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e21c15-9ab9-4f86-8650-638abb078bbf None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:59.507472 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e21c15-9ab9-4f86-8650-638abb078bbf None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:59.508787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 589/1178] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:37:59.513848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf991a-d127-41fc-bbcd-0568412256f9 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:59.514251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf991a-d127-41fc-bbcd-0568412256f9 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:59.514433 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf991a-d127-41fc-bbcd-0568412256f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:59.532651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-56cf991a-d127-41fc-bbcd-0568412256f9 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:37:59.533840 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-56cf991a-d127-41fc-bbcd-0568412256f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:37:59.598992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 590/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:37:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:37:59.622152 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e21c15-9ab9-4f86-8650-638abb078bbf None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:59.665742 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:59.721397 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e21c15-9ab9-4f86-8650-638abb078bbf None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:59.754038 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ece07-5a35-4ae4-8b69-8fcc757b0b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:59.754694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ece07-5a35-4ae4-8b69-8fcc757b0b11 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:59.754983 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ece07-5a35-4ae4-8b69-8fcc757b0b11 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:59.755264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ece07-5a35-4ae4-8b69-8fcc757b0b11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:59.766105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ece07-5a35-4ae4-8b69-8fcc757b0b11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:37:59.770957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-291ece07-5a35-4ae4-8b69-8fcc757b0b11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:37:59.770957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:37:59.770957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:37:59.770957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:37:59.770957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:37:59.770957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:37:59.770957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:37:59.770957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:37:59.770957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:37:59.770957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:37:59.770957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:37:59.770957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:37:59.770957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:37:59.770957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:37:59.770957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:37:59.770957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:37:59.772068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:37:59.772068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:37:59.772068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:37:59.772068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:37:59.772068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:37:59.772068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:37:59.772068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:37:59.772068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:37:59.772068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:37:59.772068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:37:59.772068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:37:59.772068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:37:59.772068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:37:59.772068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:37:59.772068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:37:59.772068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:37:59.773478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:37:59.773478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:37:59.773478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:37:59.773478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:37:59.773478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:37:59.773478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:37:59.773478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:37:59.773478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:37:59.773478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:37:59.773478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:37:59.773478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:37:59.773478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:37:59.773478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 590/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:37:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:37:59.778558 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf991a-d127-41fc-bbcd-0568412256f9 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:37:59.875291 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf991a-d127-41fc-bbcd-0568412256f9 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:37:59.892222 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:37:59.910246 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36e954-128e-47a2-9b00-187f7df8a2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:37:59.910901 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36e954-128e-47a2-9b00-187f7df8a2a5 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:37:59.911190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36e954-128e-47a2-9b00-187f7df8a2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:37:59.911469 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c36e954-128e-47a2-9b00-187f7df8a2a5 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:37:59.912190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36e954-128e-47a2-9b00-187f7df8a2a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:37:59.912499 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36e954-128e-47a2-9b00-187f7df8a2a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:37:59.913855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c36e954-128e-47a2-9b00-187f7df8a2a5 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:37:59.921731 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 591/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:37:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:37:59.927324 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ece07-5a35-4ae4-8b69-8fcc757b0b11 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:38:00.023502 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ece07-5a35-4ae4-8b69-8fcc757b0b11 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:38:00.024918 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:38:00.056437 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339224b8-7d47-4ddb-8a4d-25f208e5887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:38:00.057063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339224b8-7d47-4ddb-8a4d-25f208e5887c None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:38:00.057349 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339224b8-7d47-4ddb-8a4d-25f208e5887c None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:38:00.057629 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339224b8-7d47-4ddb-8a4d-25f208e5887c None admin] PATH_INFO: `/v3/users/aac4c03f58d644f4910003f206ff7987` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:38:00.070660 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339224b8-7d47-4ddb-8a4d-25f208e5887c None admin] RBAC: Authorizing `identity:get_user(user_id=aac4c03f58d644f4910003f206ff7987)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:38:00.072091 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339224b8-7d47-4ddb-8a4d-25f208e5887c None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:38:00.073689 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 591/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:37:59 2022] GET /identity/v3/users/aac4c03f58d644f4910003f206ff7987 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:38:00.079594 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36e954-128e-47a2-9b00-187f7df8a2a5 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:38:00.176780 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c36e954-128e-47a2-9b00-187f7df8a2a5 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:38:00.209389 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e996f-3e4c-42c4-9080-62f3d754ef2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:38:00.209995 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e996f-3e4c-42c4-9080-62f3d754ef2b None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:38:00.210884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e996f-3e4c-42c4-9080-62f3d754ef2b None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:38:00.211166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e996f-3e4c-42c4-9080-62f3d754ef2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:38:00.256645 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:38:00.280911 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e996f-3e4c-42c4-9080-62f3d754ef2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:38:00.282284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e996f-3e4c-42c4-9080-62f3d754ef2b None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:38:00.377069 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 592/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:38:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 22:38:00.383596 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339224b8-7d47-4ddb-8a4d-25f208e5887c None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:38:00.478152 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339224b8-7d47-4ddb-8a4d-25f208e5887c None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:38:00.511655 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38c409-c8fa-448a-b9a7-c8b94142a316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:38:00.512290 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38c409-c8fa-448a-b9a7-c8b94142a316 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:38:00.512576 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38c409-c8fa-448a-b9a7-c8b94142a316 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:38:00.512859 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38c409-c8fa-448a-b9a7-c8b94142a316 None admin] PATH_INFO: `/v3/projects/d82d94f8718a4377b687883d53a30316` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:38:00.514003 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38c409-c8fa-448a-b9a7-c8b94142a316 None admin] RBAC: Authorizing `identity:get_project(project_id=d82d94f8718a4377b687883d53a30316)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:38:00.515462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38c409-c8fa-448a-b9a7-c8b94142a316 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:38:00.517150 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 592/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:38:00 2022] GET /identity/v3/projects/d82d94f8718a4377b687883d53a30316 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:38:00.523171 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e996f-3e4c-42c4-9080-62f3d754ef2b None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:38:00.600424 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:38:00.620169 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e996f-3e4c-42c4-9080-62f3d754ef2b None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:38:00.652277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0e93e-4752-4d80-8470-576e97883d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:38:00.652886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0e93e-4752-4d80-8470-576e97883d71 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:38:00.653171 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0e93e-4752-4d80-8470-576e97883d71 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:38:00.653449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0e93e-4752-4d80-8470-576e97883d71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:38:00.654229 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0e93e-4752-4d80-8470-576e97883d71 None admin] RBAC: Adding query filter params (role.id=49e0ba8d8c9f4824892b61f05d0036e8, scope.project.id=d82d94f8718a4377b687883d53a30316, user.id=aac4c03f58d644f4910003f206ff7987) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:38:00.654578 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0e93e-4752-4d80-8470-576e97883d71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:38:00.656000 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0e93e-4752-4d80-8470-576e97883d71 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:38:00.661231 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 593/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:38:00 2022] GET /identity/v3/role_assignments?user.id=aac4c03f58d644f4910003f206ff7987&scope.project.id=d82d94f8718a4377b687883d53a30316&role.id=49e0ba8d8c9f4824892b61f05d0036e8 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:38:02.613455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e70f5-3694-4229-a83a-1f198edb063e None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:38:02.613946 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e70f5-3694-4229-a83a-1f198edb063e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:38:02.614046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e70f5-3694-4229-a83a-1f198edb063e None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:38:02.615398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 593/1186] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:38:02.621073 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b458f-2f0b-4baa-a719-4760721625b7 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:38:02.621463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b458f-2f0b-4baa-a719-4760721625b7 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:38:02.621625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670b458f-2f0b-4baa-a719-4760721625b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:38:02.639858 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-670b458f-2f0b-4baa-a719-4760721625b7 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:38:02.641030 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-670b458f-2f0b-4baa-a719-4760721625b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:38:02.704502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 594/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:38:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:38:02.726171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e70f5-3694-4229-a83a-1f198edb063e None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:38:02.753547 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:38:02.824186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e70f5-3694-4229-a83a-1f198edb063e None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:38:02.856591 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535cf3a-ebfe-43b9-8c08-6f5e816ae4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:38:02.857164 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535cf3a-ebfe-43b9-8c08-6f5e816ae4c8 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:38:02.857447 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535cf3a-ebfe-43b9-8c08-6f5e816ae4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:38:02.857725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535cf3a-ebfe-43b9-8c08-6f5e816ae4c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:38:02.867994 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535cf3a-ebfe-43b9-8c08-6f5e816ae4c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:38:02.872864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-7535cf3a-ebfe-43b9-8c08-6f5e816ae4c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:38:02.872864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:38:02.872864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:38:02.872864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:38:02.872864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:38:02.872864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:38:02.872864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:38:02.872864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:38:02.872864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:38:02.872864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:38:02.872864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:38:02.872864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:38:02.872864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:38:02.872864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:38:02.872864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:38:02.872864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:38:02.874045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:38:02.874045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:38:02.874045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:38:02.874045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:38:02.874045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:38:02.874045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:38:02.874045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:38:02.874045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:38:02.874045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:38:02.874045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:38:02.874045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:38:02.874045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:38:02.874045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:38:02.874045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:38:02.874045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:38:02.874045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:38:02.875072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:38:02.875072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:38:02.875072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:38:02.875072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:38:02.875072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:38:02.875072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:38:02.875072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:38:02.875072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:38:02.875072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:38:02.875072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:38:02.875072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:38:02.875072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:38:02.875072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 594/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:38:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:38:02.879813 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b458f-2f0b-4baa-a719-4760721625b7 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:38:02.950715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:38:02.979113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670b458f-2f0b-4baa-a719-4760721625b7 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:38:03.011939 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f1d44-3b93-468c-8bec-4bd7b2878988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:38:03.012550 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f1d44-3b93-468c-8bec-4bd7b2878988 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:38:03.012839 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f1d44-3b93-468c-8bec-4bd7b2878988 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:38:03.013119 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f1d44-3b93-468c-8bec-4bd7b2878988 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:38:03.013831 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f1d44-3b93-468c-8bec-4bd7b2878988 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:38:03.014141 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f1d44-3b93-468c-8bec-4bd7b2878988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:38:03.015530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f1d44-3b93-468c-8bec-4bd7b2878988 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:38:03.023283 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 595/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:38:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:38:03.028991 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535cf3a-ebfe-43b9-8c08-6f5e816ae4c8 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:38:03.114356 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:38:03.126699 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535cf3a-ebfe-43b9-8c08-6f5e816ae4c8 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:38:03.159164 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e3e16-2eaa-4777-b747-72827a033730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:38:03.159790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e3e16-2eaa-4777-b747-72827a033730 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:38:03.160073 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e3e16-2eaa-4777-b747-72827a033730 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:38:03.160350 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794e3e16-2eaa-4777-b747-72827a033730 None admin] PATH_INFO: `/v3/users/aac4c03f58d644f4910003f206ff7987` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:38:03.161488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e3e16-2eaa-4777-b747-72827a033730 None admin] RBAC: Authorizing `identity:get_user(user_id=aac4c03f58d644f4910003f206ff7987)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:38:03.162944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794e3e16-2eaa-4777-b747-72827a033730 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:38:03.165011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 595/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:38:03 2022] GET /identity/v3/users/aac4c03f58d644f4910003f206ff7987 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:38:03.170645 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f1d44-3b93-468c-8bec-4bd7b2878988 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:38:03.267145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f1d44-3b93-468c-8bec-4bd7b2878988 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:38:03.299575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b34d2ce-1c1a-44a9-8c63-f45500de9f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:38:03.300199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34d2ce-1c1a-44a9-8c63-f45500de9f92 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:38:03.300481 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34d2ce-1c1a-44a9-8c63-f45500de9f92 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:38:03.300758 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34d2ce-1c1a-44a9-8c63-f45500de9f92 None admin] PATH_INFO: `/v3/projects/d82d94f8718a4377b687883d53a30316` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:38:03.301884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34d2ce-1c1a-44a9-8c63-f45500de9f92 None admin] RBAC: Authorizing `identity:get_project(project_id=d82d94f8718a4377b687883d53a30316)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:38:03.303319 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b34d2ce-1c1a-44a9-8c63-f45500de9f92 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:38:03.304951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 596/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:38:03 2022] GET /identity/v3/projects/d82d94f8718a4377b687883d53a30316 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:38:03.310615 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e3e16-2eaa-4777-b747-72827a033730 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:38:03.416181 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794e3e16-2eaa-4777-b747-72827a033730 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:38:03.449100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b0c38-9ef1-46a6-b13d-c309616b7d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:38:03.449769 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b0c38-9ef1-46a6-b13d-c309616b7d3a None admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:38:03.450053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b0c38-9ef1-46a6-b13d-c309616b7d3a None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:38:03.450331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b0c38-9ef1-46a6-b13d-c309616b7d3a None admin] PATH_INFO: `/v3/projects/d82d94f8718a4377b687883d53a30316/users/aac4c03f58d644f4910003f206ff7987/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:38:03.452537 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b0c38-9ef1-46a6-b13d-c309616b7d3a None admin] RBAC: Authorizing `identity:create_grant(project_id=d82d94f8718a4377b687883d53a30316, user_id=aac4c03f58d644f4910003f206ff7987, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:38:03.453975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4b0c38-9ef1-46a6-b13d-c309616b7d3a None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:38:03.466945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 596/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:38:03 2022] PUT /identity/v3/projects/d82d94f8718a4377b687883d53a30316/users/aac4c03f58d644f4910003f206ff7987/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:38:05.482165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1fc61-8cab-4145-bf69-b0b1dd75be97 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:38:05.482757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1fc61-8cab-4145-bf69-b0b1dd75be97 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:38:05.482757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d1fc61-8cab-4145-bf69-b0b1dd75be97 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:38:05.484092 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 597/1193] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:38:05.489262 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bf316-f75c-4280-af7a-b6d32022dbdc None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:38:05.489685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bf316-f75c-4280-af7a-b6d32022dbdc None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:38:05.489820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bf316-f75c-4280-af7a-b6d32022dbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:38:05.508516 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-750bf316-f75c-4280-af7a-b6d32022dbdc None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:38:05.509692 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-750bf316-f75c-4280-af7a-b6d32022dbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:38:05.519999 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:38:05.574649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 597/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:38:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 22:38:05.597999 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1fc61-8cab-4145-bf69-b0b1dd75be97 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:38:05.601806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:38:05.716902 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d1fc61-8cab-4145-bf69-b0b1dd75be97 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:38:05.749371 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdf319-d88c-409b-b447-b4efa1bff881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:38:05.749946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdf319-d88c-409b-b447-b4efa1bff881 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:38:05.750232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdf319-d88c-409b-b447-b4efa1bff881 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:38:05.750542 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcdf319-d88c-409b-b447-b4efa1bff881 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:38:05.760863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcdf319-d88c-409b-b447-b4efa1bff881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:38:05.765815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-2bcdf319-d88c-409b-b447-b4efa1bff881 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:38:05.765815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:38:05.765815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:38:05.765815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:38:05.765815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:38:05.765815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:38:05.765815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:38:05.765815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:38:05.765815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:38:05.765815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:38:05.765815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:38:05.765815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:38:05.765815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:38:05.765815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:38:05.765815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:38:05.765815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:38:05.766964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:38:05.766964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:38:05.766964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:38:05.766964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:38:05.766964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:38:05.766964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:38:05.766964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:38:05.766964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:38:05.766964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:38:05.766964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:38:05.766964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:38:05.766964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:38:05.766964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:38:05.766964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:38:05.766964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:38:05.766964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:38:05.768046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:38:05.768046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:38:05.768046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:38:05.768046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:38:05.768046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:38:05.768046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:38:05.768046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:38:05.768046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:38:05.768046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:38:05.768046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:38:05.768046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:38:05.768046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:38:05.768046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 598/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:38:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:38:05.773194 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bf316-f75c-4280-af7a-b6d32022dbdc None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:38:05.870008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bf316-f75c-4280-af7a-b6d32022dbdc None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:38:05.901901 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c22eb-f40c-4e9a-9388-02c668a4e4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:38:05.902537 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c22eb-f40c-4e9a-9388-02c668a4e4bb None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:38:05.902826 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c22eb-f40c-4e9a-9388-02c668a4e4bb None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:38:05.903103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c22eb-f40c-4e9a-9388-02c668a4e4bb None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:38:05.903809 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c22eb-f40c-4e9a-9388-02c668a4e4bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:38:05.904116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c22eb-f40c-4e9a-9388-02c668a4e4bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:38:05.905476 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272c22eb-f40c-4e9a-9388-02c668a4e4bb None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:38:05.913652 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 598/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:38:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:38:05.919272 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdf319-d88c-409b-b447-b4efa1bff881 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:38:05.980220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:38:06.022232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcdf319-d88c-409b-b447-b4efa1bff881 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:38:06.055823 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd28b30-c332-49dc-8606-c552bb7e7d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:38:06.056459 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd28b30-c332-49dc-8606-c552bb7e7d65 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:38:06.056744 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd28b30-c332-49dc-8606-c552bb7e7d65 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:38:06.057026 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd28b30-c332-49dc-8606-c552bb7e7d65 None admin] PATH_INFO: `/v3/users/aac4c03f58d644f4910003f206ff7987` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:38:06.058176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd28b30-c332-49dc-8606-c552bb7e7d65 None admin] RBAC: Authorizing `identity:get_user(user_id=aac4c03f58d644f4910003f206ff7987)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:38:06.059642 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd28b30-c332-49dc-8606-c552bb7e7d65 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:38:06.061227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 599/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Wed Jul 27 22:38:05 2022] GET /identity/v3/users/aac4c03f58d644f4910003f206ff7987 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:38:06.067094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c22eb-f40c-4e9a-9388-02c668a4e4bb None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:38:06.078284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:38:06.162133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272c22eb-f40c-4e9a-9388-02c668a4e4bb None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:38:06.194442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7eb0ed-2633-4a98-8965-2576f145c3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:38:06.195046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7eb0ed-2633-4a98-8965-2576f145c3e2 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:38:06.195327 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7eb0ed-2633-4a98-8965-2576f145c3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:38:06.195600 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7eb0ed-2633-4a98-8965-2576f145c3e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:38:06.258869 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7eb0ed-2633-4a98-8965-2576f145c3e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:38:06.260289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7eb0ed-2633-4a98-8965-2576f145c3e2 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:38:06.269206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:38:06.365345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 599/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:38:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 22:38:06.371182 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd28b30-c332-49dc-8606-c552bb7e7d65 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:38:06.466255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd28b30-c332-49dc-8606-c552bb7e7d65 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:38:06.494487 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:38:06.500287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22046f4-c1b2-4752-9637-e7790aa29df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:38:06.500930 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22046f4-c1b2-4752-9637-e7790aa29df8 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:38:06.501213 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22046f4-c1b2-4752-9637-e7790aa29df8 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:38:06.501491 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22046f4-c1b2-4752-9637-e7790aa29df8 None admin] PATH_INFO: `/v3/projects/d82d94f8718a4377b687883d53a30316` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:38:06.502665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22046f4-c1b2-4752-9637-e7790aa29df8 None admin] RBAC: Authorizing `identity:get_project(project_id=d82d94f8718a4377b687883d53a30316)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:38:06.504081 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22046f4-c1b2-4752-9637-e7790aa29df8 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:38:06.505717 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 600/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Wed Jul 27 22:38:06 2022] GET /identity/v3/projects/d82d94f8718a4377b687883d53a30316 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:38:06.511802 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7eb0ed-2633-4a98-8965-2576f145c3e2 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:38:06.606728 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7eb0ed-2633-4a98-8965-2576f145c3e2 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:38:06.615665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:38:06.640070 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f09a3c-3a5f-4758-b1d6-312d47f8c954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:38:06.640677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f09a3c-3a5f-4758-b1d6-312d47f8c954 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:38:06.640960 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f09a3c-3a5f-4758-b1d6-312d47f8c954 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:38:06.641237 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f09a3c-3a5f-4758-b1d6-312d47f8c954 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:38:06.642009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f09a3c-3a5f-4758-b1d6-312d47f8c954 None admin] RBAC: Adding query filter params (role.id=49e0ba8d8c9f4824892b61f05d0036e8, scope.project.id=d82d94f8718a4377b687883d53a30316, user.id=aac4c03f58d644f4910003f206ff7987) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:38:06.642317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f09a3c-3a5f-4758-b1d6-312d47f8c954 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:38:06.643763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f09a3c-3a5f-4758-b1d6-312d47f8c954 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:38:06.649908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 600/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:38:06 2022] GET /identity/v3/role_assignments?user.id=aac4c03f58d644f4910003f206ff7987&scope.project.id=d82d94f8718a4377b687883d53a30316&role.id=49e0ba8d8c9f4824892b61f05d0036e8 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:38:16.646765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=14 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:01.565632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594854c-2992-423e-a3fd-ea0b45b0dd45 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:01.566240 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594854c-2992-423e-a3fd-ea0b45b0dd45 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:01.566240 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594854c-2992-423e-a3fd-ea0b45b0dd45 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:01.568296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 601/1201] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:39:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:39:01.574360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20742be2-3029-43c2-95f5-921e2ee82df2 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:01.575303 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20742be2-3029-43c2-95f5-921e2ee82df2 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:01.575802 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20742be2-3029-43c2-95f5-921e2ee82df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:01.598775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-20742be2-3029-43c2-95f5-921e2ee82df2 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:39:01.600587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-20742be2-3029-43c2-95f5-921e2ee82df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:39:01.686378 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 601/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:39:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:39:01.712955 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594854c-2992-423e-a3fd-ea0b45b0dd45 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:01.868063 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594854c-2992-423e-a3fd-ea0b45b0dd45 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:01.921940 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750084d-6a09-4049-ad6f-6428ffd6e5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:01.922652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750084d-6a09-4049-ad6f-6428ffd6e5b2 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:01.923032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750084d-6a09-4049-ad6f-6428ffd6e5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:01.923349 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750084d-6a09-4049-ad6f-6428ffd6e5b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:01.936047 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750084d-6a09-4049-ad6f-6428ffd6e5b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:01.937669 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9750084d-6a09-4049-ad6f-6428ffd6e5b2 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:01.955327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-9750084d-6a09-4049-ad6f-6428ffd6e5b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:01.955327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:01.955327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:01.955327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:01.955327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:01.955327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:01.955327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:01.955327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:01.955327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:01.955327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:01.955327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:01.955327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:01.955327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:39:01.955327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:39:01.955327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:39:01.957113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:39:01.957113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:01.957113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:01.957113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:01.957113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:01.957113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:01.957113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:01.957113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:01.957113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:01.957113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:01.957113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:01.957113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:01.957113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:01.957113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:01.957113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:01.957113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:01.957113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:01.959378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:39:01.959378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:39:01.959378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:01.959378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:39:01.959378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 602/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:01.965303 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20742be2-3029-43c2-95f5-921e2ee82df2 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:02.090195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20742be2-3029-43c2-95f5-921e2ee82df2 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:02.126840 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:02.134679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82038b0-3357-4880-9c1c-c48811edc20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:02.135539 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82038b0-3357-4880-9c1c-c48811edc20c None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:02.136095 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82038b0-3357-4880-9c1c-c48811edc20c None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:02.136587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82038b0-3357-4880-9c1c-c48811edc20c None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:02.137327 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82038b0-3357-4880-9c1c-c48811edc20c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:02.137986 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82038b0-3357-4880-9c1c-c48811edc20c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:02.139512 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82038b0-3357-4880-9c1c-c48811edc20c None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:02.152926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 602/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:02.162799 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750084d-6a09-4049-ad6f-6428ffd6e5b2 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:02.226716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:02.287922 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750084d-6a09-4049-ad6f-6428ffd6e5b2 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:02.339020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba294c-9351-401b-bf43-c2f2d3473f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:02.340108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba294c-9351-401b-bf43-c2f2d3473f12 None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:02.340535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba294c-9351-401b-bf43-c2f2d3473f12 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:02.341035 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba294c-9351-401b-bf43-c2f2d3473f12 None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:02.342236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba294c-9351-401b-bf43-c2f2d3473f12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:02.344403 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba294c-9351-401b-bf43-c2f2d3473f12 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:02.372698 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 603/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Wed Jul 27 22:39:02 2022] POST /identity/v3/users => generated 251 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:39:04.611360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf78dc-2b60-455a-ad23-2ce5c9ccb65c None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:04.611987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf78dc-2b60-455a-ad23-2ce5c9ccb65c None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:04.611987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbf78dc-2b60-455a-ad23-2ce5c9ccb65c None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:04.613411 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 603/1206] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:39:04.619756 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb71cd9-13ff-40c4-a856-966aebc715a9 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:04.620220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb71cd9-13ff-40c4-a856-966aebc715a9 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:04.620380 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb71cd9-13ff-40c4-a856-966aebc715a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:04.640429 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-ccb71cd9-13ff-40c4-a856-966aebc715a9 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:39:04.641652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ccb71cd9-13ff-40c4-a856-966aebc715a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:39:04.720454 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 604/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:39:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:39:04.746975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf78dc-2b60-455a-ad23-2ce5c9ccb65c None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:04.891737 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbf78dc-2b60-455a-ad23-2ce5c9ccb65c None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:04.937643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a4d96-a2fa-4f2f-9765-fd41ee1303e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:04.938746 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a4d96-a2fa-4f2f-9765-fd41ee1303e8 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:04.940368 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a4d96-a2fa-4f2f-9765-fd41ee1303e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:04.940368 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2a4d96-a2fa-4f2f-9765-fd41ee1303e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:04.953835 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2a4d96-a2fa-4f2f-9765-fd41ee1303e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:39:04.958803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-af2a4d96-a2fa-4f2f-9765-fd41ee1303e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:39:04.958803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:04.958803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:04.958803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:04.958803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:04.958803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:04.958803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:04.958803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:04.958803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:04.958803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:04.958803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:04.958803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:04.958803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:39:04.958803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:39:04.958803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:39:04.958803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:39:04.960007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:39:04.960007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:39:04.960007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:39:04.960007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:39:04.960007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:04.960007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:04.960007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:04.960007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:04.960007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:04.960007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:04.960007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:04.960007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:04.960007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:04.960007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:04.960007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:04.960007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:04.960961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:04.960961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:04.960961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:04.960961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:04.960961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:39:04.960961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:39:04.960961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:39:04.960961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:39:04.960961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:39:04.960961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:39:04.960961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:39:04.960961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:04.960961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 604/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:39:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:39:04.966612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb71cd9-13ff-40c4-a856-966aebc715a9 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:05.016548 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:05.085777 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb71cd9-13ff-40c4-a856-966aebc715a9 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:05.122760 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba86efc-8080-42a6-b23c-de5c5105c36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:05.123388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba86efc-8080-42a6-b23c-de5c5105c36b None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:05.123673 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba86efc-8080-42a6-b23c-de5c5105c36b None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:05.125623 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba86efc-8080-42a6-b23c-de5c5105c36b None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:05.125623 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba86efc-8080-42a6-b23c-de5c5105c36b None admin] RBAC: Adding query filter params (name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:05.125623 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba86efc-8080-42a6-b23c-de5c5105c36b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:05.126286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba86efc-8080-42a6-b23c-de5c5105c36b None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:05.135311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 605/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:39:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:05.140878 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a4d96-a2fa-4f2f-9765-fd41ee1303e8 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:05.210698 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:05.277364 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2a4d96-a2fa-4f2f-9765-fd41ee1303e8 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:05.317834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ce471-5c3a-415f-899c-502e201de847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:05.318709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ce471-5c3a-415f-899c-502e201de847 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:05.319005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ce471-5c3a-415f-899c-502e201de847 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:05.319306 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ce471-5c3a-415f-899c-502e201de847 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:05.331618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ce471-5c3a-415f-899c-502e201de847 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:05.333271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ce471-5c3a-415f-899c-502e201de847 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:05.351220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-4c6ce471-5c3a-415f-899c-502e201de847 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:05.351220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:05.351220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:05.351220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:05.351220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:05.351220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:05.351220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:05.351220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:05.351220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:05.351220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:05.351220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:05.351220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:05.351220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:39:05.351220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:39:05.351220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:39:05.352403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:39:05.352403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:05.352403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:05.352403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:05.352403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:05.352403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:05.352403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:05.352403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:05.352403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:05.352403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:05.352403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:05.352403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:05.352403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:05.352403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:05.352403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:05.352403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:05.352403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:05.353356 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:39:05.353356 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:39:05.353356 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:05.353356 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:05.353356 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 605/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:39:05.358742 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba86efc-8080-42a6-b23c-de5c5105c36b None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:05.469106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:05.471887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba86efc-8080-42a6-b23c-de5c5105c36b None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:05.511902 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781115f-7334-4cff-a14b-3052bae1c954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:05.513983 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781115f-7334-4cff-a14b-3052bae1c954 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:05.513983 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781115f-7334-4cff-a14b-3052bae1c954 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:05.513983 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781115f-7334-4cff-a14b-3052bae1c954 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:05.514274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781115f-7334-4cff-a14b-3052bae1c954 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:05.514432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781115f-7334-4cff-a14b-3052bae1c954 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:05.516084 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781115f-7334-4cff-a14b-3052bae1c954 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:05.532480 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 606/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:05.540908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ce471-5c3a-415f-899c-502e201de847 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:05.664319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ce471-5c3a-415f-899c-502e201de847 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:05.666041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:05.706578 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c791f63-cb78-4de9-9e91-9ac2c3692729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:05.707723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c791f63-cb78-4de9-9e91-9ac2c3692729 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:05.708647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c791f63-cb78-4de9-9e91-9ac2c3692729 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:05.709689 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c791f63-cb78-4de9-9e91-9ac2c3692729 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:05.720250 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c791f63-cb78-4de9-9e91-9ac2c3692729 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:05.721631 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c791f63-cb78-4de9-9e91-9ac2c3692729 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:05.735110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-3c791f63-cb78-4de9-9e91-9ac2c3692729 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 22:39:05.735110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:05.735110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:05.735110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:05.735110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:05.735110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:05.735110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:05.735110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:05.735110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:05.735110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:05.735110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:05.735110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:05.735110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:39:05.735110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:39:05.735110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:39:05.735110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:39:05.736313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:05.736313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:05.736313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:39:05.736313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:39:05.736313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:39:05.736313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:39:05.736313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:05.736313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:05.736313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:05.736313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:05.736313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:05.736313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:05.736313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:05.736313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:05.736313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:05.736313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:05.736313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:05.736313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:05.737331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:05.737331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:05.737331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:39:05.737331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:39:05.737331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:39:05.737331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:39:05.737331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:39:05.737331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:39:05.737331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 22:39:05.737331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:05.737331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 606/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:39:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:05.743680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781115f-7334-4cff-a14b-3052bae1c954 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:05.862377 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781115f-7334-4cff-a14b-3052bae1c954 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:05.898154 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a74e2a-a7c7-4021-bca6-17ef6e0bc19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:05.899009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a74e2a-a7c7-4021-bca6-17ef6e0bc19b None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:05.899414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a74e2a-a7c7-4021-bca6-17ef6e0bc19b None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:05.899681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a74e2a-a7c7-4021-bca6-17ef6e0bc19b None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:05.900620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a74e2a-a7c7-4021-bca6-17ef6e0bc19b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:05.901038 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a74e2a-a7c7-4021-bca6-17ef6e0bc19b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:05.903119 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a74e2a-a7c7-4021-bca6-17ef6e0bc19b None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:05.923941 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 607/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Jul 27 22:39:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:05.929851 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c791f63-cb78-4de9-9e91-9ac2c3692729 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:06.050023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c791f63-cb78-4de9-9e91-9ac2c3692729 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:06.094124 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d443b-3535-4dbe-a2d9-2a2e06cd0cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:06.095220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d443b-3535-4dbe-a2d9-2a2e06cd0cb0 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:06.095515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d443b-3535-4dbe-a2d9-2a2e06cd0cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:06.095798 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d443b-3535-4dbe-a2d9-2a2e06cd0cb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:06.132200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:06.175218 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d443b-3535-4dbe-a2d9-2a2e06cd0cb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:06.176680 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d443b-3535-4dbe-a2d9-2a2e06cd0cb0 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:06.301351 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 607/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:39:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 22:39:06.307674 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a74e2a-a7c7-4021-bca6-17ef6e0bc19b None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:06.333357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:06.430215 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a74e2a-a7c7-4021-bca6-17ef6e0bc19b None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:06.468327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518983e-8b58-4569-b692-57e7fbbb9220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:06.469012 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518983e-8b58-4569-b692-57e7fbbb9220 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:06.469295 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518983e-8b58-4569-b692-57e7fbbb9220 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:06.469572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518983e-8b58-4569-b692-57e7fbbb9220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:06.481812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518983e-8b58-4569-b692-57e7fbbb9220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:06.483399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518983e-8b58-4569-b692-57e7fbbb9220 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:06.500381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-4518983e-8b58-4569-b692-57e7fbbb9220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:06.500381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:06.500381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:06.500381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:06.500381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:06.500381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:06.500381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:06.500381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:06.500381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:06.500381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:06.500381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:06.500381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:06.500381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:39:06.500381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:39:06.500381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:39:06.501963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:39:06.501963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:06.501963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:06.501963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:06.501963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:06.501963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:06.501963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:06.501963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:06.501963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:06.501963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:06.501963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:06.501963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:06.501963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:06.501963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:06.501963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:06.501963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:06.501963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:06.503199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:39:06.503199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:39:06.503199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:06.503199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:39:06.503199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 608/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:39:06.508601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d443b-3535-4dbe-a2d9-2a2e06cd0cb0 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:06.612574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:06.659650 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d443b-3535-4dbe-a2d9-2a2e06cd0cb0 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:06.695861 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea7bd1-ea6b-46f3-bf2e-69f7bd3aee6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:06.696536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea7bd1-ea6b-46f3-bf2e-69f7bd3aee6f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:06.696775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea7bd1-ea6b-46f3-bf2e-69f7bd3aee6f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:06.697010 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea7bd1-ea6b-46f3-bf2e-69f7bd3aee6f None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:06.697699 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea7bd1-ea6b-46f3-bf2e-69f7bd3aee6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:06.698014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea7bd1-ea6b-46f3-bf2e-69f7bd3aee6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:06.699405 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea7bd1-ea6b-46f3-bf2e-69f7bd3aee6f None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:06.711630 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 608/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:39:06.717774 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518983e-8b58-4569-b692-57e7fbbb9220 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:06.796804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:06.835279 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518983e-8b58-4569-b692-57e7fbbb9220 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:06.872725 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33009b-512f-4497-9177-9bb767204e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:06.873307 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33009b-512f-4497-9177-9bb767204e6c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:06.873593 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33009b-512f-4497-9177-9bb767204e6c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:06.873872 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33009b-512f-4497-9177-9bb767204e6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:06.883473 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33009b-512f-4497-9177-9bb767204e6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:06.884957 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a33009b-512f-4497-9177-9bb767204e6c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:06.903016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-1a33009b-512f-4497-9177-9bb767204e6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:39:06.903016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:06.903016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:06.903016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:06.903016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:06.903016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:06.903016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:06.903016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:06.903016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:06.903016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:06.903016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:06.903016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:06.903016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:39:06.903016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:39:06.903016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:39:06.904409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:39:06.904409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:06.904409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:06.904409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:06.904409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:06.904409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:06.904409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:06.904409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:06.904409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:06.904409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:06.904409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:06.904409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:06.904409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:06.904409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:06.904409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:06.904409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:06.904409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:06.905507 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:39:06.905507 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:39:06.905507 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:39:06.905507 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:39:06.905507 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:39:06.905507 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:39:06.905507 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:39:06.905507 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:39:06.905507 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 609/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:39:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:06.912455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea7bd1-ea6b-46f3-bf2e-69f7bd3aee6f None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:07.038418 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea7bd1-ea6b-46f3-bf2e-69f7bd3aee6f None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:07.062828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:07.077076 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ecb96-2088-4c9c-b896-1152ee108109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:07.078120 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ecb96-2088-4c9c-b896-1152ee108109 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:07.078523 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ecb96-2088-4c9c-b896-1152ee108109 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:07.078898 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ecb96-2088-4c9c-b896-1152ee108109 None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:07.079890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ecb96-2088-4c9c-b896-1152ee108109 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:07.080299 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ecb96-2088-4c9c-b896-1152ee108109 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:07.082018 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ecb96-2088-4c9c-b896-1152ee108109 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:07.096523 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 609/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:39:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:07.104170 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33009b-512f-4497-9177-9bb767204e6c None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:07.217251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a33009b-512f-4497-9177-9bb767204e6c None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:07.256437 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:07.265274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d109a68c-5436-455d-8ca4-ca8ab3a3105e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:07.265909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109a68c-5436-455d-8ca4-ca8ab3a3105e None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:07.266190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109a68c-5436-455d-8ca4-ca8ab3a3105e None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:07.266500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109a68c-5436-455d-8ca4-ca8ab3a3105e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:07.267638 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109a68c-5436-455d-8ca4-ca8ab3a3105e None admin] RBAC: Adding query filter params (role.id=7b21a72e7f9348d28d60c78cb0853af7, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=2e3a1384f3b34999a75572ee10a1e3fb) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:07.267993 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109a68c-5436-455d-8ca4-ca8ab3a3105e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:07.270028 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d109a68c-5436-455d-8ca4-ca8ab3a3105e None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:07.286799 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 610/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:39:07 2022] GET /identity/v3/role_assignments?user.id=2e3a1384f3b34999a75572ee10a1e3fb&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=7b21a72e7f9348d28d60c78cb0853af7 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:09.442970 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a763a-8320-4588-8370-9280a273ad24 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:09.443526 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a763a-8320-4588-8370-9280a273ad24 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:09.443526 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a763a-8320-4588-8370-9280a273ad24 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:09.444914 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 610/1220] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:39:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:39:09.450131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c51f84-9521-43d4-8b13-4d7297eda816 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:09.450682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c51f84-9521-43d4-8b13-4d7297eda816 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:09.450786 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c51f84-9521-43d4-8b13-4d7297eda816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:09.471468 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-10c51f84-9521-43d4-8b13-4d7297eda816 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:39:09.472671 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-10c51f84-9521-43d4-8b13-4d7297eda816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:39:09.553278 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 611/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:39:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:39:09.575762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a763a-8320-4588-8370-9280a273ad24 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:09.684621 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a763a-8320-4588-8370-9280a273ad24 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:09.722001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5cd92-134f-4ac7-be0b-9c79a21524f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:09.722697 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5cd92-134f-4ac7-be0b-9c79a21524f8 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:09.722985 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5cd92-134f-4ac7-be0b-9c79a21524f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:09.723268 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5cd92-134f-4ac7-be0b-9c79a21524f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:09.736481 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5cd92-134f-4ac7-be0b-9c79a21524f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:39:09.742671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-34d5cd92-134f-4ac7-be0b-9c79a21524f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:39:09.742671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:09.742671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:09.742671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:09.742671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:09.742671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:09.742671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:09.742671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:09.742671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:09.742671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:09.742671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:09.742671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:09.742671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:39:09.742671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:39:09.742671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:39:09.742671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:39:09.743679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:39:09.743679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:39:09.743679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:39:09.743679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:39:09.743679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:09.743679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:09.743679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:09.743679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:09.743679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:09.743679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:09.743679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:09.743679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:09.743679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:09.743679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:09.743679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:09.743679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:09.745118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:09.745118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:09.745118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:09.745118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:09.745118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:39:09.745118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:39:09.745118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:39:09.745118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:39:09.745118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:39:09.745118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:39:09.745118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:39:09.745118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:09.745118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 611/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:39:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:09.750258 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c51f84-9521-43d4-8b13-4d7297eda816 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:09.859216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c51f84-9521-43d4-8b13-4d7297eda816 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:09.885514 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:09.898848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118d074-b530-42fb-aa6d-46d87e5ee287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:09.899511 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118d074-b530-42fb-aa6d-46d87e5ee287 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:09.899954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118d074-b530-42fb-aa6d-46d87e5ee287 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:09.900223 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6118d074-b530-42fb-aa6d-46d87e5ee287 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:09.901110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118d074-b530-42fb-aa6d-46d87e5ee287 None admin] RBAC: Adding query filter params (name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:09.901422 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118d074-b530-42fb-aa6d-46d87e5ee287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:09.902895 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6118d074-b530-42fb-aa6d-46d87e5ee287 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:09.913437 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 612/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:39:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:09.920772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5cd92-134f-4ac7-be0b-9c79a21524f8 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:09.967519 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:10.033261 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5cd92-134f-4ac7-be0b-9c79a21524f8 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:10.067312 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635638b0-497c-4750-a787-9000b9c12276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:10.067976 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635638b0-497c-4750-a787-9000b9c12276 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:10.068275 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635638b0-497c-4750-a787-9000b9c12276 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:10.068599 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635638b0-497c-4750-a787-9000b9c12276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:10.079832 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635638b0-497c-4750-a787-9000b9c12276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:10.081293 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635638b0-497c-4750-a787-9000b9c12276 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:10.097855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-635638b0-497c-4750-a787-9000b9c12276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:10.097855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:10.097855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:10.097855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:10.097855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:10.097855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:10.097855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:10.097855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:10.097855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:10.097855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:10.097855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:10.097855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:10.097855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:39:10.097855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:39:10.097855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:39:10.099087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:39:10.099087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:10.099087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:10.099087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:10.099087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:10.099087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:10.099087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:10.099087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:10.099087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:10.099087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:10.099087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:10.099087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:10.099087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:10.099087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:10.099087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:10.099087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:10.099087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:10.100575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:39:10.100575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:39:10.100575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:10.100575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:10.100575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 612/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:39:10.106102 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118d074-b530-42fb-aa6d-46d87e5ee287 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:10.223109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6118d074-b530-42fb-aa6d-46d87e5ee287 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:10.258363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa445025-23d2-46dd-b3db-9e7fc928dd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:10.258988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa445025-23d2-46dd-b3db-9e7fc928dd27 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:10.259272 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa445025-23d2-46dd-b3db-9e7fc928dd27 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:10.259550 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa445025-23d2-46dd-b3db-9e7fc928dd27 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:10.260236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa445025-23d2-46dd-b3db-9e7fc928dd27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:10.260544 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa445025-23d2-46dd-b3db-9e7fc928dd27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:10.261975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa445025-23d2-46dd-b3db-9e7fc928dd27 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:10.275581 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 613/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:10.281918 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635638b0-497c-4750-a787-9000b9c12276 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:10.386172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:10.394756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635638b0-497c-4750-a787-9000b9c12276 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:10.431484 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473807d3-85fc-4e0c-afce-f2db23dc7c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:10.432131 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473807d3-85fc-4e0c-afce-f2db23dc7c0b None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:10.432405 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473807d3-85fc-4e0c-afce-f2db23dc7c0b None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:10.432681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473807d3-85fc-4e0c-afce-f2db23dc7c0b None admin] PATH_INFO: `/v3/users/placement` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:10.440148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473807d3-85fc-4e0c-afce-f2db23dc7c0b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:10.441661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473807d3-85fc-4e0c-afce-f2db23dc7c0b None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:10.453795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-473807d3-85fc-4e0c-afce-f2db23dc7c0b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 22:39:10.453795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:10.453795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:10.453795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:10.453795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:10.453795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:10.453795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:10.453795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:10.453795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:10.453795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:10.453795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:10.453795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:10.453795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:39:10.453795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:39:10.453795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:39:10.453795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:39:10.455515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:10.455515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:10.455515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:39:10.455515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:39:10.455515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:39:10.455515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:39:10.455515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:10.455515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:10.455515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:10.455515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:10.455515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:10.455515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:10.455515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:10.455515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:10.455515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:10.455515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:10.455515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:10.455515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:10.456772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:10.456772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:10.456772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:39:10.456772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:39:10.456772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:39:10.456772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:39:10.456772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:39:10.456772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:39:10.456772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 22:39:10.456772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:10.456772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 613/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:39:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:10.462174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa445025-23d2-46dd-b3db-9e7fc928dd27 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:10.511779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:10.566600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa445025-23d2-46dd-b3db-9e7fc928dd27 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:10.605924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16326c-2f39-4f0a-ba5b-08c846f3cad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:10.606649 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16326c-2f39-4f0a-ba5b-08c846f3cad6 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:10.606945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16326c-2f39-4f0a-ba5b-08c846f3cad6 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:10.607291 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16326c-2f39-4f0a-ba5b-08c846f3cad6 None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:10.608287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16326c-2f39-4f0a-ba5b-08c846f3cad6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:10.608653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16326c-2f39-4f0a-ba5b-08c846f3cad6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:10.610236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16326c-2f39-4f0a-ba5b-08c846f3cad6 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:10.631513 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 614/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Jul 27 22:39:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:10.637810 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473807d3-85fc-4e0c-afce-f2db23dc7c0b None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:10.751882 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473807d3-85fc-4e0c-afce-f2db23dc7c0b None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:10.788398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340f55f-0c65-4f88-8ef1-3cc6a8259cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:10.789035 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340f55f-0c65-4f88-8ef1-3cc6a8259cc7 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:10.789317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340f55f-0c65-4f88-8ef1-3cc6a8259cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:10.789591 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3340f55f-0c65-4f88-8ef1-3cc6a8259cc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:10.800465 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340f55f-0c65-4f88-8ef1-3cc6a8259cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:10.802458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3340f55f-0c65-4f88-8ef1-3cc6a8259cc7 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:10.818145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-3340f55f-0c65-4f88-8ef1-3cc6a8259cc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:10.818145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:10.818145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:10.818145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:10.818145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:10.818145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:10.818145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:10.818145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:10.818145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:10.818145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:10.818145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:10.818145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:10.818145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:39:10.818145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:39:10.818145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:39:10.819169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:39:10.819169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:10.819169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:10.819169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:10.819169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:10.819169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:10.819169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:10.819169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:10.819169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:10.819169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:10.819169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:10.819169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:10.819169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:10.819169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:10.819169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:10.819169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:10.819169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:10.820090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:39:10.820090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:39:10.820090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:10.820090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:10.820090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 614/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:39:10.825530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16326c-2f39-4f0a-ba5b-08c846f3cad6 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:10.948972 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16326c-2f39-4f0a-ba5b-08c846f3cad6 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:10.951702 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:10.989954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112cb4a0-413f-467b-84cb-1c982f7d9029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:10.990689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cb4a0-413f-467b-84cb-1c982f7d9029 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:10.990979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cb4a0-413f-467b-84cb-1c982f7d9029 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:10.991284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112cb4a0-413f-467b-84cb-1c982f7d9029 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:10.992233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112cb4a0-413f-467b-84cb-1c982f7d9029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:10.992552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112cb4a0-413f-467b-84cb-1c982f7d9029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:10.994164 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112cb4a0-413f-467b-84cb-1c982f7d9029 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:11.013443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 615/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:11.014960 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340f55f-0c65-4f88-8ef1-3cc6a8259cc7 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:11.025394 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:11.128455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3340f55f-0c65-4f88-8ef1-3cc6a8259cc7 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:11.165312 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d76227-4736-4383-8dc6-8902ae47ad2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:11.166188 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d76227-4736-4383-8dc6-8902ae47ad2d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:11.166512 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d76227-4736-4383-8dc6-8902ae47ad2d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:11.166883 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d76227-4736-4383-8dc6-8902ae47ad2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:11.176614 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d76227-4736-4383-8dc6-8902ae47ad2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:11.178829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d76227-4736-4383-8dc6-8902ae47ad2d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:11.191142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-d8d76227-4736-4383-8dc6-8902ae47ad2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:39:11.191142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:11.191142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:11.191142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:11.191142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:11.191142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:11.191142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:11.191142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:11.191142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:11.191142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:11.191142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:11.191142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:11.191142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:39:11.191142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:39:11.191142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:39:11.192337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:39:11.192337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:11.192337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:11.192337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:11.192337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:11.192337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:11.192337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:11.192337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:11.192337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:11.192337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:11.192337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:11.192337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:11.192337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:11.192337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:11.192337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:11.192337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:11.192337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:11.193412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:39:11.193412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:39:11.193412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:39:11.193412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:39:11.193412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:39:11.193412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:39:11.193412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:39:11.193412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:11.193412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 615/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:39:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:11.198455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112cb4a0-413f-467b-84cb-1c982f7d9029 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:11.310805 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112cb4a0-413f-467b-84cb-1c982f7d9029 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:11.351319 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5d894-6dc8-4fe3-bf70-516547a603e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:11.351966 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5d894-6dc8-4fe3-bf70-516547a603e4 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:11.352253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5d894-6dc8-4fe3-bf70-516547a603e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:11.352549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5d894-6dc8-4fe3-bf70-516547a603e4 None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:11.353290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5d894-6dc8-4fe3-bf70-516547a603e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:11.353706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5d894-6dc8-4fe3-bf70-516547a603e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:11.355202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c5d894-6dc8-4fe3-bf70-516547a603e4 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:11.375949 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 616/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:39:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:11.377238 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d76227-4736-4383-8dc6-8902ae47ad2d None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:11.448059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:11.484571 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d76227-4736-4383-8dc6-8902ae47ad2d None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:11.521518 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ddb22a-1a92-4bfb-86a5-7ee8f81c3809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:11.522204 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddb22a-1a92-4bfb-86a5-7ee8f81c3809 None admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:11.522539 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddb22a-1a92-4bfb-86a5-7ee8f81c3809 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:11.522898 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ddb22a-1a92-4bfb-86a5-7ee8f81c3809 None admin] PATH_INFO: `/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/2e3a1384f3b34999a75572ee10a1e3fb/roles/7b21a72e7f9348d28d60c78cb0853af7` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:11.540743 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddb22a-1a92-4bfb-86a5-7ee8f81c3809 None admin] RBAC: Authorizing `identity:create_grant(project_id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user_id=2e3a1384f3b34999a75572ee10a1e3fb, role_id=7b21a72e7f9348d28d60c78cb0853af7)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:11.542175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ddb22a-1a92-4bfb-86a5-7ee8f81c3809 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:11.553665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 616/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:39:11 2022] PUT /identity/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/2e3a1384f3b34999a75572ee10a1e3fb/roles/7b21a72e7f9348d28d60c78cb0853af7 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:39:13.773715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c7775-4610-440c-a16e-fa9fc4a86c15 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:13.774259 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c7775-4610-440c-a16e-fa9fc4a86c15 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:13.774259 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c7775-4610-440c-a16e-fa9fc4a86c15 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:13.775950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 617/1233] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:39:13.781020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bec56-b068-4700-be9b-697cda9b3080 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:13.781415 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bec56-b068-4700-be9b-697cda9b3080 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:13.781583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490bec56-b068-4700-be9b-697cda9b3080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:13.800877 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-490bec56-b068-4700-be9b-697cda9b3080 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:39:13.802651 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-490bec56-b068-4700-be9b-697cda9b3080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:39:13.876808 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 617/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:39:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:39:13.902634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c7775-4610-440c-a16e-fa9fc4a86c15 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:13.931275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:14.014591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c7775-4610-440c-a16e-fa9fc4a86c15 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:14.053809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a9e18-b824-4263-af23-318f1ce2cdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:14.054486 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a9e18-b824-4263-af23-318f1ce2cdd5 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:14.054770 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a9e18-b824-4263-af23-318f1ce2cdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:14.055156 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a9e18-b824-4263-af23-318f1ce2cdd5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:14.068166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340a9e18-b824-4263-af23-318f1ce2cdd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:39:14.074592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-340a9e18-b824-4263-af23-318f1ce2cdd5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:39:14.074592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:14.074592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:14.074592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:14.074592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:14.074592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:14.074592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:14.074592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:14.074592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:14.074592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:14.074592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:14.074592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:14.074592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:39:14.074592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:39:14.074592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:39:14.074592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:39:14.075706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:39:14.075706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:39:14.075706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:39:14.075706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:39:14.075706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:14.075706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:14.075706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:14.075706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:14.075706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:14.075706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:14.075706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:14.075706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:14.075706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:14.075706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:14.075706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:14.075706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:14.082622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:14.082622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:14.082622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:14.082622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:14.082622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:39:14.082622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:39:14.082622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:39:14.082622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:39:14.082622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:39:14.082622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:39:14.082622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 22:39:14.082622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:39:14.082622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 618/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Wed Jul 27 22:39:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:14.083617 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490bec56-b068-4700-be9b-697cda9b3080 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:14.136861 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:14.198984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490bec56-b068-4700-be9b-697cda9b3080 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:14.237685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0286d8b-e9c9-411a-83f0-ccbcd549c4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:14.238367 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0286d8b-e9c9-411a-83f0-ccbcd549c4c6 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:14.238618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0286d8b-e9c9-411a-83f0-ccbcd549c4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:14.238935 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0286d8b-e9c9-411a-83f0-ccbcd549c4c6 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:14.240263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0286d8b-e9c9-411a-83f0-ccbcd549c4c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:14.240569 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0286d8b-e9c9-411a-83f0-ccbcd549c4c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:14.241930 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0286d8b-e9c9-411a-83f0-ccbcd549c4c6 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:14.250389 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 618/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Wed Jul 27 22:39:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:14.256296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a9e18-b824-4263-af23-318f1ce2cdd5 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:14.351293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:14.375665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a9e18-b824-4263-af23-318f1ce2cdd5 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:14.416181 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a287fc-1edc-4226-aaf3-d3d89b0b7d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:14.416751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a287fc-1edc-4226-aaf3-d3d89b0b7d41 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:14.417041 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a287fc-1edc-4226-aaf3-d3d89b0b7d41 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:14.417319 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a287fc-1edc-4226-aaf3-d3d89b0b7d41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:14.428755 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a287fc-1edc-4226-aaf3-d3d89b0b7d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:14.430277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a287fc-1edc-4226-aaf3-d3d89b0b7d41 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:14.445502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-68a287fc-1edc-4226-aaf3-d3d89b0b7d41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:14.445502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:14.445502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:14.445502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:14.445502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:14.445502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:14.445502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:14.445502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:14.445502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:14.445502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:14.445502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:14.445502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:14.445502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:39:14.445502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:39:14.445502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:39:14.446652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:39:14.446652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:14.446652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:14.446652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:14.446652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:14.446652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:14.446652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:14.446652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:14.446652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:14.446652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:14.446652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:14.446652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:14.446652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:14.446652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:14.446652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:14.446652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:14.446652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:14.447653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:39:14.447653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:39:14.447653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:14.447653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:39:14.447653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 619/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:39:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:14.452957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0286d8b-e9c9-411a-83f0-ccbcd549c4c6 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:14.563639 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0286d8b-e9c9-411a-83f0-ccbcd549c4c6 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:14.573558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:14.603861 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55a37e-e31a-4847-9b4a-95239fee0716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:14.604513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55a37e-e31a-4847-9b4a-95239fee0716 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:14.604836 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55a37e-e31a-4847-9b4a-95239fee0716 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:14.605091 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55a37e-e31a-4847-9b4a-95239fee0716 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:14.605833 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55a37e-e31a-4847-9b4a-95239fee0716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:14.606146 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55a37e-e31a-4847-9b4a-95239fee0716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:14.607653 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55a37e-e31a-4847-9b4a-95239fee0716 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:14.621444 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 619/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:39:14.627117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a287fc-1edc-4226-aaf3-d3d89b0b7d41 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:14.736543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a287fc-1edc-4226-aaf3-d3d89b0b7d41 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:14.770862 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e013faa-154a-4ce3-afbb-b54774675caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:14.771523 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e013faa-154a-4ce3-afbb-b54774675caa None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:14.771807 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e013faa-154a-4ce3-afbb-b54774675caa None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:14.772089 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e013faa-154a-4ce3-afbb-b54774675caa None admin] PATH_INFO: `/v3/users/placement` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:14.775414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:14.781461 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e013faa-154a-4ce3-afbb-b54774675caa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:14.783695 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e013faa-154a-4ce3-afbb-b54774675caa None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:14.799590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-3e013faa-154a-4ce3-afbb-b54774675caa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 22:39:14.799590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:14.799590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:14.799590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:14.799590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:14.799590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:14.799590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:14.799590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:14.799590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:14.799590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:14.799590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:14.799590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:14.799590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:39:14.799590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:39:14.799590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:39:14.799590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:39:14.800706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:14.800706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:14.800706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:39:14.800706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:39:14.800706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:39:14.800706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:39:14.800706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:14.800706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:14.800706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:14.800706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:14.800706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:14.800706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:14.800706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:14.800706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:14.800706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:14.800706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:14.800706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:14.800706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:14.801863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:14.801863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:14.801863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:39:14.801863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:39:14.801863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:39:14.801863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:39:14.801863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:39:14.801863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:39:14.801863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 22:39:14.801863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:39:14.801863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 620/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:39:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:14.807650 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55a37e-e31a-4847-9b4a-95239fee0716 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:14.919771 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55a37e-e31a-4847-9b4a-95239fee0716 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:14.961943 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271613bc-fdd6-4d10-b5e3-c62dc47c3297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:14.962750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271613bc-fdd6-4d10-b5e3-c62dc47c3297 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:14.963040 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271613bc-fdd6-4d10-b5e3-c62dc47c3297 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:14.963316 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271613bc-fdd6-4d10-b5e3-c62dc47c3297 None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:14.964265 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271613bc-fdd6-4d10-b5e3-c62dc47c3297 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:14.964630 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271613bc-fdd6-4d10-b5e3-c62dc47c3297 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:14.966064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271613bc-fdd6-4d10-b5e3-c62dc47c3297 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:14.986730 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 620/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Jul 27 22:39:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:14.993014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e013faa-154a-4ce3-afbb-b54774675caa None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:15.103005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e013faa-154a-4ce3-afbb-b54774675caa None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:15.140337 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f94f66-55fa-44f2-ade6-8a57c0e605f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:15.140968 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f94f66-55fa-44f2-ade6-8a57c0e605f8 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:15.141261 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f94f66-55fa-44f2-ade6-8a57c0e605f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:15.141642 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f94f66-55fa-44f2-ade6-8a57c0e605f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:15.211597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:15.218987 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f94f66-55fa-44f2-ade6-8a57c0e605f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:15.220426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f94f66-55fa-44f2-ade6-8a57c0e605f8 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:15.325821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 621/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:39:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 22:39:15.331976 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271613bc-fdd6-4d10-b5e3-c62dc47c3297 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:15.366060 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:15.452833 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271613bc-fdd6-4d10-b5e3-c62dc47c3297 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:15.491902 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d2064-6ca6-44a4-a114-78baa47c3269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:15.492552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d2064-6ca6-44a4-a114-78baa47c3269 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:15.492878 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d2064-6ca6-44a4-a114-78baa47c3269 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:15.493202 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d2064-6ca6-44a4-a114-78baa47c3269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:15.504264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d2064-6ca6-44a4-a114-78baa47c3269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:15.506848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d2064-6ca6-44a4-a114-78baa47c3269 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:15.524009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-ec7d2064-6ca6-44a4-a114-78baa47c3269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:15.524009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:15.524009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:15.524009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:15.524009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:15.524009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:15.524009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:15.524009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:15.524009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:15.524009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:15.524009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:15.524009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:15.524009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:39:15.524009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:39:15.524009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:39:15.525170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:39:15.525170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:15.525170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:15.525170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:15.525170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:15.525170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:15.525170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:15.525170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:15.525170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:15.525170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:15.525170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:15.525170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:15.525170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:15.525170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:15.525170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:15.525170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:15.525170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:15.526213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:39:15.526213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:39:15.526213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:15.526213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:15.526213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 621/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:15.531410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f94f66-55fa-44f2-ade6-8a57c0e605f8 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:15.638666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:15.645724 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f94f66-55fa-44f2-ade6-8a57c0e605f8 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:15.690693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba98ee0-8925-47cb-bf11-099bd22e5a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:15.691361 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba98ee0-8925-47cb-bf11-099bd22e5a76 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:15.691646 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba98ee0-8925-47cb-bf11-099bd22e5a76 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:15.691928 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba98ee0-8925-47cb-bf11-099bd22e5a76 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:15.692913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba98ee0-8925-47cb-bf11-099bd22e5a76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:15.693348 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba98ee0-8925-47cb-bf11-099bd22e5a76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:15.695131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba98ee0-8925-47cb-bf11-099bd22e5a76 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:15.709559 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 622/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:15.716019 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d2064-6ca6-44a4-a114-78baa47c3269 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:15.799492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:15.822237 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d2064-6ca6-44a4-a114-78baa47c3269 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:15.860005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7243b-0ead-4e53-bdbe-c0c55adc7dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:15.860219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7243b-0ead-4e53-bdbe-c0c55adc7dfa None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:15.860414 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7243b-0ead-4e53-bdbe-c0c55adc7dfa None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:15.860765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e7243b-0ead-4e53-bdbe-c0c55adc7dfa None admin] PATH_INFO: `/v3/projects/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:15.871341 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7243b-0ead-4e53-bdbe-c0c55adc7dfa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:15.871341 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e7243b-0ead-4e53-bdbe-c0c55adc7dfa None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:15.898412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-a8e7243b-0ead-4e53-bdbe-c0c55adc7dfa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:39:15.898412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:15.898412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:15.898412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:15.898412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:15.898412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:15.898412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:15.898412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:15.898412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:15.898412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:15.898412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:15.898412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:15.898412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:39:15.898412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:39:15.898412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:39:15.899713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:39:15.899713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:15.899713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:15.899713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:15.899713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:15.899713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:15.899713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:15.899713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:15.899713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:15.899713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:15.899713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:15.899713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:15.899713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:15.899713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:15.899713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:15.899713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:15.899713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:15.900891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:39:15.900891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:39:15.900891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:39:15.900891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:39:15.900891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:39:15.900891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:39:15.900891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:39:15.900891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:15.900891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 622/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:39:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:15.905978 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba98ee0-8925-47cb-bf11-099bd22e5a76 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:16.020870 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba98ee0-8925-47cb-bf11-099bd22e5a76 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:16.056292 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336c497-c73a-4273-b48e-d9ff33eaba79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:16.056916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336c497-c73a-4273-b48e-d9ff33eaba79 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:16.057228 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336c497-c73a-4273-b48e-d9ff33eaba79 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:16.057510 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336c497-c73a-4273-b48e-d9ff33eaba79 None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:16.058261 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336c497-c73a-4273-b48e-d9ff33eaba79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:16.058629 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336c497-c73a-4273-b48e-d9ff33eaba79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:16.060185 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336c497-c73a-4273-b48e-d9ff33eaba79 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:16.073938 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 623/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:39:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:16.081262 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7243b-0ead-4e53-bdbe-c0c55adc7dfa None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:16.194826 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e7243b-0ead-4e53-bdbe-c0c55adc7dfa None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:16.241434 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c1c5bd-23bb-42c2-ad65-8fb49cfcfe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:16.242113 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1c5bd-23bb-42c2-ad65-8fb49cfcfe40 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:16.242526 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1c5bd-23bb-42c2-ad65-8fb49cfcfe40 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:16.242814 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c1c5bd-23bb-42c2-ad65-8fb49cfcfe40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:16.243871 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1c5bd-23bb-42c2-ad65-8fb49cfcfe40 None admin] RBAC: Adding query filter params (role.id=7b21a72e7f9348d28d60c78cb0853af7, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=2e3a1384f3b34999a75572ee10a1e3fb) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:16.244295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1c5bd-23bb-42c2-ad65-8fb49cfcfe40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:16.246474 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c1c5bd-23bb-42c2-ad65-8fb49cfcfe40 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:16.254465 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 623/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:39:16 2022] GET /identity/v3/role_assignments?user.id=2e3a1384f3b34999a75572ee10a1e3fb&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=7b21a72e7f9348d28d60c78cb0853af7 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:18.329725 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ced04-e75d-4778-aae9-23d8296f78f4 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:18.330313 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ced04-e75d-4778-aae9-23d8296f78f4 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:18.330313 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ced04-e75d-4778-aae9-23d8296f78f4 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:18.331631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 624/1247] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:39:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:39:18.337404 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34261265-a009-48bf-922f-059605b6b24c None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:18.337931 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34261265-a009-48bf-922f-059605b6b24c None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:18.337931 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34261265-a009-48bf-922f-059605b6b24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:18.345031 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:18.359198 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-34261265-a009-48bf-922f-059605b6b24c None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:39:18.360527 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-34261265-a009-48bf-922f-059605b6b24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:39:18.444749 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 624/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:39:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:39:18.473904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ced04-e75d-4778-aae9-23d8296f78f4 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:18.497027 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:18.613383 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ced04-e75d-4778-aae9-23d8296f78f4 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:18.652502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17a010-297a-400a-9afc-c2fbdb0a79cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:18.653327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17a010-297a-400a-9afc-c2fbdb0a79cb None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:18.653783 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17a010-297a-400a-9afc-c2fbdb0a79cb None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:18.654180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17a010-297a-400a-9afc-c2fbdb0a79cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:18.665735 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17a010-297a-400a-9afc-c2fbdb0a79cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:39:18.670888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-ef17a010-297a-400a-9afc-c2fbdb0a79cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:39:18.670888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:18.670888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:18.670888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:18.670888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:18.670888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:18.670888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:18.670888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:18.670888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:18.670888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:18.670888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:18.670888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:18.670888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:39:18.670888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:39:18.670888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:39:18.670888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:39:18.672133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:39:18.672133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:39:18.672133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:39:18.672133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:39:18.672133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:18.672133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:18.672133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:18.672133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:18.672133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:18.672133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:18.672133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:18.672133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:18.672133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:18.672133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:18.672133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:18.672133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:18.673211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:18.673211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:18.673211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:18.673211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:18.673211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:39:18.673211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:39:18.673211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:39:18.673211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:39:18.673211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:39:18.673211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:39:18.673211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:39:18.673211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:39:18.673211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 625/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:39:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:18.679354 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34261265-a009-48bf-922f-059605b6b24c None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:18.794134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34261265-a009-48bf-922f-059605b6b24c None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:18.829275 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:18.836035 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7834e44-1d54-4c69-b2da-a6f900ffc5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:18.836707 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7834e44-1d54-4c69-b2da-a6f900ffc5f8 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:18.837061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7834e44-1d54-4c69-b2da-a6f900ffc5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:18.837264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7834e44-1d54-4c69-b2da-a6f900ffc5f8 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:18.837977 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7834e44-1d54-4c69-b2da-a6f900ffc5f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:18.838304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7834e44-1d54-4c69-b2da-a6f900ffc5f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:18.839674 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7834e44-1d54-4c69-b2da-a6f900ffc5f8 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:18.848201 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 625/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:39:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:39:18.855033 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17a010-297a-400a-9afc-c2fbdb0a79cb None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:18.951054 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:18.980970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17a010-297a-400a-9afc-c2fbdb0a79cb None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:19.017902 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c425a84-681a-4708-8842-05b328adf0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:19.018575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c425a84-681a-4708-8842-05b328adf0b5 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:19.018994 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c425a84-681a-4708-8842-05b328adf0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:19.019316 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c425a84-681a-4708-8842-05b328adf0b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:19.030900 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c425a84-681a-4708-8842-05b328adf0b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:19.032568 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c425a84-681a-4708-8842-05b328adf0b5 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:19.049814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-0c425a84-681a-4708-8842-05b328adf0b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:19.049814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:19.049814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:19.049814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:19.049814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:19.049814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:19.049814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:19.049814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:19.049814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:19.049814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:19.049814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:19.049814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:19.049814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:39:19.049814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:39:19.049814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:39:19.050984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:39:19.050984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:19.050984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:19.050984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:19.050984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:19.050984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:19.050984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:19.050984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:19.050984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:19.050984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:19.050984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:19.050984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:19.050984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:19.050984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:19.050984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:19.050984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:19.050984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:19.052035 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:39:19.052035 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:39:19.052035 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:19.052035 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:39:19.052035 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 626/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:19.057239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7834e44-1d54-4c69-b2da-a6f900ffc5f8 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:19.166996 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7834e44-1d54-4c69-b2da-a6f900ffc5f8 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:19.205463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49aa15-d173-495a-992e-9f8d27383435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:19.206272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49aa15-d173-495a-992e-9f8d27383435 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:19.206575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49aa15-d173-495a-992e-9f8d27383435 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:19.206918 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d49aa15-d173-495a-992e-9f8d27383435 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:19.208184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49aa15-d173-495a-992e-9f8d27383435 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:19.208490 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49aa15-d173-495a-992e-9f8d27383435 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:19.209863 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d49aa15-d173-495a-992e-9f8d27383435 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:19.222486 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 626/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:19.228702 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c425a84-681a-4708-8842-05b328adf0b5 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:19.342214 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c425a84-681a-4708-8842-05b328adf0b5 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:19.374570 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:19.385270 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cc537-d75b-4fde-9932-0469efb535a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:19.386295 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cc537-d75b-4fde-9932-0469efb535a1 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:19.386711 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cc537-d75b-4fde-9932-0469efb535a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:19.387080 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cc537-d75b-4fde-9932-0469efb535a1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:19.399656 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cc537-d75b-4fde-9932-0469efb535a1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:19.401362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323cc537-d75b-4fde-9932-0469efb535a1 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:19.414935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-323cc537-d75b-4fde-9932-0469efb535a1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 22:39:19.414935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:19.414935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:19.414935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:19.414935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:19.414935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:19.414935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:19.414935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:19.414935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:19.414935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:19.414935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:19.414935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:19.414935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:39:19.414935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:39:19.414935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:39:19.414935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:39:19.416093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:19.416093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:19.416093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:39:19.416093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:39:19.416093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:39:19.416093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:39:19.416093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:19.416093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:19.416093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:19.416093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:19.416093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:19.416093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:19.416093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:19.416093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:19.416093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:19.416093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:19.416093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:19.416093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:19.417311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:19.417311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:19.417311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:39:19.417311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:39:19.417311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:39:19.417311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:39:19.417311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:39:19.417311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:39:19.417311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 22:39:19.417311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:39:19.417311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 627/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:39:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:19.422840 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49aa15-d173-495a-992e-9f8d27383435 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:19.483471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:19.532060 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d49aa15-d173-495a-992e-9f8d27383435 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:19.569241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374e964-955f-442a-81c1-ec72d49e2fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:19.569911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374e964-955f-442a-81c1-ec72d49e2fbd None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:19.570253 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374e964-955f-442a-81c1-ec72d49e2fbd None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:19.570597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374e964-955f-442a-81c1-ec72d49e2fbd None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:19.571504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374e964-955f-442a-81c1-ec72d49e2fbd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:19.571851 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374e964-955f-442a-81c1-ec72d49e2fbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:19.573576 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374e964-955f-442a-81c1-ec72d49e2fbd None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:19.592511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 627/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Jul 27 22:39:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:19.599383 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cc537-d75b-4fde-9932-0469efb535a1 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:19.713233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323cc537-d75b-4fde-9932-0469efb535a1 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:19.747897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a604a4-7963-4f9c-9df3-8a7714191c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:19.748525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a604a4-7963-4f9c-9df3-8a7714191c60 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:19.748815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a604a4-7963-4f9c-9df3-8a7714191c60 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:19.749097 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a604a4-7963-4f9c-9df3-8a7714191c60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:19.807742 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:19.824027 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a604a4-7963-4f9c-9df3-8a7714191c60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:19.826877 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a604a4-7963-4f9c-9df3-8a7714191c60 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:19.936666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 628/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:39:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 22:39:19.942536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374e964-955f-442a-81c1-ec72d49e2fbd None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:20.050509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374e964-955f-442a-81c1-ec72d49e2fbd None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:20.064624 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:20.090957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc239c5-5bd6-4511-91df-d27527de9abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:20.091776 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc239c5-5bd6-4511-91df-d27527de9abf None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:20.092132 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc239c5-5bd6-4511-91df-d27527de9abf None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:20.092453 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc239c5-5bd6-4511-91df-d27527de9abf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:20.104065 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc239c5-5bd6-4511-91df-d27527de9abf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:20.105787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc239c5-5bd6-4511-91df-d27527de9abf None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:20.121121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-7cc239c5-5bd6-4511-91df-d27527de9abf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:20.121121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:20.121121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:20.121121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:20.121121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:20.121121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:20.121121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:20.121121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:20.121121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:20.121121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:20.121121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:20.121121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:20.121121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:39:20.121121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:39:20.121121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:39:20.122195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:39:20.122195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:20.122195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:20.122195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:20.122195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:20.122195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:20.122195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:20.122195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:20.122195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:20.122195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:20.122195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:20.122195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:20.122195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:20.122195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:20.122195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:20.122195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:20.122195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:20.123177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:39:20.123177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:39:20.123177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:20.123177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:20.123177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 628/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:20.128176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a604a4-7963-4f9c-9df3-8a7714191c60 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:20.217560 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:20.229725 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a604a4-7963-4f9c-9df3-8a7714191c60 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:20.266697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed380b-5801-47ad-8210-8a3e33621c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:20.267401 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed380b-5801-47ad-8210-8a3e33621c30 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:20.267718 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed380b-5801-47ad-8210-8a3e33621c30 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:20.268029 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed380b-5801-47ad-8210-8a3e33621c30 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:20.268833 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed380b-5801-47ad-8210-8a3e33621c30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:20.269147 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed380b-5801-47ad-8210-8a3e33621c30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:20.271293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed380b-5801-47ad-8210-8a3e33621c30 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:20.287816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 629/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:20.289016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc239c5-5bd6-4511-91df-d27527de9abf None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:20.407927 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc239c5-5bd6-4511-91df-d27527de9abf None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:20.443206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb065454-f240-41e2-8a5e-ea74ff6bb7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:20.443939 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb065454-f240-41e2-8a5e-ea74ff6bb7a7 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:20.444130 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb065454-f240-41e2-8a5e-ea74ff6bb7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:20.444408 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb065454-f240-41e2-8a5e-ea74ff6bb7a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:20.452090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb065454-f240-41e2-8a5e-ea74ff6bb7a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:20.454001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb065454-f240-41e2-8a5e-ea74ff6bb7a7 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:20.467966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-fb065454-f240-41e2-8a5e-ea74ff6bb7a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:39:20.467966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:20.467966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:20.467966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:20.467966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:20.467966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:20.467966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:20.467966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:20.467966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:20.467966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:20.467966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:20.467966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:20.467966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:39:20.467966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:39:20.467966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:39:20.469042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:39:20.469042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:20.469042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:20.469042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:20.469042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:20.469042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:20.469042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:20.469042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:20.469042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:20.469042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:20.469042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:20.469042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:20.469042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:20.469042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:20.469042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:20.469042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:20.469042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:20.475004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:39:20.475004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:39:20.475004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:39:20.475004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:39:20.475004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:39:20.475004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:39:20.475004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:39:20.475004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:20.475004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 629/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:39:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:20.475599 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed380b-5801-47ad-8210-8a3e33621c30 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:20.582759 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed380b-5801-47ad-8210-8a3e33621c30 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:20.624694 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f41f5-4b89-418e-a429-20475e15e3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:20.625327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f41f5-4b89-418e-a429-20475e15e3da None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:20.625616 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f41f5-4b89-418e-a429-20475e15e3da None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:20.625927 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f41f5-4b89-418e-a429-20475e15e3da None admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:20.626862 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f41f5-4b89-418e-a429-20475e15e3da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:20.627208 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f41f5-4b89-418e-a429-20475e15e3da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:20.628928 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7f41f5-4b89-418e-a429-20475e15e3da None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:20.648826 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 630/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:39:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:39:20.650133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb065454-f240-41e2-8a5e-ea74ff6bb7a7 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:20.679380 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:20.763374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb065454-f240-41e2-8a5e-ea74ff6bb7a7 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:20.800366 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5479c98d-4937-4e46-bbeb-5075875e3066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:20.801106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479c98d-4937-4e46-bbeb-5075875e3066 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:20.801963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479c98d-4937-4e46-bbeb-5075875e3066 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:20.802308 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479c98d-4937-4e46-bbeb-5075875e3066 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:20.803241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479c98d-4937-4e46-bbeb-5075875e3066 None admin] RBAC: Adding query filter params (role.id=49e0ba8d8c9f4824892b61f05d0036e8, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=2e3a1384f3b34999a75572ee10a1e3fb) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:20.803552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479c98d-4937-4e46-bbeb-5075875e3066 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:20.805139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5479c98d-4937-4e46-bbeb-5075875e3066 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:20.826371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 630/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:39:20 2022] GET /identity/v3/role_assignments?user.id=2e3a1384f3b34999a75572ee10a1e3fb&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=49e0ba8d8c9f4824892b61f05d0036e8 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:22.840618 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0e649-88f9-4e0d-9454-5a2fcf5f1ff1 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:22.841151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0e649-88f9-4e0d-9454-5a2fcf5f1ff1 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:22.841151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb0e649-88f9-4e0d-9454-5a2fcf5f1ff1 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:22.842545 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 631/1261] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:39:22.847710 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a650b9d-bbe2-477c-9da9-7243effc6af9 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:22.848110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a650b9d-bbe2-477c-9da9-7243effc6af9 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:22.848872 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a650b9d-bbe2-477c-9da9-7243effc6af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:22.866486 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-1a650b9d-bbe2-477c-9da9-7243effc6af9 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:39:22.867607 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-1a650b9d-bbe2-477c-9da9-7243effc6af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:39:22.932279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 631/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:39:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:39:22.954652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0e649-88f9-4e0d-9454-5a2fcf5f1ff1 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:22.972336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:23.070096 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb0e649-88f9-4e0d-9454-5a2fcf5f1ff1 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:23.103666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4d2b8-3a72-4119-894f-a7b9d9271e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:23.104299 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4d2b8-3a72-4119-894f-a7b9d9271e2f None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:23.104583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4d2b8-3a72-4119-894f-a7b9d9271e2f None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:23.104866 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4d2b8-3a72-4119-894f-a7b9d9271e2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:23.115086 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f4d2b8-3a72-4119-894f-a7b9d9271e2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:39:23.120015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-e9f4d2b8-3a72-4119-894f-a7b9d9271e2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:39:23.120015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:23.120015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:23.120015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:23.120015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:23.120015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:23.120015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:23.120015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:23.120015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:23.120015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:23.120015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:23.120015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:23.120015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:39:23.120015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:39:23.120015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:39:23.120015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:39:23.121130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:39:23.121130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:39:23.121130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:39:23.121130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:39:23.121130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:23.121130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:23.121130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:23.121130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:23.121130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:23.121130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:23.121130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:23.121130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:23.121130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:23.121130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:23.121130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:23.121130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:23.122109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:23.122109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:23.122109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:23.122109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:23.122109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:39:23.122109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:39:23.122109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:39:23.122109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:39:23.122109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:39:23.122109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:39:23.122109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:39:23.122109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:39:23.122109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 632/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:39:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:23.127272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a650b9d-bbe2-477c-9da9-7243effc6af9 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:23.144888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:23.222861 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a650b9d-bbe2-477c-9da9-7243effc6af9 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:23.257684 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d9d7a-4a0e-4a2a-8f14-051270b49b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:23.260268 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d9d7a-4a0e-4a2a-8f14-051270b49b12 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:23.260558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d9d7a-4a0e-4a2a-8f14-051270b49b12 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:23.261988 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d9d7a-4a0e-4a2a-8f14-051270b49b12 None admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:23.262739 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d9d7a-4a0e-4a2a-8f14-051270b49b12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:23.263057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d9d7a-4a0e-4a2a-8f14-051270b49b12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:23.264438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419d9d7a-4a0e-4a2a-8f14-051270b49b12 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:23.272825 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 632/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:39:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:23.278546 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4d2b8-3a72-4119-894f-a7b9d9271e2f None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:23.346739 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:23.386438 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4d2b8-3a72-4119-894f-a7b9d9271e2f None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:23.424370 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e566e-4d79-4765-bb0d-5934e8fedee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:23.425044 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e566e-4d79-4765-bb0d-5934e8fedee5 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:23.425327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e566e-4d79-4765-bb0d-5934e8fedee5 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:23.425602 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e566e-4d79-4765-bb0d-5934e8fedee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:23.436407 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e566e-4d79-4765-bb0d-5934e8fedee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:23.437818 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e566e-4d79-4765-bb0d-5934e8fedee5 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:23.451467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-410e566e-4d79-4765-bb0d-5934e8fedee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:23.451467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:23.451467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:23.451467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:23.451467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:23.451467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:23.451467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:23.451467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:23.451467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:23.451467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:23.451467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:23.451467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:23.451467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:39:23.451467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:39:23.451467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:39:23.452801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:39:23.452801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:23.452801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:23.452801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:23.452801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:23.452801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:23.452801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:23.452801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:23.452801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:23.452801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:23.452801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:23.452801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:23.452801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:23.452801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:23.452801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:23.452801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:23.452801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:23.454040 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:39:23.454040 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:39:23.454040 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:23.454040 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:39:23.454515 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 633/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:23.459042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d9d7a-4a0e-4a2a-8f14-051270b49b12 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:23.536792 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:23.554927 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419d9d7a-4a0e-4a2a-8f14-051270b49b12 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:23.587329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943505d-526c-4992-b503-82bddebad94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:23.587940 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943505d-526c-4992-b503-82bddebad94b None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:23.588224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943505d-526c-4992-b503-82bddebad94b None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:23.588502 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4943505d-526c-4992-b503-82bddebad94b None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:23.589186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943505d-526c-4992-b503-82bddebad94b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:23.589493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943505d-526c-4992-b503-82bddebad94b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:23.590892 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4943505d-526c-4992-b503-82bddebad94b None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:23.603009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 633/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:23.608562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e566e-4d79-4765-bb0d-5934e8fedee5 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:23.703825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e566e-4d79-4765-bb0d-5934e8fedee5 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:23.722591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:23.736829 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824a10e-659e-4ef6-8a7b-06fb331c9ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:23.737463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824a10e-659e-4ef6-8a7b-06fb331c9ffb None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:23.737748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824a10e-659e-4ef6-8a7b-06fb331c9ffb None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:23.738022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824a10e-659e-4ef6-8a7b-06fb331c9ffb None admin] PATH_INFO: `/v3/users/placement` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:23.745196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824a10e-659e-4ef6-8a7b-06fb331c9ffb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:23.746645 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824a10e-659e-4ef6-8a7b-06fb331c9ffb None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:23.757501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-6824a10e-659e-4ef6-8a7b-06fb331c9ffb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 22:39:23.757501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:23.757501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:23.757501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:23.757501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:23.757501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:23.757501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:23.757501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:23.757501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:23.757501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:23.757501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:23.757501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:23.757501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:39:23.757501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:39:23.757501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:39:23.757501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:39:23.758666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:23.758666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:23.758666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:39:23.758666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:39:23.758666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:39:23.758666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:39:23.758666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:23.758666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:23.758666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:23.758666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:23.758666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:23.758666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:23.758666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:23.758666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:23.758666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:23.758666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:23.758666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:23.758666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:23.759779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:23.759779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:23.759779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:39:23.759779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:39:23.759779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:39:23.759779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:39:23.759779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:39:23.759779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:39:23.759779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 22:39:23.759779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:39:23.759779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 634/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:39:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:23.764382 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943505d-526c-4992-b503-82bddebad94b None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:23.860535 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4943505d-526c-4992-b503-82bddebad94b None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:23.893587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0a57b-c0fb-4fb8-bfe7-43c30c0ec393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:23.894189 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0a57b-c0fb-4fb8-bfe7-43c30c0ec393 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:23.894506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0a57b-c0fb-4fb8-bfe7-43c30c0ec393 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:23.894784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e0a57b-c0fb-4fb8-bfe7-43c30c0ec393 None admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:23.896163 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0a57b-c0fb-4fb8-bfe7-43c30c0ec393 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:23.896474 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0a57b-c0fb-4fb8-bfe7-43c30c0ec393 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:23.897886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e0a57b-c0fb-4fb8-bfe7-43c30c0ec393 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:23.906134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:23.914842 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 634/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Jul 27 22:39:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:23.920290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824a10e-659e-4ef6-8a7b-06fb331c9ffb None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:24.015661 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824a10e-659e-4ef6-8a7b-06fb331c9ffb None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:24.047362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711ddf7-34ae-4932-ae70-4a439ef48bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:24.047975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711ddf7-34ae-4932-ae70-4a439ef48bb7 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:24.048255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711ddf7-34ae-4932-ae70-4a439ef48bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:24.048526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711ddf7-34ae-4932-ae70-4a439ef48bb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:24.058558 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711ddf7-34ae-4932-ae70-4a439ef48bb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:24.059970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711ddf7-34ae-4932-ae70-4a439ef48bb7 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:24.074076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-3711ddf7-34ae-4932-ae70-4a439ef48bb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:24.074076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:24.074076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:24.074076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:24.074076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:24.074076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:24.074076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:24.074076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:24.074076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:24.074076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:24.074076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:24.074076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:24.074076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:39:24.074076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:39:24.074076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:39:24.075145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:39:24.075145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:24.075145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:24.075145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:24.075145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:24.075145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:24.075145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:24.075145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:24.075145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:24.075145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:24.075145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:24.075145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:24.075145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:24.075145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:24.075145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:24.075145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:24.075145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:24.076092 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:39:24.076092 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:39:24.076092 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:24.076092 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:39:24.076092 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 635/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:24.081023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0a57b-c0fb-4fb8-bfe7-43c30c0ec393 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:24.175712 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e0a57b-c0fb-4fb8-bfe7-43c30c0ec393 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:24.208912 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64103006-2844-47be-8c5f-98adb13a0a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:24.209512 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64103006-2844-47be-8c5f-98adb13a0a21 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:24.209797 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64103006-2844-47be-8c5f-98adb13a0a21 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:24.210076 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64103006-2844-47be-8c5f-98adb13a0a21 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:24.210793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64103006-2844-47be-8c5f-98adb13a0a21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:24.211101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64103006-2844-47be-8c5f-98adb13a0a21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:24.212456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64103006-2844-47be-8c5f-98adb13a0a21 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:24.223193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 635/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:24.228490 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711ddf7-34ae-4932-ae70-4a439ef48bb7 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:24.259466 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:24.329993 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711ddf7-34ae-4932-ae70-4a439ef48bb7 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:24.367082 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1f4ae-0e7a-4d73-8e2c-29fe12cbf064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:24.367829 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1f4ae-0e7a-4d73-8e2c-29fe12cbf064 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:24.368122 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1f4ae-0e7a-4d73-8e2c-29fe12cbf064 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:24.368433 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1f4ae-0e7a-4d73-8e2c-29fe12cbf064 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:24.375341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1f4ae-0e7a-4d73-8e2c-29fe12cbf064 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:24.376817 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e1f4ae-0e7a-4d73-8e2c-29fe12cbf064 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:24.389519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-93e1f4ae-0e7a-4d73-8e2c-29fe12cbf064 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:39:24.389519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:24.389519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:24.389519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:24.389519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:24.389519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:24.389519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:24.389519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:24.389519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:24.389519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:24.389519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:24.389519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:24.389519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:39:24.389519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:39:24.389519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:39:24.390654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:39:24.390654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:24.390654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:24.390654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:24.390654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:24.390654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:24.390654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:24.390654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:24.390654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:24.390654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:24.390654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:24.390654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:24.390654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:24.390654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:24.390654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:24.390654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:24.390654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:24.391929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:39:24.391929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:39:24.391929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:39:24.391929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:39:24.391929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:39:24.391929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:39:24.391929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:39:24.391929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:39:24.391929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 636/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:24.396578 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64103006-2844-47be-8c5f-98adb13a0a21 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:24.453016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:24.494354 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64103006-2844-47be-8c5f-98adb13a0a21 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:24.526933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693a944-a0bf-4cd5-bc59-d50700d9c108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:24.527542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693a944-a0bf-4cd5-bc59-d50700d9c108 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:24.527825 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693a944-a0bf-4cd5-bc59-d50700d9c108 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:24.528104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693a944-a0bf-4cd5-bc59-d50700d9c108 None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:24.528842 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693a944-a0bf-4cd5-bc59-d50700d9c108 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:24.529149 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693a944-a0bf-4cd5-bc59-d50700d9c108 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:24.530588 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f693a944-a0bf-4cd5-bc59-d50700d9c108 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:24.542099 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 636/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:24.547911 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1f4ae-0e7a-4d73-8e2c-29fe12cbf064 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:24.639174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:24.648257 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1f4ae-0e7a-4d73-8e2c-29fe12cbf064 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:24.681169 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9cc5e-0a03-43a7-b07e-53aeafc0cd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:24.681839 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9cc5e-0a03-43a7-b07e-53aeafc0cd5f None admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:24.682126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9cc5e-0a03-43a7-b07e-53aeafc0cd5f None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:24.682440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9cc5e-0a03-43a7-b07e-53aeafc0cd5f None admin] PATH_INFO: `/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/2e3a1384f3b34999a75572ee10a1e3fb/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:24.684355 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9cc5e-0a03-43a7-b07e-53aeafc0cd5f None admin] RBAC: Authorizing `identity:create_grant(project_id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user_id=2e3a1384f3b34999a75572ee10a1e3fb, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:24.685778 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9cc5e-0a03-43a7-b07e-53aeafc0cd5f None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:24.698278 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 637/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Wed Jul 27 22:39:24 2022] PUT /identity/v3/projects/d94f62f9c6ea4d7088ec264bf0ff3cf4/users/2e3a1384f3b34999a75572ee10a1e3fb/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:39:26.638241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8fcda-b186-4c4a-98ff-644aa2338737 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:26.638692 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8fcda-b186-4c4a-98ff-644aa2338737 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:26.638832 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8fcda-b186-4c4a-98ff-644aa2338737 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:26.640188 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 637/1274] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:39:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:39:26.645691 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1da90a-673a-4a65-a3b7-999bfdcaa616 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:26.646059 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1da90a-673a-4a65-a3b7-999bfdcaa616 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:26.646249 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1da90a-673a-4a65-a3b7-999bfdcaa616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:26.664528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-ae1da90a-673a-4a65-a3b7-999bfdcaa616 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:39:26.665704 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ae1da90a-673a-4a65-a3b7-999bfdcaa616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:39:26.730327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 638/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:39:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:39:26.752555 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8fcda-b186-4c4a-98ff-644aa2338737 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:26.850244 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8fcda-b186-4c4a-98ff-644aa2338737 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:26.866565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:26.882844 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158afc5b-95a9-4692-8667-2ebbc1fb34c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:26.883472 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158afc5b-95a9-4692-8667-2ebbc1fb34c1 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:26.883753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158afc5b-95a9-4692-8667-2ebbc1fb34c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:26.884027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158afc5b-95a9-4692-8667-2ebbc1fb34c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:26.893599 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158afc5b-95a9-4692-8667-2ebbc1fb34c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 22:39:26.899077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-158afc5b-95a9-4692-8667-2ebbc1fb34c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:39:26.899077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:26.899077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:26.899077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:26.899077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:26.899077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:26.899077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:26.899077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:26.899077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:26.899077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:26.899077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:26.899077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:26.899077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 22:39:26.899077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 22:39:26.899077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 22:39:26.899077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 22:39:26.900050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 22:39:26.900050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 22:39:26.900050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 22:39:26.900050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 22:39:26.900050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:26.900050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:26.900050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:26.900050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:26.900050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:26.900050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:26.900050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:26.900050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:26.900050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:26.900050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:26.900050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:26.900050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:26.901396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:26.901396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:26.901396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:26.901396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:26.901396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 22:39:26.901396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 22:39:26.901396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 22:39:26.901396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 22:39:26.901396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 22:39:26.901396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 22:39:26.901396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 22:39:26.901396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:26.901396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 638/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Wed Jul 27 22:39:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:26.906231 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1da90a-673a-4a65-a3b7-999bfdcaa616 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:26.983393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:27.001087 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1da90a-673a-4a65-a3b7-999bfdcaa616 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:27.034077 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce092a-9745-4569-97d8-6235c992ad24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:27.034712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce092a-9745-4569-97d8-6235c992ad24 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:27.034998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce092a-9745-4569-97d8-6235c992ad24 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:27.035279 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce092a-9745-4569-97d8-6235c992ad24 None admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:27.036011 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce092a-9745-4569-97d8-6235c992ad24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:27.036319 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce092a-9745-4569-97d8-6235c992ad24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:27.037670 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce092a-9745-4569-97d8-6235c992ad24 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:27.045378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 639/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Wed Jul 27 22:39:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:27.051062 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158afc5b-95a9-4692-8667-2ebbc1fb34c1 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:27.147914 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158afc5b-95a9-4692-8667-2ebbc1fb34c1 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:27.179943 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9bfbc-6789-4ed4-8523-045ede3ca38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:27.180564 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9bfbc-6789-4ed4-8523-045ede3ca38d None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:27.180852 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9bfbc-6789-4ed4-8523-045ede3ca38d None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:27.181132 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9bfbc-6789-4ed4-8523-045ede3ca38d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:27.191183 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9bfbc-6789-4ed4-8523-045ede3ca38d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:27.193247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b9bfbc-6789-4ed4-8523-045ede3ca38d None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:27.209096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-68b9bfbc-6789-4ed4-8523-045ede3ca38d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:27.209096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:27.209096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:27.209096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:27.209096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:27.209096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:27.209096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:27.209096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:27.209096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:27.209096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:27.209096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:27.209096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:27.209096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:39:27.209096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:39:27.209096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:39:27.210000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:39:27.210000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:27.210000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:27.210000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:27.210000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:27.210000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:27.210000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:27.210000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:27.210000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:27.210000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:27.210000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:27.210000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:27.210000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:27.210000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:27.210000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:27.210000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:27.210000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:27.211021 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:39:27.211021 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:39:27.211021 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:27.211021 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:27.211021 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 639/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:27.215953 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce092a-9745-4569-97d8-6235c992ad24 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:27.314514 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce092a-9745-4569-97d8-6235c992ad24 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:27.350352 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160f033-539a-4d76-83f4-0bdc7c7b1025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:27.351032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160f033-539a-4d76-83f4-0bdc7c7b1025 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:27.351429 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160f033-539a-4d76-83f4-0bdc7c7b1025 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:27.351872 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f160f033-539a-4d76-83f4-0bdc7c7b1025 None admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:27.352749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160f033-539a-4d76-83f4-0bdc7c7b1025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:27.353105 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160f033-539a-4d76-83f4-0bdc7c7b1025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:27.354899 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f160f033-539a-4d76-83f4-0bdc7c7b1025 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:27.369553 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 640/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:27.375291 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9bfbc-6789-4ed4-8523-045ede3ca38d None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:27.405799 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:27.473338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9bfbc-6789-4ed4-8523-045ede3ca38d None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:27.506613 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e54cfd-d43f-47f7-ba7f-9dfd0d8d281b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:27.507241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e54cfd-d43f-47f7-ba7f-9dfd0d8d281b None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:27.507527 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e54cfd-d43f-47f7-ba7f-9dfd0d8d281b None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:27.507809 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e54cfd-d43f-47f7-ba7f-9dfd0d8d281b None admin] PATH_INFO: `/v3/users/placement` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:27.514985 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e54cfd-d43f-47f7-ba7f-9dfd0d8d281b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:27.516413 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e54cfd-d43f-47f7-ba7f-9dfd0d8d281b None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:27.527402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-b9e54cfd-d43f-47f7-ba7f-9dfd0d8d281b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 22:39:27.527402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:27.527402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:27.527402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:27.527402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:27.527402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:27.527402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:27.527402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:27.527402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:27.527402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:27.527402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:27.527402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:27.527402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 22:39:27.527402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 22:39:27.527402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 22:39:27.527402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 22:39:27.528601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:27.528601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:27.528601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 22:39:27.528601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:39:27.528601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 22:39:27.528601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 22:39:27.528601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:27.528601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:27.528601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:27.528601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:27.528601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:27.528601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:27.528601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:27.528601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:27.528601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:27.528601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:27.528601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:27.528601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:27.529826 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:27.529826 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:27.529826 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 22:39:27.529826 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 22:39:27.529826 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 22:39:27.529826 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 22:39:27.529826 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 22:39:27.529826 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 22:39:27.529826 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 22:39:27.529826 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:27.529826 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 640/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:39:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 22:39:27.534139 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160f033-539a-4d76-83f4-0bdc7c7b1025 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:27.537839 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:27.633675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f160f033-539a-4d76-83f4-0bdc7c7b1025 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:27.666163 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544de7e-15f8-4700-ba7c-2e3781fb7205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:27.666780 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544de7e-15f8-4700-ba7c-2e3781fb7205 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:27.667024 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544de7e-15f8-4700-ba7c-2e3781fb7205 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:27.667305 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a544de7e-15f8-4700-ba7c-2e3781fb7205 None admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:27.668091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544de7e-15f8-4700-ba7c-2e3781fb7205 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:27.668403 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544de7e-15f8-4700-ba7c-2e3781fb7205 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:27.669814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a544de7e-15f8-4700-ba7c-2e3781fb7205 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:27.687347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 641/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Wed Jul 27 22:39:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:27.693051 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e54cfd-d43f-47f7-ba7f-9dfd0d8d281b None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:27.780047 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:27.790070 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e54cfd-d43f-47f7-ba7f-9dfd0d8d281b None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:27.822426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f2c13-3f39-4b29-a89a-5ab90e8ef801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:27.823044 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f2c13-3f39-4b29-a89a-5ab90e8ef801 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:27.823330 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f2c13-3f39-4b29-a89a-5ab90e8ef801 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:27.823614 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f2c13-3f39-4b29-a89a-5ab90e8ef801 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:27.888945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f2c13-3f39-4b29-a89a-5ab90e8ef801 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:27.890451 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f2c13-3f39-4b29-a89a-5ab90e8ef801 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:27.975486 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:27.985807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 641/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Wed Jul 27 22:39:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 22:39:27.991815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544de7e-15f8-4700-ba7c-2e3781fb7205 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:28.050007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:28.086897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a544de7e-15f8-4700-ba7c-2e3781fb7205 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:28.119439 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d11651-7433-4671-9e0a-d1cb959bb4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:28.120065 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d11651-7433-4671-9e0a-d1cb959bb4b5 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:28.120344 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d11651-7433-4671-9e0a-d1cb959bb4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:28.120618 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d11651-7433-4671-9e0a-d1cb959bb4b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:28.130170 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d11651-7433-4671-9e0a-d1cb959bb4b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:28.131628 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d11651-7433-4671-9e0a-d1cb959bb4b5 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:28.145601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-10d11651-7433-4671-9e0a-d1cb959bb4b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:28.145601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:28.145601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:28.145601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:28.145601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:28.145601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:28.145601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:28.145601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:28.145601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:28.145601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:28.145601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:28.145601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:28.145601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 22:39:28.145601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 22:39:28.145601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 22:39:28.147190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 22:39:28.147190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:28.147190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:28.147190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:28.147190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:28.147190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:28.147190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:28.147190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:28.147190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:28.147190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:28.147190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:28.147190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:28.147190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:28.147190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:28.147190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:28.147190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:28.147190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:28.152772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 22:39:28.152772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 22:39:28.152772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 22:39:28.152772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:39:28.152772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 642/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:28.153121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f2c13-3f39-4b29-a89a-5ab90e8ef801 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:28.248281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f2c13-3f39-4b29-a89a-5ab90e8ef801 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:28.280658 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953ac57-d397-414c-a821-8f93e9758928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:28.281262 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ac57-d397-414c-a821-8f93e9758928 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:28.281549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ac57-d397-414c-a821-8f93e9758928 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:28.281828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953ac57-d397-414c-a821-8f93e9758928 None admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:28.282537 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953ac57-d397-414c-a821-8f93e9758928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:28.282854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953ac57-d397-414c-a821-8f93e9758928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:28.284229 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953ac57-d397-414c-a821-8f93e9758928 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:28.295605 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 642/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Wed Jul 27 22:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:28.301045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d11651-7433-4671-9e0a-d1cb959bb4b5 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:28.401200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d11651-7433-4671-9e0a-d1cb959bb4b5 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:28.414134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:28.433659 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a37c1f-3d70-4b04-90ac-0a7412f233e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:28.434297 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a37c1f-3d70-4b04-90ac-0a7412f233e4 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:28.434619 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a37c1f-3d70-4b04-90ac-0a7412f233e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:28.434899 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a37c1f-3d70-4b04-90ac-0a7412f233e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:28.441418 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a37c1f-3d70-4b04-90ac-0a7412f233e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:28.443391 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a37c1f-3d70-4b04-90ac-0a7412f233e4 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:28.454847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application [None req-53a37c1f-3d70-4b04-90ac-0a7412f233e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:39:28.454847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:28.454847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:28.454847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:28.454847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:28.454847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:28.454847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:28.454847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:28.454847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:28.454847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:28.454847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:28.454847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:28.454847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 22:39:28.454847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 22:39:28.454847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 22:39:28.455926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 22:39:28.455926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:28.455926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:28.455926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:28.455926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:28.455926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:28.455926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:28.455926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:28.455926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:28.455926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:28.455926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:28.455926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:28.455926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:28.455926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:28.455926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:28.455926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:28.455926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:28.457003 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 22:39:28.457003 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 22:39:28.457003 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 22:39:28.457003 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 22:39:28.457003 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 22:39:28.457003 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 22:39:28.457003 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 22:39:28.457003 dv-cinder-851249-4-smb devstack@keystone.service[86594]: ERROR keystone.server.flask.application Jul 27 22:39:28.457003 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 643/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Wed Jul 27 22:39:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:28.462565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953ac57-d397-414c-a821-8f93e9758928 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:28.510148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:28.559683 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953ac57-d397-414c-a821-8f93e9758928 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:28.592716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d9830-dc4e-4676-94dc-dee2753dc7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:28.593328 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d9830-dc4e-4676-94dc-dee2753dc7d1 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:28.593613 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d9830-dc4e-4676-94dc-dee2753dc7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:28.593890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d9830-dc4e-4676-94dc-dee2753dc7d1 None admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:28.594675 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d9830-dc4e-4676-94dc-dee2753dc7d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:28.594983 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d9830-dc4e-4676-94dc-dee2753dc7d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:28.596407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d9830-dc4e-4676-94dc-dee2753dc7d1 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:28.608013 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 643/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Wed Jul 27 22:39:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:28.614025 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a37c1f-3d70-4b04-90ac-0a7412f233e4 None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:28.710602 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a37c1f-3d70-4b04-90ac-0a7412f233e4 None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:28.742709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541fc20a-d8d5-4638-833e-ecf44f1d79e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:28.743307 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fc20a-d8d5-4638-833e-ecf44f1d79e7 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:28.743598 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fc20a-d8d5-4638-833e-ecf44f1d79e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:28.743864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541fc20a-d8d5-4638-833e-ecf44f1d79e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:28.744642 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fc20a-d8d5-4638-833e-ecf44f1d79e7 None admin] RBAC: Adding query filter params (role.id=49e0ba8d8c9f4824892b61f05d0036e8, scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4, user.id=2e3a1384f3b34999a75572ee10a1e3fb) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:28.744950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fc20a-d8d5-4638-833e-ecf44f1d79e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:28.746373 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541fc20a-d8d5-4638-833e-ecf44f1d79e7 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:28.751926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 644/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Wed Jul 27 22:39:28 2022] GET /identity/v3/role_assignments?user.id=2e3a1384f3b34999a75572ee10a1e3fb&scope.project.id=d94f62f9c6ea4d7088ec264bf0ff3cf4&role.id=49e0ba8d8c9f4824892b61f05d0036e8 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:30.712728 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9194f-d9a5-4676-86dc-ec7e80ffeb66 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:30.713274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9194f-d9a5-4676-86dc-ec7e80ffeb66 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:30.713274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9194f-d9a5-4676-86dc-ec7e80ffeb66 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:30.714672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 644/1288] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:39:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:39:30.719698 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4c445-39fc-4b6c-8139-0f6761b33274 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:30.720092 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4c445-39fc-4b6c-8139-0f6761b33274 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:30.720255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4c445-39fc-4b6c-8139-0f6761b33274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:30.738318 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-c3c4c445-39fc-4b6c-8139-0f6761b33274 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:39:30.740109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-c3c4c445-39fc-4b6c-8139-0f6761b33274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:39:30.767970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:30.804317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 645/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:39:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:39:30.825349 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9194f-d9a5-4676-86dc-ec7e80ffeb66 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:30.922111 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9194f-d9a5-4676-86dc-ec7e80ffeb66 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:30.932730 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:30.955528 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd645373-4809-4f6d-b670-56d6cb052d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:30.956151 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd645373-4809-4f6d-b670-56d6cb052d0c None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:30.956431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd645373-4809-4f6d-b670-56d6cb052d0c None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:30.956702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd645373-4809-4f6d-b670-56d6cb052d0c None admin] PATH_INFO: `/v3/services/placement` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:30.957316 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd645373-4809-4f6d-b670-56d6cb052d0c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:30.959231 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd645373-4809-4f6d-b670-56d6cb052d0c None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:30.967702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-dd645373-4809-4f6d-b670-56d6cb052d0c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 22:39:30.967702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:30.967702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:39:30.967702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:39:30.967702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:39:30.967702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:39:30.967702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:39:30.967702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:39:30.967702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 22:39:30.967702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:30.967702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:39:30.967702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:30.967702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:30.967702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:30.967702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:30.967702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:30.967702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:30.968933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:30.968933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:30.968933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:30.968933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:30.968933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:30.968933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:30.968933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:39:30.968933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:39:30.968933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:39:30.968933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:39:30.968933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:30.968933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:30.968933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:30.968933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:30.968933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:30.968933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:30.970059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:30.970059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:30.970059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:30.970059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:30.970059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:30.970059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:30.970059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:30.970059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:30.970059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:30.970059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:30.970059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:39:30.970059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:39:30.970059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 22:39:30.970059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:30.970059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 645/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jul 27 22:39:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:30.975657 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4c445-39fc-4b6c-8139-0f6761b33274 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:31.068526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4c445-39fc-4b6c-8139-0f6761b33274 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:31.102095 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc79c2-bac9-4f32-8b5b-fa31950aa733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:31.102723 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc79c2-bac9-4f32-8b5b-fa31950aa733 None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:31.103005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc79c2-bac9-4f32-8b5b-fa31950aa733 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:31.103276 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc79c2-bac9-4f32-8b5b-fa31950aa733 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:31.103936 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc79c2-bac9-4f32-8b5b-fa31950aa733 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:31.104241 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc79c2-bac9-4f32-8b5b-fa31950aa733 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:31.105573 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc79c2-bac9-4f32-8b5b-fa31950aa733 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:31.110136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 646/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Wed Jul 27 22:39:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:31.115722 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd645373-4809-4f6d-b670-56d6cb052d0c None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:31.212274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd645373-4809-4f6d-b670-56d6cb052d0c None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:31.247177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5671a172-32f9-4b30-a159-b9222202adeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:31.247177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671a172-32f9-4b30-a159-b9222202adeb None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:31.247177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671a172-32f9-4b30-a159-b9222202adeb None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:31.247514 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5671a172-32f9-4b30-a159-b9222202adeb None admin] PATH_INFO: `/v3/services` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:31.247899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671a172-32f9-4b30-a159-b9222202adeb None admin] RBAC: Adding query filter params (type=placement) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:31.248203 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671a172-32f9-4b30-a159-b9222202adeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:31.249771 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5671a172-32f9-4b30-a159-b9222202adeb None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:31.254981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 646/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Wed Jul 27 22:39:31 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:33.241116 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5b8b-82db-49f9-877b-a7433175066e None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:33.241745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5b8b-82db-49f9-877b-a7433175066e None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:33.241745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcd5b8b-82db-49f9-877b-a7433175066e None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:33.243059 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 647/1293] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:39:33.247976 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dd4f3-43aa-4ea9-90f1-75dd865a31eb None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:33.248388 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dd4f3-43aa-4ea9-90f1-75dd865a31eb None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:33.248532 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85dd4f3-43aa-4ea9-90f1-75dd865a31eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:33.266634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-c85dd4f3-43aa-4ea9-90f1-75dd865a31eb None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:39:33.267791 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c85dd4f3-43aa-4ea9-90f1-75dd865a31eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:39:33.298639 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:33.335676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 647/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:39:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:39:33.360102 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd5b8b-82db-49f9-877b-a7433175066e None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:33.398275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:33.467757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcd5b8b-82db-49f9-877b-a7433175066e None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:33.500350 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630dc289-0182-447a-a584-e81fc96ef6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:33.500902 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dc289-0182-447a-a584-e81fc96ef6d4 None admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:33.501189 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dc289-0182-447a-a584-e81fc96ef6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:33.501469 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630dc289-0182-447a-a584-e81fc96ef6d4 None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:33.502170 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630dc289-0182-447a-a584-e81fc96ef6d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:33.503553 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630dc289-0182-447a-a584-e81fc96ef6d4 None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:33.517363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 648/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Wed Jul 27 22:39:33 2022] POST /identity/v3/services => generated 246 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:39:35.484101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d6c0d-c8a2-4e38-a917-ed9fe12c82dd None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:35.484672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d6c0d-c8a2-4e38-a917-ed9fe12c82dd None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:35.484672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d6c0d-c8a2-4e38-a917-ed9fe12c82dd None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:35.485986 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 648/1296] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:39:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:39:35.491497 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c02e00-8e16-4055-bf72-16db569081d2 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:35.492062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c02e00-8e16-4055-bf72-16db569081d2 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:35.492343 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c02e00-8e16-4055-bf72-16db569081d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:35.510607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-60c02e00-8e16-4055-bf72-16db569081d2 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:39:35.511777 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-60c02e00-8e16-4055-bf72-16db569081d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:39:35.581787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 649/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:39:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:39:35.603412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d6c0d-c8a2-4e38-a917-ed9fe12c82dd None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:35.705194 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d6c0d-c8a2-4e38-a917-ed9fe12c82dd None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:35.736797 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f895a-1ccf-4331-a155-8f888ca4f722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:35.737360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f895a-1ccf-4331-a155-8f888ca4f722 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:35.737642 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f895a-1ccf-4331-a155-8f888ca4f722 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:35.737915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f895a-1ccf-4331-a155-8f888ca4f722 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:35.738563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f895a-1ccf-4331-a155-8f888ca4f722 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:35.740451 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f895a-1ccf-4331-a155-8f888ca4f722 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:35.748948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-855f895a-1ccf-4331-a155-8f888ca4f722 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 22:39:35.748948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:35.748948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:39:35.748948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:39:35.748948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:39:35.748948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:39:35.748948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:39:35.748948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:39:35.748948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 22:39:35.748948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:35.748948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:39:35.748948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:35.748948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:35.748948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:35.748948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:35.748948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:35.748948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:35.750200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:35.750200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:35.750200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:35.750200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:35.750200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:35.750200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:35.750200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:39:35.750200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:39:35.750200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:39:35.750200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:39:35.750200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:35.750200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:35.750200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:35.750200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:35.750200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:35.750200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:35.751348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:35.751348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:35.751348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:35.751348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:35.751348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:35.751348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:35.751348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:35.751348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:35.751348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:35.751348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:35.751348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:39:35.751348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:39:35.751348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 22:39:35.751348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:35.751348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 649/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jul 27 22:39:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:35.756657 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c02e00-8e16-4055-bf72-16db569081d2 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:35.775046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:35.859182 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c02e00-8e16-4055-bf72-16db569081d2 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:35.891763 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaa3a2-99dc-46d4-a99a-c4513b14b28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:35.892381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaa3a2-99dc-46d4-a99a-c4513b14b28f None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:35.892665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaa3a2-99dc-46d4-a99a-c4513b14b28f None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:35.892943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becaa3a2-99dc-46d4-a99a-c4513b14b28f None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:35.893613 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaa3a2-99dc-46d4-a99a-c4513b14b28f None admin] RBAC: Adding query filter params (name=placement) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:35.893920 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaa3a2-99dc-46d4-a99a-c4513b14b28f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:35.895306 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becaa3a2-99dc-46d4-a99a-c4513b14b28f None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:35.901050 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 650/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Wed Jul 27 22:39:35 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:35.907017 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f895a-1ccf-4331-a155-8f888ca4f722 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:35.938126 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:36.009644 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f895a-1ccf-4331-a155-8f888ca4f722 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:36.042223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc947c5-4d8c-4705-97a6-ffe11cf7477f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:36.042869 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc947c5-4d8c-4705-97a6-ffe11cf7477f None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:36.043156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc947c5-4d8c-4705-97a6-ffe11cf7477f None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:36.043435 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc947c5-4d8c-4705-97a6-ffe11cf7477f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:36.044185 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc947c5-4d8c-4705-97a6-ffe11cf7477f None admin] RBAC: Adding query filter params (interface=public, service_id=506e3db3c5ce4a23b37c52e9ffdcd303, region_id=RegionOne) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:36.044500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc947c5-4d8c-4705-97a6-ffe11cf7477f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:36.045868 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc947c5-4d8c-4705-97a6-ffe11cf7477f None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:36.050833 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 650/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Wed Jul 27 22:39:35 2022] GET /identity/v3/endpoints?service_id=506e3db3c5ce4a23b37c52e9ffdcd303&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:36.056505 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaa3a2-99dc-46d4-a99a-c4513b14b28f None admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:36.135440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:36.154081 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becaa3a2-99dc-46d4-a99a-c4513b14b28f None admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:36.186898 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb3f30d-3e28-4b81-96a2-1c010c76068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:36.187502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3f30d-3e28-4b81-96a2-1c010c76068b None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:36.187785 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3f30d-3e28-4b81-96a2-1c010c76068b None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:36.188062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb3f30d-3e28-4b81-96a2-1c010c76068b None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:36.188710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3f30d-3e28-4b81-96a2-1c010c76068b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:36.190052 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb3f30d-3e28-4b81-96a2-1c010c76068b None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:36.197276 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 651/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Wed Jul 27 22:39:36 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:39:38.220117 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2b582-69b8-46c1-847b-83843c1f3d06 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:38.220653 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2b582-69b8-46c1-847b-83843c1f3d06 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:38.220747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c2b582-69b8-46c1-847b-83843c1f3d06 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:38.222030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 651/1302] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:39:38.227607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efcfd5-7622-4b94-b74a-f68310f3a4ed None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:38.227997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efcfd5-7622-4b94-b74a-f68310f3a4ed None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:38.228178 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8efcfd5-7622-4b94-b74a-f68310f3a4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:38.246443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-e8efcfd5-7622-4b94-b74a-f68310f3a4ed None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:39:38.247610 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e8efcfd5-7622-4b94-b74a-f68310f3a4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:39:38.311552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 652/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:39:38 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 22:39:38.333521 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2b582-69b8-46c1-847b-83843c1f3d06 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:38.443278 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:38.450106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c2b582-69b8-46c1-847b-83843c1f3d06 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:38.483317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb6e0f-17ef-4cfb-8d3b-9c0da09f7487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:38.483891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb6e0f-17ef-4cfb-8d3b-9c0da09f7487 None admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:38.484177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb6e0f-17ef-4cfb-8d3b-9c0da09f7487 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:38.484455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cb6e0f-17ef-4cfb-8d3b-9c0da09f7487 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:38.485080 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb6e0f-17ef-4cfb-8d3b-9c0da09f7487 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:38.486469 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cb6e0f-17ef-4cfb-8d3b-9c0da09f7487 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:38.495196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application [None req-72cb6e0f-17ef-4cfb-8d3b-9c0da09f7487 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 22:39:38.495196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:38.495196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 22:39:38.495196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 22:39:38.495196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 22:39:38.495196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 22:39:38.495196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 22:39:38.495196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:39:38.495196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 22:39:38.495196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:38.495196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 22:39:38.495196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:38.495196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 22:39:38.495196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 22:39:38.495196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 22:39:38.495196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 22:39:38.495196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 22:39:38.496360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 22:39:38.496360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 22:39:38.496360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 22:39:38.496360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 22:39:38.496360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 22:39:38.496360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 22:39:38.496360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 22:39:38.496360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 22:39:38.496360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 22:39:38.496360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 22:39:38.496360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 22:39:38.496360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 22:39:38.496360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 22:39:38.496360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 22:39:38.496360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 22:39:38.496360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 22:39:38.497323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 22:39:38.497323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application with Lock( Jul 27 22:39:38.497323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 22:39:38.497323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self._enter() Jul 27 22:39:38.497323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 22:39:38.497323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 22:39:38.497323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 22:39:38.497323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application return self.creator() Jul 27 22:39:38.497323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 22:39:38.497323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application created_value = creator( Jul 27 22:39:38.497323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 22:39:38.497323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 22:39:38.497323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 22:39:38.497323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: ERROR keystone.server.flask.application Jul 27 22:39:38.497323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 652/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Wed Jul 27 22:39:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 22:39:38.502475 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efcfd5-7622-4b94-b74a-f68310f3a4ed None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:38.574772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:38.597628 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8efcfd5-7622-4b94-b74a-f68310f3a4ed None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:38.632579 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbef4a64-df74-40e4-bea1-10edb7b1061c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:38.633196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef4a64-df74-40e4-bea1-10edb7b1061c None admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:38.633479 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef4a64-df74-40e4-bea1-10edb7b1061c None admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:38.633755 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef4a64-df74-40e4-bea1-10edb7b1061c None admin] PATH_INFO: `/v3/services` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:38.634462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef4a64-df74-40e4-bea1-10edb7b1061c None admin] RBAC: Adding query filter params (name=placement) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:39:38.634774 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef4a64-df74-40e4-bea1-10edb7b1061c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:38.636132 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbef4a64-df74-40e4-bea1-10edb7b1061c None admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:38.641060 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 653/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Wed Jul 27 22:39:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:39:38.647337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb6e0f-17ef-4cfb-8d3b-9c0da09f7487 None admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:39:38.761244 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cb6e0f-17ef-4cfb-8d3b-9c0da09f7487 None admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:39:38.794100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3cc0a3-982e-49fd-84a2-347f37f04301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:39:38.794739 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cc0a3-982e-49fd-84a2-347f37f04301 None admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:39:38.795028 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cc0a3-982e-49fd-84a2-347f37f04301 None admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:39:38.795309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3cc0a3-982e-49fd-84a2-347f37f04301 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:39:38.796009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cc0a3-982e-49fd-84a2-347f37f04301 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:39:38.797366 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3cc0a3-982e-49fd-84a2-347f37f04301 None admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:39:38.815764 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 653/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:39:38 2022] POST /identity/v3/endpoints => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:39:48.638131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=30 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:39:48.811647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:40:41.280774 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d2bab-ef1b-4c05-96d4-84f76fa95339 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:41.281854 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d2bab-ef1b-4c05-96d4-84f76fa95339 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:41.282398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86d2bab-ef1b-4c05-96d4-84f76fa95339 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:41.288461 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 654/1307] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:40:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:40:41.289831 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc06460-a1ac-4858-a24e-dbc5a0123776 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:41.290259 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc06460-a1ac-4858-a24e-dbc5a0123776 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:41.290506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc06460-a1ac-4858-a24e-dbc5a0123776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:41.438224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-4fc06460-a1ac-4858-a24e-dbc5a0123776 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:40:41.441663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-4fc06460-a1ac-4858-a24e-dbc5a0123776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:41.645863 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 654/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:40:41.697278 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d052371-30b9-4a32-adda-f77f3a68e92c None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:41.697648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d052371-30b9-4a32-adda-f77f3a68e92c None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:41.698277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d052371-30b9-4a32-adda-f77f3a68e92c None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:41.699814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 655/1309] 10.222.0.48 () {54 vars in 965 bytes} [Wed Jul 27 22:40:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:40:41.707530 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21464d6-58d7-48e1-947c-10dbfdcc776d None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:41.707897 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21464d6-58d7-48e1-947c-10dbfdcc776d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:41.708418 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21464d6-58d7-48e1-947c-10dbfdcc776d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:41.796817 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-c21464d6-58d7-48e1-947c-10dbfdcc776d None None] MFA Rules not processed for user `c266721767004428b9b54dd200f3cd6b`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:40:41.797972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c21464d6-58d7-48e1-947c-10dbfdcc776d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:41.819463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:40:41.876859 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 655/1310] 10.222.0.48 () {58 vars in 1062 bytes} [Wed Jul 27 22:40:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:40:41.886723 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d052371-30b9-4a32-adda-f77f3a68e92c None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:40:41.888528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-4d052371-30b9-4a32-adda-f77f3a68e92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:42.000955 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d052371-30b9-4a32-adda-f77f3a68e92c None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:40:42.073413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3ad65-bb8e-4a3a-9402-56b627ea44fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:40:42.073958 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3ad65-bb8e-4a3a-9402-56b627ea44fb service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:42.074241 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3ad65-bb8e-4a3a-9402-56b627ea44fb service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:42.074537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3ad65-bb8e-4a3a-9402-56b627ea44fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:42.076168 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-73c3ad65-bb8e-4a3a-9402-56b627ea44fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:42.130865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:40:42.188659 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3ad65-bb8e-4a3a-9402-56b627ea44fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:40:42.190297 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3ad65-bb8e-4a3a-9402-56b627ea44fb service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:40:42.213268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 656/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:40:44.504743 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cd058-ce08-4a2b-9a86-1ee5712fec6d None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:44.505309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cd058-ce08-4a2b-9a86-1ee5712fec6d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:44.505309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cd058-ce08-4a2b-9a86-1ee5712fec6d None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:44.506683 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 656/1312] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:40:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:40:44.512013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a09b09-fa65-4187-be48-60faf0907dab None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:44.512410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a09b09-fa65-4187-be48-60faf0907dab None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:44.512579 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a09b09-fa65-4187-be48-60faf0907dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:44.601767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-10a09b09-fa65-4187-be48-60faf0907dab None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:40:44.603008 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-10a09b09-fa65-4187-be48-60faf0907dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:44.709376 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 657/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:40:44.749334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cd058-ce08-4a2b-9a86-1ee5712fec6d None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:40:44.750913 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-450cd058-ce08-4a2b-9a86-1ee5712fec6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:44.854486 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cd058-ce08-4a2b-9a86-1ee5712fec6d None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:40:44.927020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:40:44.931016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85ed8f-cc2a-4f9d-b4a1-08f372df30a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:40:44.931600 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85ed8f-cc2a-4f9d-b4a1-08f372df30a4 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:44.932091 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85ed8f-cc2a-4f9d-b4a1-08f372df30a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:44.934725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85ed8f-cc2a-4f9d-b4a1-08f372df30a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:44.936562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-3f85ed8f-cc2a-4f9d-b4a1-08f372df30a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:45.043863 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85ed8f-cc2a-4f9d-b4a1-08f372df30a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:40:45.045278 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f85ed8f-cc2a-4f9d-b4a1-08f372df30a4 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:40:45.063530 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 657/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:40:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:40:47.381240 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde5153-8900-4ecf-ae8a-d2a0962e9501 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:47.381776 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde5153-8900-4ecf-ae8a-d2a0962e9501 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:47.381776 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde5153-8900-4ecf-ae8a-d2a0962e9501 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:47.383320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 658/1315] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:40:47.388256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d55f8-a699-4e75-a8d0-e896499f2ed3 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:47.388637 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d55f8-a699-4e75-a8d0-e896499f2ed3 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:47.388810 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d55f8-a699-4e75-a8d0-e896499f2ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:47.460705 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-7e4d55f8-a699-4e75-a8d0-e896499f2ed3 None None] MFA Rules not processed for user `427c46ab26884620ba19e763d2a97b83`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:40:47.461919 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-7e4d55f8-a699-4e75-a8d0-e896499f2ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:47.515335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:40:47.561027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 658/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:40:47 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:40:47.613810 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1aea1-5286-498d-b855-7b27a4c2582a None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:47.614237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1aea1-5286-498d-b855-7b27a4c2582a None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:47.614466 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1aea1-5286-498d-b855-7b27a4c2582a None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:47.615757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 659/1317] 10.222.0.48 () {54 vars in 965 bytes} [Wed Jul 27 22:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:40:47.622049 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce215bfb-bd6c-4345-b7bb-2f9f82af5438 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:47.622437 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce215bfb-bd6c-4345-b7bb-2f9f82af5438 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:47.622648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce215bfb-bd6c-4345-b7bb-2f9f82af5438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:47.703505 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-ce215bfb-bd6c-4345-b7bb-2f9f82af5438 None None] MFA Rules not processed for user `c266721767004428b9b54dd200f3cd6b`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:40:47.704728 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ce215bfb-bd6c-4345-b7bb-2f9f82af5438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:47.780837 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 659/1318] 10.222.0.48 () {58 vars in 1062 bytes} [Wed Jul 27 22:40:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:40:47.789814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1aea1-5286-498d-b855-7b27a4c2582a None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:40:47.791433 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-9ac1aea1-5286-498d-b855-7b27a4c2582a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:47.801589 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:40:47.894997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1aea1-5286-498d-b855-7b27a4c2582a None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:40:47.966534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b02b9-0c3c-4b77-a674-4c6342b93424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:40:47.967151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b02b9-0c3c-4b77-a674-4c6342b93424 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:47.967436 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b02b9-0c3c-4b77-a674-4c6342b93424 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:47.967719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b02b9-0c3c-4b77-a674-4c6342b93424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:47.969331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-fc5b02b9-0c3c-4b77-a674-4c6342b93424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:48.030201 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:40:48.076619 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b02b9-0c3c-4b77-a674-4c6342b93424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:40:48.077994 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b02b9-0c3c-4b77-a674-4c6342b93424 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:40:48.095844 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 660/1319] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:40:47 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:40:51.013933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2a0c5-33c0-435d-b966-bfcc3832794c None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:51.014457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2a0c5-33c0-435d-b966-bfcc3832794c None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:51.014573 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2a0c5-33c0-435d-b966-bfcc3832794c None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:51.015896 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 660/1320] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:40:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:40:51.021099 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7b093-7372-41fc-9964-09dba11be4ba None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:51.021525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7b093-7372-41fc-9964-09dba11be4ba None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:51.021663 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7b093-7372-41fc-9964-09dba11be4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:51.086321 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-e1a7b093-7372-41fc-9964-09dba11be4ba None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:40:51.087563 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e1a7b093-7372-41fc-9964-09dba11be4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:51.182412 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 661/1321] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:40:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:40:51.220958 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2a0c5-33c0-435d-b966-bfcc3832794c None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:40:51.223151 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-91d2a0c5-33c0-435d-b966-bfcc3832794c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:51.272541 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:40:51.325180 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2a0c5-33c0-435d-b966-bfcc3832794c None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:40:51.400177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec8b8d9-7bdc-427a-bd0b-ef2777212bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:40:51.400803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8b8d9-7bdc-427a-bd0b-ef2777212bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:51.401084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8b8d9-7bdc-427a-bd0b-ef2777212bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:51.401358 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec8b8d9-7bdc-427a-bd0b-ef2777212bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:51.402980 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-6ec8b8d9-7bdc-427a-bd0b-ef2777212bb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:51.496098 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:40:51.509156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8b8d9-7bdc-427a-bd0b-ef2777212bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:40:51.510610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec8b8d9-7bdc-427a-bd0b-ef2777212bb3 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:40:51.529194 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 661/1322] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:40:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:40:54.236750 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928501e-392a-4f7e-95eb-f8f14613a66a None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:54.237326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928501e-392a-4f7e-95eb-f8f14613a66a None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:54.237326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7928501e-392a-4f7e-95eb-f8f14613a66a None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:54.238717 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 662/1323] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:40:54.243779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa450c-039d-4416-acb4-f860c750d473 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:54.244203 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa450c-039d-4416-acb4-f860c750d473 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:54.244480 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa450c-039d-4416-acb4-f860c750d473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:54.311571 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-0faa450c-039d-4416-acb4-f860c750d473 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:40:54.312805 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-0faa450c-039d-4416-acb4-f860c750d473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:54.413817 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 662/1324] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:40:54.449859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928501e-392a-4f7e-95eb-f8f14613a66a None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:40:54.451456 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-7928501e-392a-4f7e-95eb-f8f14613a66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:54.474402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:40:54.563677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7928501e-392a-4f7e-95eb-f8f14613a66a None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:40:54.638727 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cd191-a7ea-4d6f-939f-0af86ee5ed63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:40:54.639343 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cd191-a7ea-4d6f-939f-0af86ee5ed63 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:54.639626 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cd191-a7ea-4d6f-939f-0af86ee5ed63 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:54.639934 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cd191-a7ea-4d6f-939f-0af86ee5ed63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:54.641591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-775cd191-a7ea-4d6f-939f-0af86ee5ed63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:54.712206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:40:54.749446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775cd191-a7ea-4d6f-939f-0af86ee5ed63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:40:54.750937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775cd191-a7ea-4d6f-939f-0af86ee5ed63 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:40:54.769703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 663/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:40:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:40:56.866889 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa2d8b-99d6-4d1c-b385-a47291a9d97f None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:56.867409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa2d8b-99d6-4d1c-b385-a47291a9d97f None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:56.867409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa2d8b-99d6-4d1c-b385-a47291a9d97f None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:56.868723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 663/1326] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:40:56.874006 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14adf8-10fe-44fb-8bbd-c813baa110ce None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:56.874471 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14adf8-10fe-44fb-8bbd-c813baa110ce None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:56.874616 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14adf8-10fe-44fb-8bbd-c813baa110ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:56.940803 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-6c14adf8-10fe-44fb-8bbd-c813baa110ce None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:40:56.942020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6c14adf8-10fe-44fb-8bbd-c813baa110ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:57.040790 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 664/1327] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:40:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:40:57.076606 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa2d8b-99d6-4d1c-b385-a47291a9d97f None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:40:57.078423 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-47aa2d8b-99d6-4d1c-b385-a47291a9d97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:57.139892 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:40:57.183647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa2d8b-99d6-4d1c-b385-a47291a9d97f None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:40:57.258606 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40d0e9-f053-471a-890a-f3bd183efdbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:40:57.259582 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40d0e9-f053-471a-890a-f3bd183efdbb service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:57.260032 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40d0e9-f053-471a-890a-f3bd183efdbb service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:57.260504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40d0e9-f053-471a-890a-f3bd183efdbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:57.263677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-da40d0e9-f053-471a-890a-f3bd183efdbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:57.377436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:40:57.380561 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40d0e9-f053-471a-890a-f3bd183efdbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:40:57.382297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da40d0e9-f053-471a-890a-f3bd183efdbb service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:40:57.400726 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 664/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:40:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:40:59.481782 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26e49e-d987-40a6-ac25-b03596dddbac None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:59.482306 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26e49e-d987-40a6-ac25-b03596dddbac None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:59.482426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26e49e-d987-40a6-ac25-b03596dddbac None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:59.483809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 665/1329] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:40:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:40:59.489586 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e176f7-018f-4f7e-9285-170fbdcfe43c None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:59.489996 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e176f7-018f-4f7e-9285-170fbdcfe43c None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:59.490287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e176f7-018f-4f7e-9285-170fbdcfe43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:59.555271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-59e176f7-018f-4f7e-9285-170fbdcfe43c None None] MFA Rules not processed for user `427c46ab26884620ba19e763d2a97b83`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:40:59.556472 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-59e176f7-018f-4f7e-9285-170fbdcfe43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:59.659398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 665/1330] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:40:59 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:40:59.700424 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26e49e-d987-40a6-ac25-b03596dddbac None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:40:59.701963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-4e26e49e-d987-40a6-ac25-b03596dddbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:59.734637 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:40:59.810971 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26e49e-d987-40a6-ac25-b03596dddbac None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:40:59.884779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a35f1e-f9bb-49de-9434-ab907f644f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:40:59.885401 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a35f1e-f9bb-49de-9434-ab907f644f3e service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:40:59.885685 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a35f1e-f9bb-49de-9434-ab907f644f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:40:59.885960 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a35f1e-f9bb-49de-9434-ab907f644f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:40:59.887626 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-81a35f1e-f9bb-49de-9434-ab907f644f3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:40:59.963915 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:00.002257 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a35f1e-f9bb-49de-9434-ab907f644f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:41:00.003729 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a35f1e-f9bb-49de-9434-ab907f644f3e service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:41:00.021379 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 666/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:40:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:41:02.287184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0e3c2-7aeb-4188-85f8-0daa294988d8 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:02.287719 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0e3c2-7aeb-4188-85f8-0daa294988d8 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:02.287834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0e3c2-7aeb-4188-85f8-0daa294988d8 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:02.289107 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 666/1332] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:02.294142 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c9fe1-1ea7-417a-bb1d-b42c10c75415 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:02.294559 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c9fe1-1ea7-417a-bb1d-b42c10c75415 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:02.294740 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c9fe1-1ea7-417a-bb1d-b42c10c75415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:02.360734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-758c9fe1-1ea7-417a-bb1d-b42c10c75415 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:02.361962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-758c9fe1-1ea7-417a-bb1d-b42c10c75415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:02.456983 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 667/1333] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:41:02.493999 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0e3c2-7aeb-4188-85f8-0daa294988d8 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:41:02.495731 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5ea0e3c2-7aeb-4188-85f8-0daa294988d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:02.588113 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:02.622530 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0e3c2-7aeb-4188-85f8-0daa294988d8 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:41:02.693556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029e640-ea14-4c18-8e6c-917378239cc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:41:02.694167 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029e640-ea14-4c18-8e6c-917378239cc0 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:02.694478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029e640-ea14-4c18-8e6c-917378239cc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:02.694756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029e640-ea14-4c18-8e6c-917378239cc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:02.696363 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8029e640-ea14-4c18-8e6c-917378239cc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:02.801341 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029e640-ea14-4c18-8e6c-917378239cc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:41:02.802810 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029e640-ea14-4c18-8e6c-917378239cc0 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:41:02.812605 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:02.821855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 667/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:41:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:41:04.895372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214781e4-c92a-4de0-a619-3cb71efcd186 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:04.895893 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214781e4-c92a-4de0-a619-3cb71efcd186 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:04.896012 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214781e4-c92a-4de0-a619-3cb71efcd186 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:04.897300 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 668/1335] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:04.902398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be25f91-b4b7-475a-8c98-4c7f6324d7f2 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:04.902806 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be25f91-b4b7-475a-8c98-4c7f6324d7f2 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:04.902961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be25f91-b4b7-475a-8c98-4c7f6324d7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:04.967993 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-2be25f91-b4b7-475a-8c98-4c7f6324d7f2 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:04.969188 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-2be25f91-b4b7-475a-8c98-4c7f6324d7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:05.064206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 668/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:41:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:41:05.103949 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214781e4-c92a-4de0-a619-3cb71efcd186 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:41:05.105500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-214781e4-c92a-4de0-a619-3cb71efcd186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:05.145999 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:05.208879 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214781e4-c92a-4de0-a619-3cb71efcd186 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:41:05.280137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863693b-03fc-4b0b-ae8f-74846239db2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:41:05.280755 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863693b-03fc-4b0b-ae8f-74846239db2a service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:05.281039 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863693b-03fc-4b0b-ae8f-74846239db2a service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:05.281318 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863693b-03fc-4b0b-ae8f-74846239db2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:05.282974 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-4863693b-03fc-4b0b-ae8f-74846239db2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:05.366226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:05.399531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863693b-03fc-4b0b-ae8f-74846239db2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:41:05.401049 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863693b-03fc-4b0b-ae8f-74846239db2a service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:41:05.419267 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 669/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:41:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:41:07.734385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fac1a3-814a-4c52-bd28-8cc94fdff450 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:07.734947 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fac1a3-814a-4c52-bd28-8cc94fdff450 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:07.734947 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fac1a3-814a-4c52-bd28-8cc94fdff450 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:07.736294 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 669/1338] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:07.741927 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e42ffb-7d2f-46c2-96f2-12a1c2049028 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:07.742322 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e42ffb-7d2f-46c2-96f2-12a1c2049028 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:07.742516 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e42ffb-7d2f-46c2-96f2-12a1c2049028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:07.806523 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-38e42ffb-7d2f-46c2-96f2-12a1c2049028 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:07.807716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-38e42ffb-7d2f-46c2-96f2-12a1c2049028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:07.901470 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 670/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:41:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:41:07.937969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fac1a3-814a-4c52-bd28-8cc94fdff450 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:41:07.939523 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-13fac1a3-814a-4c52-bd28-8cc94fdff450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:08.016377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:08.044173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fac1a3-814a-4c52-bd28-8cc94fdff450 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:41:08.117237 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb2d9bb-5a74-47df-a4b7-fcc3416fbb23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:41:08.117853 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2d9bb-5a74-47df-a4b7-fcc3416fbb23 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:08.118137 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2d9bb-5a74-47df-a4b7-fcc3416fbb23 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:08.118438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb2d9bb-5a74-47df-a4b7-fcc3416fbb23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:08.120046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-adb2d9bb-5a74-47df-a4b7-fcc3416fbb23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:08.229405 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2d9bb-5a74-47df-a4b7-fcc3416fbb23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:41:08.230911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb2d9bb-5a74-47df-a4b7-fcc3416fbb23 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:41:08.252092 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 670/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:41:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:41:12.221989 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0993385-1ccd-42cd-9d4f-73d266134796 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:12.222552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0993385-1ccd-42cd-9d4f-73d266134796 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:12.222552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0993385-1ccd-42cd-9d4f-73d266134796 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:12.223855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 671/1341] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:12.228964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95454bf1-8829-40f6-83cb-00fa552521ed None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:12.229377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95454bf1-8829-40f6-83cb-00fa552521ed None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:12.229527 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95454bf1-8829-40f6-83cb-00fa552521ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:12.235046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:12.296889 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-95454bf1-8829-40f6-83cb-00fa552521ed None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:12.298091 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-95454bf1-8829-40f6-83cb-00fa552521ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:12.395471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 671/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:41:12.433582 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0993385-1ccd-42cd-9d4f-73d266134796 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:41:12.435169 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-f0993385-1ccd-42cd-9d4f-73d266134796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:12.483267 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:12.538488 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0993385-1ccd-42cd-9d4f-73d266134796 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:41:12.616170 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f386f30-a895-4274-b589-bbe09f3dceae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:41:12.616792 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f386f30-a895-4274-b589-bbe09f3dceae service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:12.617073 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f386f30-a895-4274-b589-bbe09f3dceae service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:12.617349 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f386f30-a895-4274-b589-bbe09f3dceae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:12.619004 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-0f386f30-a895-4274-b589-bbe09f3dceae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:12.711571 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:12.729291 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f386f30-a895-4274-b589-bbe09f3dceae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:41:12.730758 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f386f30-a895-4274-b589-bbe09f3dceae service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:41:12.749397 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 672/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:41:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:41:15.571816 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7476032-c215-498a-be6b-e189fde52dbb None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:15.572371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7476032-c215-498a-be6b-e189fde52dbb None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:15.572371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7476032-c215-498a-be6b-e189fde52dbb None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:15.573779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 672/1344] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:15.579351 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e960cb-6083-4834-9b52-1fe15bf54037 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:15.579804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e960cb-6083-4834-9b52-1fe15bf54037 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:15.579901 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e960cb-6083-4834-9b52-1fe15bf54037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:15.648129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-22e960cb-6083-4834-9b52-1fe15bf54037 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:15.649340 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-22e960cb-6083-4834-9b52-1fe15bf54037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:15.744834 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 673/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:41:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:41:15.782793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7476032-c215-498a-be6b-e189fde52dbb None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:41:15.784400 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-f7476032-c215-498a-be6b-e189fde52dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:15.870308 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:15.887777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7476032-c215-498a-be6b-e189fde52dbb None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:41:15.961402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f67c5d-d8a1-41c8-bf46-ebfbd8967120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:41:15.962026 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f67c5d-d8a1-41c8-bf46-ebfbd8967120 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:15.962314 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f67c5d-d8a1-41c8-bf46-ebfbd8967120 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:15.962625 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f67c5d-d8a1-41c8-bf46-ebfbd8967120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:15.964246 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-15f67c5d-d8a1-41c8-bf46-ebfbd8967120 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:16.078834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f67c5d-d8a1-41c8-bf46-ebfbd8967120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:41:16.080198 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f67c5d-d8a1-41c8-bf46-ebfbd8967120 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:41:16.098200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 673/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:41:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:41:20.284091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec379f81-a50b-4628-9f70-c8d615c7d2ba None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:20.284646 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec379f81-a50b-4628-9f70-c8d615c7d2ba None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:20.284646 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec379f81-a50b-4628-9f70-c8d615c7d2ba None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:20.286006 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 674/1347] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:20.291445 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049723b-707d-4d1f-97bf-9e4ef768aada None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:20.291904 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049723b-707d-4d1f-97bf-9e4ef768aada None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:20.292011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049723b-707d-4d1f-97bf-9e4ef768aada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:20.307738 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:20.362104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-3049723b-707d-4d1f-97bf-9e4ef768aada None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:20.363352 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-3049723b-707d-4d1f-97bf-9e4ef768aada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:20.467452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 674/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:41:20.507129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec379f81-a50b-4628-9f70-c8d615c7d2ba None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:41:20.508682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ec379f81-a50b-4628-9f70-c8d615c7d2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:20.567239 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:20.614972 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec379f81-a50b-4628-9f70-c8d615c7d2ba None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:41:20.690555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f56af4-d2bb-4211-a87e-0818aa38f9d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:41:20.691180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f56af4-d2bb-4211-a87e-0818aa38f9d4 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:20.691466 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f56af4-d2bb-4211-a87e-0818aa38f9d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:20.691741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f56af4-d2bb-4211-a87e-0818aa38f9d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:20.693433 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-41f56af4-d2bb-4211-a87e-0818aa38f9d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:20.795738 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:20.800218 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f56af4-d2bb-4211-a87e-0818aa38f9d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:41:20.801658 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f56af4-d2bb-4211-a87e-0818aa38f9d4 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:41:20.819923 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 675/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:41:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:41:25.664556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de2e7b-a5bb-4cb2-bdab-a7f0a17b498f None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:25.665062 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de2e7b-a5bb-4cb2-bdab-a7f0a17b498f None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:25.665300 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de2e7b-a5bb-4cb2-bdab-a7f0a17b498f None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:25.667092 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 675/1350] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 22:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:25.672571 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c25c1-1bc9-464b-8212-4e93fded0503 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:25.673177 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c25c1-1bc9-464b-8212-4e93fded0503 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:25.673177 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c25c1-1bc9-464b-8212-4e93fded0503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:25.817935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-895c25c1-1bc9-464b-8212-4e93fded0503 None None] MFA Rules not processed for user `2e3a1384f3b34999a75572ee10a1e3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:25.820700 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-895c25c1-1bc9-464b-8212-4e93fded0503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:25.941322 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 676/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 22:41:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:41:30.169160 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda2c95-a249-4130-8418-3e800655d29a None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:30.169688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda2c95-a249-4130-8418-3e800655d29a None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:30.169772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda2c95-a249-4130-8418-3e800655d29a None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:30.171300 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 676/1352] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 22:41:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:30.176797 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fb0bb-cbcc-4454-8418-1edd244c6edd None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:30.177230 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fb0bb-cbcc-4454-8418-1edd244c6edd None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:30.177461 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fb0bb-cbcc-4454-8418-1edd244c6edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:30.232639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:30.256612 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-665fb0bb-cbcc-4454-8418-1edd244c6edd None None] MFA Rules not processed for user `2e3a1384f3b34999a75572ee10a1e3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:30.257819 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-665fb0bb-cbcc-4454-8418-1edd244c6edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:30.381032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 677/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 22:41:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:41:30.465997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=59 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:31.573197 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670504d8-4765-4226-ad58-27cc3e47b9c9 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:31.573933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670504d8-4765-4226-ad58-27cc3e47b9c9 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:31.573933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670504d8-4765-4226-ad58-27cc3e47b9c9 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:31.575326 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 677/1354] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 22:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:31.580614 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71775fa9-394e-4c73-a722-5d339a1ad248 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:31.581064 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71775fa9-394e-4c73-a722-5d339a1ad248 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:31.581241 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71775fa9-394e-4c73-a722-5d339a1ad248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:31.661451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-71775fa9-394e-4c73-a722-5d339a1ad248 None None] MFA Rules not processed for user `2e3a1384f3b34999a75572ee10a1e3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:31.662704 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-71775fa9-394e-4c73-a722-5d339a1ad248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:31.703826 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:31.772414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 678/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 22:41:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:41:35.182245 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c33bf-70f1-49cc-8da0-c5a828fc53b7 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:35.182793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c33bf-70f1-49cc-8da0-c5a828fc53b7 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:35.182793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c33bf-70f1-49cc-8da0-c5a828fc53b7 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:35.184285 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 678/1356] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:35.190244 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcfb67-7425-406c-9663-8bedd2a97db1 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:35.190734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcfb67-7425-406c-9663-8bedd2a97db1 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:35.190858 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcfb67-7425-406c-9663-8bedd2a97db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:35.265044 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-8cfcfb67-7425-406c-9663-8bedd2a97db1 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:35.266517 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8cfcfb67-7425-406c-9663-8bedd2a97db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:35.368463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 679/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:41:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:41:35.422587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b69409-ea5b-4360-954f-b59251b0c331 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:35.424052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b69409-ea5b-4360-954f-b59251b0c331 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:35.424666 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b69409-ea5b-4360-954f-b59251b0c331 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:35.426780 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 679/1358] 10.222.0.48 () {54 vars in 962 bytes} [Wed Jul 27 22:41:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:35.435948 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c814be-9fa8-4dc1-8d16-6be6ecd5fd76 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:35.436594 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c814be-9fa8-4dc1-8d16-6be6ecd5fd76 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:35.437178 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c814be-9fa8-4dc1-8d16-6be6ecd5fd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:35.459623 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:35.524710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-e4c814be-9fa8-4dc1-8d16-6be6ecd5fd76 None None] MFA Rules not processed for user `c621601261e44ca8a7938862d6578639`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:35.525857 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e4c814be-9fa8-4dc1-8d16-6be6ecd5fd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:35.654827 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 680/1359] 10.222.0.48 () {58 vars in 1059 bytes} [Wed Jul 27 22:41:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:41:35.663227 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b69409-ea5b-4360-954f-b59251b0c331 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:41:35.664738 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c8b69409-ea5b-4360-954f-b59251b0c331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:35.814901 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b69409-ea5b-4360-954f-b59251b0c331 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:41:35.901586 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:35.938457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02cb77-993c-46c5-841e-ce4168e6ee63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:41:35.939610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02cb77-993c-46c5-841e-ce4168e6ee63 service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:35.939895 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02cb77-993c-46c5-841e-ce4168e6ee63 service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:35.940170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02cb77-993c-46c5-841e-ce4168e6ee63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:35.941776 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ab02cb77-993c-46c5-841e-ce4168e6ee63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:36.037834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02cb77-993c-46c5-841e-ce4168e6ee63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:41:36.039458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab02cb77-993c-46c5-841e-ce4168e6ee63 service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:41:36.059279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 680/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:41:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:41:38.287006 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df6065-f0e4-4250-bcd3-3816e4c3c8f7 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:38.287591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df6065-f0e4-4250-bcd3-3816e4c3c8f7 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:38.287591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df6065-f0e4-4250-bcd3-3816e4c3c8f7 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:38.288902 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 681/1361] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:38.294703 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba40cc1-a730-4755-ab0c-e633beed9bc2 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:38.295146 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba40cc1-a730-4755-ab0c-e633beed9bc2 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:38.295385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba40cc1-a730-4755-ab0c-e633beed9bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:38.366565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-bba40cc1-a730-4755-ab0c-e633beed9bc2 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:38.367812 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-bba40cc1-a730-4755-ab0c-e633beed9bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:38.406881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:38.479773 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 681/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:41:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:41:38.523526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df6065-f0e4-4250-bcd3-3816e4c3c8f7 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:41:38.525355 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-05df6065-f0e4-4250-bcd3-3816e4c3c8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:38.608260 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:38.700867 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df6065-f0e4-4250-bcd3-3816e4c3c8f7 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:41:38.858367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f8c12-fd5f-4768-8595-028681d9b821 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:41:38.859169 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f8c12-fd5f-4768-8595-028681d9b821 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:38.859517 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f8c12-fd5f-4768-8595-028681d9b821 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:38.859858 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f8c12-fd5f-4768-8595-028681d9b821 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:38.861750 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-bb6f8c12-fd5f-4768-8595-028681d9b821 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:38.886546 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:38.963474 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f8c12-fd5f-4768-8595-028681d9b821 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:41:38.965253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f8c12-fd5f-4768-8595-028681d9b821 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:41:38.984680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 682/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:41:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:41:41.335443 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec830af1-cd2e-4cc2-9f40-69db03d10c9e None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:41.335965 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec830af1-cd2e-4cc2-9f40-69db03d10c9e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:41.335965 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec830af1-cd2e-4cc2-9f40-69db03d10c9e None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:41.337423 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 682/1364] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:41.342467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d792b50-a919-41af-b8cc-791edf5b8699 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:41.342908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d792b50-a919-41af-b8cc-791edf5b8699 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:41.343010 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d792b50-a919-41af-b8cc-791edf5b8699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:41.429332 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-2d792b50-a919-41af-b8cc-791edf5b8699 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:41.430592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-2d792b50-a919-41af-b8cc-791edf5b8699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:41.536091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:41.539415 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 683/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:41:41.589473 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace0382-100e-4e0c-88da-0bf00eb2b375 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:41.589666 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace0382-100e-4e0c-88da-0bf00eb2b375 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:41.589971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ace0382-100e-4e0c-88da-0bf00eb2b375 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:41.591491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 683/1366] 10.222.0.48 () {54 vars in 962 bytes} [Wed Jul 27 22:41:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:41.600686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8570e-176f-4eb5-a149-16feede93c10 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:41.600686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8570e-176f-4eb5-a149-16feede93c10 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:41.600686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8570e-176f-4eb5-a149-16feede93c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:41.679338 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-6fd8570e-176f-4eb5-a149-16feede93c10 None None] MFA Rules not processed for user `c621601261e44ca8a7938862d6578639`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:41.680695 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6fd8570e-176f-4eb5-a149-16feede93c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:41.816674 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 684/1367] 10.222.0.48 () {58 vars in 1059 bytes} [Wed Jul 27 22:41:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:41:41.824184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace0382-100e-4e0c-88da-0bf00eb2b375 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:41:41.825945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-4ace0382-100e-4e0c-88da-0bf00eb2b375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:41.982460 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ace0382-100e-4e0c-88da-0bf00eb2b375 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:41:42.008037 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:42.129555 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274aeedd-d260-40da-9120-670ef61bceeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:41:42.132022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274aeedd-d260-40da-9120-670ef61bceeb service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:42.132385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274aeedd-d260-40da-9120-670ef61bceeb service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:42.134326 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274aeedd-d260-40da-9120-670ef61bceeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:42.136027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-274aeedd-d260-40da-9120-670ef61bceeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:42.231283 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274aeedd-d260-40da-9120-670ef61bceeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:41:42.232952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274aeedd-d260-40da-9120-670ef61bceeb service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:41:42.252216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 684/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:41:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:41:43.260170 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc79c6-9312-4382-b3ce-c0fea1feb1ad None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:43.260702 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc79c6-9312-4382-b3ce-c0fea1feb1ad None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:43.260702 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc79c6-9312-4382-b3ce-c0fea1feb1ad None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:43.262157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 685/1369] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:43.267329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074394b-ea08-4d24-a2d8-9f233eb98fce None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:43.267752 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074394b-ea08-4d24-a2d8-9f233eb98fce None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:43.267891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074394b-ea08-4d24-a2d8-9f233eb98fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:43.301825 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:43.342478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-2074394b-ea08-4d24-a2d8-9f233eb98fce None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:43.344101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-2074394b-ea08-4d24-a2d8-9f233eb98fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:43.457634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 685/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:41:43.804839 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda3863-3657-403d-8914-a984d073d917 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:43.805128 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda3863-3657-403d-8914-a984d073d917 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:43.805409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda3863-3657-403d-8914-a984d073d917 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:43.806927 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 686/1371] 10.222.0.48 () {54 vars in 964 bytes} [Wed Jul 27 22:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:43.811828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07824b-90e0-4e8c-8a14-3b0916b97781 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:43.812130 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07824b-90e0-4e8c-8a14-3b0916b97781 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:43.812410 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07824b-90e0-4e8c-8a14-3b0916b97781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:43.898025 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-8c07824b-90e0-4e8c-8a14-3b0916b97781 None None] MFA Rules not processed for user `9ac8dcdbe57646f79593e7f39dc60900`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:43.899847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8c07824b-90e0-4e8c-8a14-3b0916b97781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:43.951642 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:43.985060 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 686/1372] 10.222.0.48 () {58 vars in 1061 bytes} [Wed Jul 27 22:41:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:41:43.992699 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda3863-3657-403d-8914-a984d073d917 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:41:43.994223 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ffda3863-3657-403d-8914-a984d073d917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:44.047760 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:44.109832 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda3863-3657-403d-8914-a984d073d917 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:41:44.189403 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8574e93a-92de-4557-869f-9081bc6d3e11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:41:44.189925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574e93a-92de-4557-869f-9081bc6d3e11 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:44.190209 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574e93a-92de-4557-869f-9081bc6d3e11 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:44.190527 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8574e93a-92de-4557-869f-9081bc6d3e11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:44.192220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8574e93a-92de-4557-869f-9081bc6d3e11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:44.298213 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:44.312374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574e93a-92de-4557-869f-9081bc6d3e11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:41:44.314632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8574e93a-92de-4557-869f-9081bc6d3e11 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:41:44.334825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 687/1373] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:41:44.365519 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a778a-3f66-436b-8e31-dfbc328a75ad None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:44.365987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a778a-3f66-436b-8e31-dfbc328a75ad None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:44.366692 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942a778a-3f66-436b-8e31-dfbc328a75ad None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:44.371348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 687/1374] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:41:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:44.382061 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ad981-6b3a-4cb1-9d38-52b852fffd77 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:44.382061 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ad981-6b3a-4cb1-9d38-52b852fffd77 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:44.382061 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77ad981-6b3a-4cb1-9d38-52b852fffd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:44.454713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-d77ad981-6b3a-4cb1-9d38-52b852fffd77 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:44.455807 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d77ad981-6b3a-4cb1-9d38-52b852fffd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:44.562836 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 688/1375] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:41:44.607010 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a778a-3f66-436b-8e31-dfbc328a75ad None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:41:44.609143 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-942a778a-3f66-436b-8e31-dfbc328a75ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:44.783089 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942a778a-3f66-436b-8e31-dfbc328a75ad None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:41:44.835632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:44.897707 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d32cb5-c1af-4151-988c-2a2c2293ef5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:41:44.898331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d32cb5-c1af-4151-988c-2a2c2293ef5f service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:44.898643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d32cb5-c1af-4151-988c-2a2c2293ef5f service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:44.898926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d32cb5-c1af-4151-988c-2a2c2293ef5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:44.900549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-96d32cb5-c1af-4151-988c-2a2c2293ef5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:44.991916 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d32cb5-c1af-4151-988c-2a2c2293ef5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:41:44.993522 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d32cb5-c1af-4151-988c-2a2c2293ef5f service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:41:45.011663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 688/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:41:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:41:47.031343 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5228ac-bc3b-46de-ac3f-fff61f822a23 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:47.031864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5228ac-bc3b-46de-ac3f-fff61f822a23 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:47.031864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5228ac-bc3b-46de-ac3f-fff61f822a23 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:47.033886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 689/1377] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:41:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:47.039158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016399e-5f13-4f54-b68f-5dc38e10cd48 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:47.039587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016399e-5f13-4f54-b68f-5dc38e10cd48 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:47.039841 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016399e-5f13-4f54-b68f-5dc38e10cd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:47.105939 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-e016399e-5f13-4f54-b68f-5dc38e10cd48 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:47.107159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e016399e-5f13-4f54-b68f-5dc38e10cd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:47.114282 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:47.217310 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 689/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:41:47.260601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5228ac-bc3b-46de-ac3f-fff61f822a23 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:41:47.262137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-1d5228ac-bc3b-46de-ac3f-fff61f822a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:47.338195 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:47.427060 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5228ac-bc3b-46de-ac3f-fff61f822a23 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:41:47.537422 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6ee48-dd40-4f6c-9c94-40607bbc28ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:41:47.538037 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6ee48-dd40-4f6c-9c94-40607bbc28ef service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:47.538316 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6ee48-dd40-4f6c-9c94-40607bbc28ef service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:47.538616 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6ee48-dd40-4f6c-9c94-40607bbc28ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:47.540222 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-73e6ee48-dd40-4f6c-9c94-40607bbc28ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:47.558664 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:47.633193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6ee48-dd40-4f6c-9c94-40607bbc28ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:41:47.635957 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6ee48-dd40-4f6c-9c94-40607bbc28ef service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:41:47.662628 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 690/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:41:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:41:49.741008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc06c4f-c6db-477a-84e7-ba20dc05e8d1 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:49.741524 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc06c4f-c6db-477a-84e7-ba20dc05e8d1 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:49.741524 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc06c4f-c6db-477a-84e7-ba20dc05e8d1 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:49.743033 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 690/1380] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:49.747933 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b3359-cc78-4218-86ed-27538b08bd07 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:49.748365 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b3359-cc78-4218-86ed-27538b08bd07 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:49.748543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b3359-cc78-4218-86ed-27538b08bd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:49.817531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-240b3359-cc78-4218-86ed-27538b08bd07 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:49.818801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-240b3359-cc78-4218-86ed-27538b08bd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:49.922329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:49.930481 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 691/1381] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:41:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:41:49.974230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc06c4f-c6db-477a-84e7-ba20dc05e8d1 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:41:49.975955 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-acc06c4f-c6db-477a-84e7-ba20dc05e8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:50.120001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:50.132182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc06c4f-c6db-477a-84e7-ba20dc05e8d1 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:41:50.257269 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04e044-17e1-46c4-9521-c3a649ddc669 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:41:50.257889 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04e044-17e1-46c4-9521-c3a649ddc669 service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:50.258168 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04e044-17e1-46c4-9521-c3a649ddc669 service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:50.258469 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04e044-17e1-46c4-9521-c3a649ddc669 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:50.260064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8b04e044-17e1-46c4-9521-c3a649ddc669 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:50.358791 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04e044-17e1-46c4-9521-c3a649ddc669 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:41:50.361463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04e044-17e1-46c4-9521-c3a649ddc669 service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:41:50.375222 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:50.386693 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 691/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:41:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:41:52.591897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f578a-a0cc-45c6-b9ec-da9d37272c1c None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:52.592481 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f578a-a0cc-45c6-b9ec-da9d37272c1c None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:52.592600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f578a-a0cc-45c6-b9ec-da9d37272c1c None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:52.594432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 692/1383] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:41:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:52.599839 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bddd8-1a0f-42f1-a3ee-e5958ac83a08 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:52.600683 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bddd8-1a0f-42f1-a3ee-e5958ac83a08 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:52.601026 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749bddd8-1a0f-42f1-a3ee-e5958ac83a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:52.668788 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-749bddd8-1a0f-42f1-a3ee-e5958ac83a08 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:52.670103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-749bddd8-1a0f-42f1-a3ee-e5958ac83a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:52.769757 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 692/1384] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:41:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:41:52.813928 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f578a-a0cc-45c6-b9ec-da9d37272c1c None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:41:52.816031 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a04f578a-a0cc-45c6-b9ec-da9d37272c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:52.973519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f578a-a0cc-45c6-b9ec-da9d37272c1c None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:41:53.041743 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:53.092318 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe2941d-b85e-4f9f-8c3d-45be03537cae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:41:53.093160 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2941d-b85e-4f9f-8c3d-45be03537cae service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:53.093521 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2941d-b85e-4f9f-8c3d-45be03537cae service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:53.093884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe2941d-b85e-4f9f-8c3d-45be03537cae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:53.097137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-dbe2941d-b85e-4f9f-8c3d-45be03537cae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:53.211592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2941d-b85e-4f9f-8c3d-45be03537cae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:41:53.213191 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe2941d-b85e-4f9f-8c3d-45be03537cae service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:41:53.231979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 693/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:41:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:41:55.377323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d499aa7-f1dc-4ffe-8354-928a33ee89ee None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:55.377836 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d499aa7-f1dc-4ffe-8354-928a33ee89ee None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:55.377836 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d499aa7-f1dc-4ffe-8354-928a33ee89ee None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:55.379270 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 693/1386] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:41:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:55.384586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5b522-4aab-47b3-9810-683d4e04f3be None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:55.385170 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5b522-4aab-47b3-9810-683d4e04f3be None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:55.385280 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5b522-4aab-47b3-9810-683d4e04f3be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:55.451234 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-62c5b522-4aab-47b3-9810-683d4e04f3be None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:55.452453 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-62c5b522-4aab-47b3-9810-683d4e04f3be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:55.498964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:55.569915 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 694/1387] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:41:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:41:55.616805 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d499aa7-f1dc-4ffe-8354-928a33ee89ee None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:41:55.620464 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8d499aa7-f1dc-4ffe-8354-928a33ee89ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:55.750077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:55.834941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d499aa7-f1dc-4ffe-8354-928a33ee89ee None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:41:55.962083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb64fc0-1297-41e3-9f8b-8c811d076a09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:41:55.962896 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb64fc0-1297-41e3-9f8b-8c811d076a09 service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:55.963258 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb64fc0-1297-41e3-9f8b-8c811d076a09 service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:55.963614 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb64fc0-1297-41e3-9f8b-8c811d076a09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:55.965867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-bcb64fc0-1297-41e3-9f8b-8c811d076a09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:56.009380 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:56.074256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb64fc0-1297-41e3-9f8b-8c811d076a09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:41:56.075892 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb64fc0-1297-41e3-9f8b-8c811d076a09 service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:41:56.094026 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 694/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:41:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:41:58.204261 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7902cf-f42b-4cdf-b494-d821fbd354a4 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:58.204824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7902cf-f42b-4cdf-b494-d821fbd354a4 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:58.204824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7902cf-f42b-4cdf-b494-d821fbd354a4 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:58.206377 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 695/1389] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:58.211322 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217defe-9909-42ae-8841-435d6c839dab None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:58.211748 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217defe-9909-42ae-8841-435d6c839dab None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:58.211913 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217defe-9909-42ae-8841-435d6c839dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:58.278247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-6217defe-9909-42ae-8841-435d6c839dab None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:58.279505 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-6217defe-9909-42ae-8841-435d6c839dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:58.376701 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 695/1390] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:41:58.420874 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7902cf-f42b-4cdf-b494-d821fbd354a4 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:41:58.422418 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-eb7902cf-f42b-4cdf-b494-d821fbd354a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:58.601128 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7902cf-f42b-4cdf-b494-d821fbd354a4 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:41:58.618220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:58.715114 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3250e969-ac71-4a60-96dc-c474d9b3b932 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:41:58.715739 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250e969-ac71-4a60-96dc-c474d9b3b932 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:58.716026 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250e969-ac71-4a60-96dc-c474d9b3b932 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:58.716305 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3250e969-ac71-4a60-96dc-c474d9b3b932 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:58.717944 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-3250e969-ac71-4a60-96dc-c474d9b3b932 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:58.808845 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250e969-ac71-4a60-96dc-c474d9b3b932 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:41:58.810522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3250e969-ac71-4a60-96dc-c474d9b3b932 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:41:58.828305 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 696/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:41:59.422377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106dba1-66c5-40a0-b849-ad8d3627b49b None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:59.423425 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106dba1-66c5-40a0-b849-ad8d3627b49b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:59.423425 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0106dba1-66c5-40a0-b849-ad8d3627b49b None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:59.424909 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 696/1392] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:41:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:59.430190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac05cfb-1361-40ee-9806-e999bd8767b6 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:59.430640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac05cfb-1361-40ee-9806-e999bd8767b6 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:59.430793 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac05cfb-1361-40ee-9806-e999bd8767b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:59.456855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:59.497635 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-1ac05cfb-1361-40ee-9806-e999bd8767b6 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:59.498876 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-1ac05cfb-1361-40ee-9806-e999bd8767b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:59.595185 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 697/1393] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:41:59.650646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090051-63bb-47ec-9af6-8b5d428cc74d None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:59.650936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090051-63bb-47ec-9af6-8b5d428cc74d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:59.651213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090051-63bb-47ec-9af6-8b5d428cc74d None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:59.652566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 697/1394] 10.222.0.48 () {54 vars in 966 bytes} [Wed Jul 27 22:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:41:59.657706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d24f2-26e2-44a3-899a-ed8a8df226f6 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:41:59.657999 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d24f2-26e2-44a3-899a-ed8a8df226f6 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:41:59.658279 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414d24f2-26e2-44a3-899a-ed8a8df226f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:41:59.732764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-414d24f2-26e2-44a3-899a-ed8a8df226f6 None None] MFA Rules not processed for user `b26c60d08b9f47aca8404e4173290908`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:41:59.733904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-414d24f2-26e2-44a3-899a-ed8a8df226f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:59.775786 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:59.816202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 698/1395] 10.222.0.48 () {58 vars in 1063 bytes} [Wed Jul 27 22:41:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:41:59.823701 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf090051-63bb-47ec-9af6-8b5d428cc74d None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:41:59.825220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-cf090051-63bb-47ec-9af6-8b5d428cc74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:41:59.838968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:41:59.928866 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf090051-63bb-47ec-9af6-8b5d428cc74d None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:00.005360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbc23c2-6e1b-484b-a250-5d4478751cdc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b26c60d08b9f47aca8404e4173290908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:00.005967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc23c2-6e1b-484b-a250-5d4478751cdc service glance] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:00.006251 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc23c2-6e1b-484b-a250-5d4478751cdc service glance] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:00.006557 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbc23c2-6e1b-484b-a250-5d4478751cdc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:00.008209 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-cfbc23c2-6e1b-484b-a250-5d4478751cdc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:00.077055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:00.119677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc23c2-6e1b-484b-a250-5d4478751cdc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:00.121118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbc23c2-6e1b-484b-a250-5d4478751cdc service glance] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:00.138945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 698/1396] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:41:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:00.858047 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf7243-aebd-4c7d-bfa2-e13c6227e257 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:00.858584 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf7243-aebd-4c7d-bfa2-e13c6227e257 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:00.858584 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf7243-aebd-4c7d-bfa2-e13c6227e257 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:00.860073 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 699/1397] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:00.865768 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873aea15-c561-46dc-b8e9-daf18357a365 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:00.866187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873aea15-c561-46dc-b8e9-daf18357a365 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:00.866367 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873aea15-c561-46dc-b8e9-daf18357a365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:00.871082 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6e789-b77f-411f-a039-683773c10e08 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:00.871443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6e789-b77f-411f-a039-683773c10e08 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:00.871795 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6e789-b77f-411f-a039-683773c10e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:00.934196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-873aea15-c561-46dc-b8e9-daf18357a365 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:00.935483 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-873aea15-c561-46dc-b8e9-daf18357a365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:00.939755 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-42d6e789-b77f-411f-a039-683773c10e08 None None] MFA Rules not processed for user `db10ad54ec9948a3bb8b04c708fc4ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:00.940943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-42d6e789-b77f-411f-a039-683773c10e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:01.028935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 700/1398] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 22:42:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:42:01.032965 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 699/1399] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:42:01.070872 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e684d-d004-4625-8ba0-033e573bfa17 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:01.071170 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e684d-d004-4625-8ba0-033e573bfa17 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:01.071454 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e684d-d004-4625-8ba0-033e573bfa17 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:01.072851 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 701/1400] 10.222.0.48 () {54 vars in 943 bytes} [Wed Jul 27 22:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:01.079412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e53cf-0258-4bf0-8ce3-0c7f398a57e9 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:01.079707 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e53cf-0258-4bf0-8ce3-0c7f398a57e9 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:01.079817 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e684d-d004-4625-8ba0-033e573bfa17 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:42:01.079991 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e53cf-0258-4bf0-8ce3-0c7f398a57e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:01.081281 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-df4e684d-d004-4625-8ba0-033e573bfa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:01.106008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:01.144083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:01.158247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-435e53cf-0258-4bf0-8ce3-0c7f398a57e9 None None] MFA Rules not processed for user `baf405258b9d413fae1192e10250b6a3`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:01.159562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-435e53cf-0258-4bf0-8ce3-0c7f398a57e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:01.231144 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e684d-d004-4625-8ba0-033e573bfa17 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:01.265722 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 700/1401] 10.222.0.48 () {58 vars in 1040 bytes} [Wed Jul 27 22:42:01 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:42:01.275360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e53cf-0258-4bf0-8ce3-0c7f398a57e9 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:42:01.284730 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e53cf-0258-4bf0-8ce3-0c7f398a57e9 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:01.346549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e6256-9e3f-4c94-8e0e-e13f9575258b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:01.347174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e6256-9e3f-4c94-8e0e-e13f9575258b service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:01.347456 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e6256-9e3f-4c94-8e0e-e13f9575258b service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:01.347733 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e6256-9e3f-4c94-8e0e-e13f9575258b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:01.349359 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-c14e6256-9e3f-4c94-8e0e-e13f9575258b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:01.355875 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:01.369020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:01.391952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af6df1-08ae-4f22-92cc-b684b6ade596 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf405258b9d413fae1192e10250b6a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:01.392587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af6df1-08ae-4f22-92cc-b684b6ade596 service swift] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:01.392872 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af6df1-08ae-4f22-92cc-b684b6ade596 service swift] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:01.393151 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af6df1-08ae-4f22-92cc-b684b6ade596 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:01.394918 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-58af6df1-08ae-4f22-92cc-b684b6ade596 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:01.443216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e6256-9e3f-4c94-8e0e-e13f9575258b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:01.444822 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e6256-9e3f-4c94-8e0e-e13f9575258b service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:01.462986 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 702/1402] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:42:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:01.489006 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af6df1-08ae-4f22-92cc-b684b6ade596 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:01.490115 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af6df1-08ae-4f22-92cc-b684b6ade596 service swift] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:01.500353 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 701/1403] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 22:42:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 22:42:03.555632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9df648-5a44-416b-94a5-04087fe1291b None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:03.556221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9df648-5a44-416b-94a5-04087fe1291b None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:03.556322 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9df648-5a44-416b-94a5-04087fe1291b None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:03.562383 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 703/1404] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:42:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:03.567172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58a762-bed1-4e7a-bedf-af72fa8afb87 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:03.567650 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58a762-bed1-4e7a-bedf-af72fa8afb87 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:03.567754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58a762-bed1-4e7a-bedf-af72fa8afb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:03.648359 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-6d58a762-bed1-4e7a-bedf-af72fa8afb87 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:03.649587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-6d58a762-bed1-4e7a-bedf-af72fa8afb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:03.714247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:03.767011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 702/1405] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:42:03.811747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9df648-5a44-416b-94a5-04087fe1291b None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:42:03.813850 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ca9df648-5a44-416b-94a5-04087fe1291b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:03.984620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:03.988323 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9df648-5a44-416b-94a5-04087fe1291b None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:04.122973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b4d1b-c5a8-4237-9e02-edf7fd113ef8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:04.123702 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b4d1b-c5a8-4237-9e02-edf7fd113ef8 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:04.123991 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b4d1b-c5a8-4237-9e02-edf7fd113ef8 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:04.124273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b4d1b-c5a8-4237-9e02-edf7fd113ef8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:04.126504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-2f6b4d1b-c5a8-4237-9e02-edf7fd113ef8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:04.229528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b4d1b-c5a8-4237-9e02-edf7fd113ef8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:04.231178 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b4d1b-c5a8-4237-9e02-edf7fd113ef8 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:04.252015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 704/1406] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:06.367231 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66caa35-9ae4-4635-9430-ec4dc8a0a38d None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:06.367841 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66caa35-9ae4-4635-9430-ec4dc8a0a38d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:06.367841 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66caa35-9ae4-4635-9430-ec4dc8a0a38d None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:06.369442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 703/1407] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:06.377966 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d873e21-1235-4caa-a5a7-f66a301ec443 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:06.377966 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d873e21-1235-4caa-a5a7-f66a301ec443 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:06.377966 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d873e21-1235-4caa-a5a7-f66a301ec443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:06.380262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:06.453220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-3d873e21-1235-4caa-a5a7-f66a301ec443 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:06.454836 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-3d873e21-1235-4caa-a5a7-f66a301ec443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:06.560886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 705/1408] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:42:06.605472 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66caa35-9ae4-4635-9430-ec4dc8a0a38d None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:42:06.607136 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e66caa35-9ae4-4635-9430-ec4dc8a0a38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:06.769076 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66caa35-9ae4-4635-9430-ec4dc8a0a38d None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:06.813931 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:06.896589 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316d5875-3d3b-4c3a-8916-ecee008f4b79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:06.897213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d5875-3d3b-4c3a-8916-ecee008f4b79 service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:06.897493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d5875-3d3b-4c3a-8916-ecee008f4b79 service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:06.897765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316d5875-3d3b-4c3a-8916-ecee008f4b79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:06.900925 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-316d5875-3d3b-4c3a-8916-ecee008f4b79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:06.998020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d5875-3d3b-4c3a-8916-ecee008f4b79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:06.999673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316d5875-3d3b-4c3a-8916-ecee008f4b79 service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:07.019023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 704/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:42:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:16.558903 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=64 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:17.016606 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=79 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:23.969973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1122d6a-a6e6-4660-8090-e1b223d43c88 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:23.970602 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1122d6a-a6e6-4660-8090-e1b223d43c88 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:23.970602 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1122d6a-a6e6-4660-8090-e1b223d43c88 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:23.971934 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 706/1410] 10.222.0.48 () {54 vars in 918 bytes} [Wed Jul 27 22:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:42:23.980000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6229e18-fc32-47f9-a6b3-91e28731597e None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:23.980466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6229e18-fc32-47f9-a6b3-91e28731597e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:23.980574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6229e18-fc32-47f9-a6b3-91e28731597e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:24.057266 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-b6229e18-fc32-47f9-a6b3-91e28731597e None None] MFA Rules not processed for user `2e3a1384f3b34999a75572ee10a1e3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:24.058509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-b6229e18-fc32-47f9-a6b3-91e28731597e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:24.162923 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 705/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Wed Jul 27 22:42:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:42:24.177587 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300be52-64c9-4b8f-9945-f9a94955ef46 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:24.177874 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300be52-64c9-4b8f-9945-f9a94955ef46 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:24.178153 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300be52-64c9-4b8f-9945-f9a94955ef46 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:24.179519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 707/1412] 10.222.0.48 () {54 vars in 918 bytes} [Wed Jul 27 22:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:24.184350 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8161be-b2b9-44a1-811b-8f68f8d79d78 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:24.184643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8161be-b2b9-44a1-811b-8f68f8d79d78 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:24.184932 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8161be-b2b9-44a1-811b-8f68f8d79d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:24.256518 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:24.259990 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-1c8161be-b2b9-44a1-811b-8f68f8d79d78 None None] MFA Rules not processed for user `c621601261e44ca8a7938862d6578639`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:24.261603 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-1c8161be-b2b9-44a1-811b-8f68f8d79d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:24.379009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 706/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Wed Jul 27 22:42:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:42:26.857784 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd94b8a-86da-4dd9-a873-60998836150e None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:26.858295 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd94b8a-86da-4dd9-a873-60998836150e None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:26.858295 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd94b8a-86da-4dd9-a873-60998836150e None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:26.859809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 22:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:26.865161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9126e-54dd-4b6c-a189-286eccf7896e None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:26.865583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9126e-54dd-4b6c-a189-286eccf7896e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:26.865715 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9126e-54dd-4b6c-a189-286eccf7896e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:26.930309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-c2e9126e-54dd-4b6c-a189-286eccf7896e None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:26.931532 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c2e9126e-54dd-4b6c-a189-286eccf7896e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:26.986566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:27.029575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 22:42:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:42:27.072690 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd94b8a-86da-4dd9-a873-60998836150e None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:42:27.074415 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-0cd94b8a-86da-4dd9-a873-60998836150e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:27.220659 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd94b8a-86da-4dd9-a873-60998836150e None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:27.291055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:27.331016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32548d1-2326-4181-931c-07ae8c2a570b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:27.331639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32548d1-2326-4181-931c-07ae8c2a570b service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:27.331925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32548d1-2326-4181-931c-07ae8c2a570b service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:27.332205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32548d1-2326-4181-931c-07ae8c2a570b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:27.333821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a32548d1-2326-4181-931c-07ae8c2a570b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:27.420082 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32548d1-2326-4181-931c-07ae8c2a570b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:27.422304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32548d1-2326-4181-931c-07ae8c2a570b service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:27.440701 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 709/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:42:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:28.351400 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53840150-49cd-4d2d-9511-c651a75134c5 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:28.351980 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53840150-49cd-4d2d-9511-c651a75134c5 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:28.351980 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53840150-49cd-4d2d-9511-c651a75134c5 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:28.353335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 22:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:28.358453 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9628f-e0a2-454a-9f3d-6f1831e11145 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:28.358850 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9628f-e0a2-454a-9f3d-6f1831e11145 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:28.359123 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9628f-e0a2-454a-9f3d-6f1831e11145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:28.433790 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-cbb9628f-e0a2-454a-9f3d-6f1831e11145 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:28.435033 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-cbb9628f-e0a2-454a-9f3d-6f1831e11145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:28.462840 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:28.532134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 22:42:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:42:28.685361 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53840150-49cd-4d2d-9511-c651a75134c5 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:42:28.686913 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-53840150-49cd-4d2d-9511-c651a75134c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:28.829344 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53840150-49cd-4d2d-9511-c651a75134c5 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:28.868944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:28.953456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224a2e3-a83d-4520-a03a-ecc80ce0890b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:28.954362 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224a2e3-a83d-4520-a03a-ecc80ce0890b service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:28.954658 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224a2e3-a83d-4520-a03a-ecc80ce0890b service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:28.954935 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224a2e3-a83d-4520-a03a-ecc80ce0890b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:28.956568 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c224a2e3-a83d-4520-a03a-ecc80ce0890b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:29.044410 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224a2e3-a83d-4520-a03a-ecc80ce0890b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:29.046014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224a2e3-a83d-4520-a03a-ecc80ce0890b service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:29.065469 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 709/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:42:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:29.952130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5579da1-5ac8-4176-a045-e7213fa663fd None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:29.952693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5579da1-5ac8-4176-a045-e7213fa663fd None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:29.952693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5579da1-5ac8-4176-a045-e7213fa663fd None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:29.954940 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 22:42:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:29.959824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96029d37-9b49-45fc-bc95-a8ce0faca9e2 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:29.960246 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96029d37-9b49-45fc-bc95-a8ce0faca9e2 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:29.960379 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96029d37-9b49-45fc-bc95-a8ce0faca9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:30.013105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:30.035616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-96029d37-9b49-45fc-bc95-a8ce0faca9e2 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:30.036812 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-96029d37-9b49-45fc-bc95-a8ce0faca9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:30.132271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 22:42:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:42:30.283973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5579da1-5ac8-4176-a045-e7213fa663fd None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:42:30.285432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e5579da1-5ac8-4176-a045-e7213fa663fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:30.429701 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5579da1-5ac8-4176-a045-e7213fa663fd None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:30.442045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:30.541170 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8eb3c-f962-4cae-8f1c-c1ed5bbc67ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:30.541710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8eb3c-f962-4cae-8f1c-c1ed5bbc67ee service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:30.541996 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8eb3c-f962-4cae-8f1c-c1ed5bbc67ee service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:30.542312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8eb3c-f962-4cae-8f1c-c1ed5bbc67ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:30.543992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-09e8eb3c-f962-4cae-8f1c-c1ed5bbc67ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:30.633798 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8eb3c-f962-4cae-8f1c-c1ed5bbc67ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:30.635413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8eb3c-f962-4cae-8f1c-c1ed5bbc67ee service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:30.652729 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 712/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:42:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:31.506647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52591ba1-d9e7-4c12-a74c-87c63d35024a None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:31.507188 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52591ba1-d9e7-4c12-a74c-87c63d35024a None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:31.507304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52591ba1-d9e7-4c12-a74c-87c63d35024a None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:31.508633 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 22:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:31.513509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a614e-5dfd-44fa-a615-18e402932667 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:31.513904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a614e-5dfd-44fa-a615-18e402932667 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:31.514068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a614e-5dfd-44fa-a615-18e402932667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:31.534538 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:31.591370 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-959a614e-5dfd-44fa-a615-18e402932667 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:31.592585 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-959a614e-5dfd-44fa-a615-18e402932667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:31.688496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 22:42:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:42:31.839098 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52591ba1-d9e7-4c12-a74c-87c63d35024a None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:42:31.840538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-52591ba1-d9e7-4c12-a74c-87c63d35024a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:31.948747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:31.984438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52591ba1-d9e7-4c12-a74c-87c63d35024a None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:32.097751 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f36294e-34d4-4599-8258-1b1aa04c6152 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:32.098771 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36294e-34d4-4599-8258-1b1aa04c6152 service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:32.099068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36294e-34d4-4599-8258-1b1aa04c6152 service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:32.099500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36294e-34d4-4599-8258-1b1aa04c6152 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:32.102145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-7f36294e-34d4-4599-8258-1b1aa04c6152 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:32.178169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:32.195611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36294e-34d4-4599-8258-1b1aa04c6152 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:32.197466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f36294e-34d4-4599-8258-1b1aa04c6152 service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:32.215585 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 712/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:42:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:33.063116 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8706eeb-37c3-4d64-9519-4cbcb7a0302a None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:33.063625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8706eeb-37c3-4d64-9519-4cbcb7a0302a None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:33.063721 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8706eeb-37c3-4d64-9519-4cbcb7a0302a None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:33.065058 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 22:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:33.070089 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b3ecc-ee02-4c61-9478-0968cdfcc6c5 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:33.070532 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b3ecc-ee02-4c61-9478-0968cdfcc6c5 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:33.070683 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b3ecc-ee02-4c61-9478-0968cdfcc6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:33.146500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-344b3ecc-ee02-4c61-9478-0968cdfcc6c5 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:33.147704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-344b3ecc-ee02-4c61-9478-0968cdfcc6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:33.249262 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 22:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:42:33.398354 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8706eeb-37c3-4d64-9519-4cbcb7a0302a None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:42:33.399953 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a8706eeb-37c3-4d64-9519-4cbcb7a0302a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:33.484407 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:33.545275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8706eeb-37c3-4d64-9519-4cbcb7a0302a None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:33.655921 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5085fd79-f0f4-4c47-81e1-ff27b3679ba9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:33.656480 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085fd79-f0f4-4c47-81e1-ff27b3679ba9 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:33.656782 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085fd79-f0f4-4c47-81e1-ff27b3679ba9 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:33.657054 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5085fd79-f0f4-4c47-81e1-ff27b3679ba9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:33.658678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-5085fd79-f0f4-4c47-81e1-ff27b3679ba9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:33.705335 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:33.746246 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085fd79-f0f4-4c47-81e1-ff27b3679ba9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:33.747881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5085fd79-f0f4-4c47-81e1-ff27b3679ba9 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:33.765948 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 715/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:42:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:34.571038 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8735b-5844-4dec-a3ae-8ebea04e1f00 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:34.571602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8735b-5844-4dec-a3ae-8ebea04e1f00 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:34.571602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8735b-5844-4dec-a3ae-8ebea04e1f00 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:34.572976 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 22:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:34.578102 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72636c19-c9a2-49ea-a0e7-549e0f098d22 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:34.578576 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72636c19-c9a2-49ea-a0e7-549e0f098d22 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:34.578677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72636c19-c9a2-49ea-a0e7-549e0f098d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:34.654531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-72636c19-c9a2-49ea-a0e7-549e0f098d22 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:34.655744 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-72636c19-c9a2-49ea-a0e7-549e0f098d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:34.750901 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 22:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:42:34.902552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8735b-5844-4dec-a3ae-8ebea04e1f00 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:42:34.904249 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-4df8735b-5844-4dec-a3ae-8ebea04e1f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:34.956121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:35.053627 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8735b-5844-4dec-a3ae-8ebea04e1f00 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:35.164519 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6fa078-2040-4ec5-ac1a-a28945ad4540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:35.165068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fa078-2040-4ec5-ac1a-a28945ad4540 service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:35.165370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fa078-2040-4ec5-ac1a-a28945ad4540 service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:35.165635 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6fa078-2040-4ec5-ac1a-a28945ad4540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:35.167299 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5c6fa078-2040-4ec5-ac1a-a28945ad4540 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:35.174081 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:35.256713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fa078-2040-4ec5-ac1a-a28945ad4540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:35.258332 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6fa078-2040-4ec5-ac1a-a28945ad4540 service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:35.277571 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 715/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:36.073448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5ef50-8ae1-49da-a186-aeac8b0e5bfb None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:36.074074 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5ef50-8ae1-49da-a186-aeac8b0e5bfb None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:36.074074 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae5ef50-8ae1-49da-a186-aeac8b0e5bfb None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:36.075461 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 22:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:36.080639 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5d721-4015-490c-909c-add9c2c8a5eb None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:36.081082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5d721-4015-490c-909c-add9c2c8a5eb None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:36.081211 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5d721-4015-490c-909c-add9c2c8a5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:36.156533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-08a5d721-4015-490c-909c-add9c2c8a5eb None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:36.158284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-08a5d721-4015-490c-909c-add9c2c8a5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:36.224853 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:36.253515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 22:42:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:42:36.408918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5ef50-8ae1-49da-a186-aeac8b0e5bfb None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:42:36.410482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-bae5ef50-8ae1-49da-a186-aeac8b0e5bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:36.427725 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:36.553480 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae5ef50-8ae1-49da-a186-aeac8b0e5bfb None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:36.638904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:36.665409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f9207-1542-4c34-8ce0-db6cadf8cf09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:36.665954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f9207-1542-4c34-8ce0-db6cadf8cf09 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:36.666238 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f9207-1542-4c34-8ce0-db6cadf8cf09 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:36.666563 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f9207-1542-4c34-8ce0-db6cadf8cf09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:36.668189 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-db4f9207-1542-4c34-8ce0-db6cadf8cf09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:36.755424 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f9207-1542-4c34-8ce0-db6cadf8cf09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:36.757020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f9207-1542-4c34-8ce0-db6cadf8cf09 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:36.775211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 718/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:42:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:37.568931 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b7f7b-ba85-499a-aaff-84d6b96e11a3 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:37.569503 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b7f7b-ba85-499a-aaff-84d6b96e11a3 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:37.569503 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b7f7b-ba85-499a-aaff-84d6b96e11a3 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:37.570900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 22:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:37.575996 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e33ec-a45d-45df-9dfb-9b6ebbdc457b None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:37.576433 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e33ec-a45d-45df-9dfb-9b6ebbdc457b None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:37.576544 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e33ec-a45d-45df-9dfb-9b6ebbdc457b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:37.651903 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-9e4e33ec-a45d-45df-9dfb-9b6ebbdc457b None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:37.653107 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-9e4e33ec-a45d-45df-9dfb-9b6ebbdc457b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:37.693842 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:37.748571 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 22:42:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:42:37.898947 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b7f7b-ba85-499a-aaff-84d6b96e11a3 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:42:37.900489 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d28b7f7b-ba85-499a-aaff-84d6b96e11a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:38.043421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b7f7b-ba85-499a-aaff-84d6b96e11a3 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:38.097760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:38.156123 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65fd236-8959-4f73-b72c-2cf9021b0397 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:38.156661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fd236-8959-4f73-b72c-2cf9021b0397 service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:38.156949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fd236-8959-4f73-b72c-2cf9021b0397 service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:38.157222 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65fd236-8959-4f73-b72c-2cf9021b0397 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:38.158871 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c65fd236-8959-4f73-b72c-2cf9021b0397 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:38.252330 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fd236-8959-4f73-b72c-2cf9021b0397 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:38.253938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65fd236-8959-4f73-b72c-2cf9021b0397 service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:38.272409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 718/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:42:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:39.064421 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d813ae-db1d-46ca-a472-8a771a7ea13d None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:39.064895 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d813ae-db1d-46ca-a472-8a771a7ea13d None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:39.065003 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d813ae-db1d-46ca-a472-8a771a7ea13d None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:39.066363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 22:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:39.071426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dce5e-8ffd-4322-ab54-31de7ccca97d None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:39.071854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dce5e-8ffd-4322-ab54-31de7ccca97d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:39.071995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357dce5e-8ffd-4322-ab54-31de7ccca97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:39.148835 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-357dce5e-8ffd-4322-ab54-31de7ccca97d None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:39.150022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-357dce5e-8ffd-4322-ab54-31de7ccca97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:39.152035 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:39.246275 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 22:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:42:39.400116 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d813ae-db1d-46ca-a472-8a771a7ea13d None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:42:39.401657 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e1d813ae-db1d-46ca-a472-8a771a7ea13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:39.546958 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d813ae-db1d-46ca-a472-8a771a7ea13d None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:39.573191 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:39.662797 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd5c839-9f5e-4606-9f0e-d63b0a527dbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:39.663364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5c839-9f5e-4606-9f0e-d63b0a527dbd service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:39.663651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5c839-9f5e-4606-9f0e-d63b0a527dbd service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:39.663932 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd5c839-9f5e-4606-9f0e-d63b0a527dbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:39.665584 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-4dd5c839-9f5e-4606-9f0e-d63b0a527dbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:39.753923 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5c839-9f5e-4606-9f0e-d63b0a527dbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:39.755550 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd5c839-9f5e-4606-9f0e-d63b0a527dbd service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:39.773333 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 721/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:42:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:41.691986 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52923e-1333-427e-8f00-153713660553 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:41.692544 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52923e-1333-427e-8f00-153713660553 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:41.692544 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52923e-1333-427e-8f00-153713660553 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:41.693904 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 22:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:41.699393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801984f-bbb5-4488-8f99-c4faee12148b None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:41.699817 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801984f-bbb5-4488-8f99-c4faee12148b None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:41.699947 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801984f-bbb5-4488-8f99-c4faee12148b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:41.741980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:41.768105 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-3801984f-bbb5-4488-8f99-c4faee12148b None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:41.769316 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-3801984f-bbb5-4488-8f99-c4faee12148b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:41.862923 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 22:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:42:41.901761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52923e-1333-427e-8f00-153713660553 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:42:41.903356 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-3c52923e-1333-427e-8f00-153713660553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:42.004102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52923e-1333-427e-8f00-153713660553 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:42.035835 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:42.077405 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaedd30-97fa-4bd5-8b7c-08a7cb78a51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:42.078020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaedd30-97fa-4bd5-8b7c-08a7cb78a51b service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:42.078301 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaedd30-97fa-4bd5-8b7c-08a7cb78a51b service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:42.078607 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaedd30-97fa-4bd5-8b7c-08a7cb78a51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:42.081259 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-cdaedd30-97fa-4bd5-8b7c-08a7cb78a51b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:42.187272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaedd30-97fa-4bd5-8b7c-08a7cb78a51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:42.189373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaedd30-97fa-4bd5-8b7c-08a7cb78a51b service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:42.207425 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 721/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:42:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:44.451486 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47190c7b-24df-4e1a-b4bd-3be691b70d81 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:44.452071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47190c7b-24df-4e1a-b4bd-3be691b70d81 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:44.452071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47190c7b-24df-4e1a-b4bd-3be691b70d81 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:44.453410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 22:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:44.459564 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d3e1a-1d9f-4eb6-bf2f-1f3f03e0074d None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:44.459968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d3e1a-1d9f-4eb6-bf2f-1f3f03e0074d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:44.460128 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d3e1a-1d9f-4eb6-bf2f-1f3f03e0074d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:44.525367 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-ce6d3e1a-1d9f-4eb6-bf2f-1f3f03e0074d None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:44.526607 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ce6d3e1a-1d9f-4eb6-bf2f-1f3f03e0074d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:44.541269 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:44.634092 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 22:42:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:42:44.674527 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47190c7b-24df-4e1a-b4bd-3be691b70d81 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:42:44.676120 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-47190c7b-24df-4e1a-b4bd-3be691b70d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:44.779377 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47190c7b-24df-4e1a-b4bd-3be691b70d81 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:44.791233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:44.862704 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed16338-a899-4ad2-8b0c-da9bf10a7050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:44.863327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed16338-a899-4ad2-8b0c-da9bf10a7050 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:44.863614 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed16338-a899-4ad2-8b0c-da9bf10a7050 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:44.863896 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed16338-a899-4ad2-8b0c-da9bf10a7050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:44.865539 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-2ed16338-a899-4ad2-8b0c-da9bf10a7050 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:44.972028 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed16338-a899-4ad2-8b0c-da9bf10a7050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:44.973490 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed16338-a899-4ad2-8b0c-da9bf10a7050 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:44.991047 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 724/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:42:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:47.310017 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613237b-266b-4e8a-bdc8-ee3462f9de7d None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:47.310567 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613237b-266b-4e8a-bdc8-ee3462f9de7d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:47.310567 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613237b-266b-4e8a-bdc8-ee3462f9de7d None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:47.311917 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 22:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:47.317684 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a139b3-1933-40b3-89a5-7268ad5fca4d None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:47.318229 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a139b3-1933-40b3-89a5-7268ad5fca4d None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:47.318470 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a139b3-1933-40b3-89a5-7268ad5fca4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:47.369604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:47.389201 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-92a139b3-1933-40b3-89a5-7268ad5fca4d None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:47.390471 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-92a139b3-1933-40b3-89a5-7268ad5fca4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:47.491431 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 22:42:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:42:47.530785 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613237b-266b-4e8a-bdc8-ee3462f9de7d None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:42:47.532976 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8613237b-266b-4e8a-bdc8-ee3462f9de7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:47.754643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613237b-266b-4e8a-bdc8-ee3462f9de7d None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:47.802072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:47.837572 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e659165-3fc3-4398-96a1-56d0a3ccbdc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:47.838191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e659165-3fc3-4398-96a1-56d0a3ccbdc3 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:47.838511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e659165-3fc3-4398-96a1-56d0a3ccbdc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:47.838788 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e659165-3fc3-4398-96a1-56d0a3ccbdc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:47.840397 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-1e659165-3fc3-4398-96a1-56d0a3ccbdc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:47.946098 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e659165-3fc3-4398-96a1-56d0a3ccbdc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:47.947555 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e659165-3fc3-4398-96a1-56d0a3ccbdc3 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:47.965752 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 724/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:42:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:50.056101 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b453f2-56da-4a58-b922-1760a699e352 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:50.056679 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b453f2-56da-4a58-b922-1760a699e352 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:50.056679 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b453f2-56da-4a58-b922-1760a699e352 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:50.058044 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 22:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:50.063120 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e11db9-c351-402f-9b15-06b9871549dd None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:50.063557 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e11db9-c351-402f-9b15-06b9871549dd None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:50.063682 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e11db9-c351-402f-9b15-06b9871549dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:50.128095 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-f8e11db9-c351-402f-9b15-06b9871549dd None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:50.129299 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-f8e11db9-c351-402f-9b15-06b9871549dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:50.149222 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:50.228614 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 22:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:42:50.267405 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b453f2-56da-4a58-b922-1760a699e352 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:42:50.269492 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-28b453f2-56da-4a58-b922-1760a699e352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:50.379467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b453f2-56da-4a58-b922-1760a699e352 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:50.399384 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:50.453313 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79cb3b-40ac-474c-8092-976d2b496bb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:50.454744 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79cb3b-40ac-474c-8092-976d2b496bb8 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:50.455032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79cb3b-40ac-474c-8092-976d2b496bb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:50.455310 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79cb3b-40ac-474c-8092-976d2b496bb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:50.456951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ba79cb3b-40ac-474c-8092-976d2b496bb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:50.684869 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79cb3b-40ac-474c-8092-976d2b496bb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:50.686300 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79cb3b-40ac-474c-8092-976d2b496bb8 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:50.705006 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 727/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:42:52.728993 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec5d4b-ce54-44c5-b39d-9bbc99750033 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:52.729565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec5d4b-ce54-44c5-b39d-9bbc99750033 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:52.729565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec5d4b-ce54-44c5-b39d-9bbc99750033 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:52.730949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 22:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:52.736747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af363f9-f17f-4a6d-aa50-f0bbaa9eef58 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:52.737137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af363f9-f17f-4a6d-aa50-f0bbaa9eef58 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:52.737288 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af363f9-f17f-4a6d-aa50-f0bbaa9eef58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:52.799792 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:52.802872 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-8af363f9-f17f-4a6d-aa50-f0bbaa9eef58 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:52.804500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8af363f9-f17f-4a6d-aa50-f0bbaa9eef58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:52.898975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 22:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:42:52.936189 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec5d4b-ce54-44c5-b39d-9bbc99750033 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:42:52.937696 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-69ec5d4b-ce54-44c5-b39d-9bbc99750033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:53.040081 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec5d4b-ce54-44c5-b39d-9bbc99750033 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:53.086932 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:53.111682 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653b4d2-fec8-4649-8ae9-3a5902bdb2e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:53.112290 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653b4d2-fec8-4649-8ae9-3a5902bdb2e7 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:53.112589 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653b4d2-fec8-4649-8ae9-3a5902bdb2e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:53.112840 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653b4d2-fec8-4649-8ae9-3a5902bdb2e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:53.114458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c653b4d2-fec8-4649-8ae9-3a5902bdb2e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:53.218793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653b4d2-fec8-4649-8ae9-3a5902bdb2e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:53.220666 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c653b4d2-fec8-4649-8ae9-3a5902bdb2e7 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:53.238586 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 727/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:42:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:55.296864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a95a5-f702-4347-8abb-6d189b77ae9c None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:55.297369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a95a5-f702-4347-8abb-6d189b77ae9c None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:55.297369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a95a5-f702-4347-8abb-6d189b77ae9c None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:55.299351 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 22:42:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:55.304604 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0cf15-5482-482e-86ac-385ee5ebe6c7 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:55.305002 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0cf15-5482-482e-86ac-385ee5ebe6c7 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:55.305161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0cf15-5482-482e-86ac-385ee5ebe6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:55.372568 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-42f0cf15-5482-482e-86ac-385ee5ebe6c7 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:55.373985 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-42f0cf15-5482-482e-86ac-385ee5ebe6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:55.403478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:55.471727 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 22:42:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:42:55.509371 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a95a5-f702-4347-8abb-6d189b77ae9c None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:42:55.510956 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e72a95a5-f702-4347-8abb-6d189b77ae9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:55.613199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a95a5-f702-4347-8abb-6d189b77ae9c None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:55.640796 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:55.686764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1509fa-7b1d-42e6-8092-4147956d0b29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:55.687377 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1509fa-7b1d-42e6-8092-4147956d0b29 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:55.687657 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1509fa-7b1d-42e6-8092-4147956d0b29 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:55.687933 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1509fa-7b1d-42e6-8092-4147956d0b29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:55.689538 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-0d1509fa-7b1d-42e6-8092-4147956d0b29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:55.796414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1509fa-7b1d-42e6-8092-4147956d0b29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:55.797838 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1509fa-7b1d-42e6-8092-4147956d0b29 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:55.815863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 730/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:42:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:42:57.884367 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e5940-1518-4be0-8353-ffffb099c26a None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:57.884909 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e5940-1518-4be0-8353-ffffb099c26a None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:57.885017 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067e5940-1518-4be0-8353-ffffb099c26a None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:57.886314 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 22:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:42:57.892536 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feba5eb-c055-474a-91c4-909a2f8a0b11 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:57.893072 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feba5eb-c055-474a-91c4-909a2f8a0b11 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:57.893378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feba5eb-c055-474a-91c4-909a2f8a0b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:57.958496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-1feba5eb-c055-474a-91c4-909a2f8a0b11 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:42:57.959707 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-1feba5eb-c055-474a-91c4-909a2f8a0b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:57.967806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:58.054865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 22:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:42:58.092450 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e5940-1518-4be0-8353-ffffb099c26a None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:42:58.094076 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-067e5940-1518-4be0-8353-ffffb099c26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:58.195669 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067e5940-1518-4be0-8353-ffffb099c26a None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:42:58.252402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:42:58.270454 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea620e47-bb87-4f74-96b1-32c1a64b1fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:42:58.271071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea620e47-bb87-4f74-96b1-32c1a64b1fef service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:42:58.271352 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea620e47-bb87-4f74-96b1-32c1a64b1fef service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:42:58.271622 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea620e47-bb87-4f74-96b1-32c1a64b1fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:42:58.273226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ea620e47-bb87-4f74-96b1-32c1a64b1fef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:42:58.381005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea620e47-bb87-4f74-96b1-32c1a64b1fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:42:58.383149 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea620e47-bb87-4f74-96b1-32c1a64b1fef service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:42:58.402595 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 730/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:42:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:43:00.495810 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c11b05-9ac6-4c79-b43c-0c1ce0f64c57 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:00.496387 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c11b05-9ac6-4c79-b43c-0c1ce0f64c57 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:00.496387 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c11b05-9ac6-4c79-b43c-0c1ce0f64c57 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:00.497707 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 22:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:43:00.503592 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8216d9-a977-4596-bdc1-93921faa1492 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:00.503982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8216d9-a977-4596-bdc1-93921faa1492 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:00.504155 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8216d9-a977-4596-bdc1-93921faa1492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:00.570133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-6b8216d9-a977-4596-bdc1-93921faa1492 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:43:00.571369 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-6b8216d9-a977-4596-bdc1-93921faa1492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:00.610054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:00.668307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 22:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:43:00.705745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c11b05-9ac6-4c79-b43c-0c1ce0f64c57 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:43:00.707307 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e1c11b05-9ac6-4c79-b43c-0c1ce0f64c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:00.807646 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c11b05-9ac6-4c79-b43c-0c1ce0f64c57 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:43:00.844671 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:00.879775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf84ab7-af6a-468f-9586-e0d5a68320c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:43:00.880392 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf84ab7-af6a-468f-9586-e0d5a68320c8 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:00.880678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf84ab7-af6a-468f-9586-e0d5a68320c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:00.880956 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf84ab7-af6a-468f-9586-e0d5a68320c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:00.882593 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8cf84ab7-af6a-468f-9586-e0d5a68320c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:00.988486 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf84ab7-af6a-468f-9586-e0d5a68320c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:43:00.989897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf84ab7-af6a-468f-9586-e0d5a68320c8 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:43:01.007720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 733/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:43:02.990607 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2b824-081e-4aef-8e6f-c723722066c2 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:02.991174 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2b824-081e-4aef-8e6f-c723722066c2 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:02.991174 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2b824-081e-4aef-8e6f-c723722066c2 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:02.992564 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 22:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:43:02.997633 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918daa05-a190-45ae-956a-6aa5d782d4a6 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:02.998066 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918daa05-a190-45ae-956a-6aa5d782d4a6 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:02.998188 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918daa05-a190-45ae-956a-6aa5d782d4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:03.063304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-918daa05-a190-45ae-956a-6aa5d782d4a6 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:43:03.064514 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-918daa05-a190-45ae-956a-6aa5d782d4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:03.082686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:03.160315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 22:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:43:03.195752 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2b824-081e-4aef-8e6f-c723722066c2 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:43:03.197309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-7bf2b824-081e-4aef-8e6f-c723722066c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:03.299868 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2b824-081e-4aef-8e6f-c723722066c2 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:43:03.365413 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:03.373271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2d304-d08e-4490-a963-9b0e3d4196ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:43:03.373917 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2d304-d08e-4490-a963-9b0e3d4196ed service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:03.374202 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2d304-d08e-4490-a963-9b0e3d4196ed service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:03.374514 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2d304-d08e-4490-a963-9b0e3d4196ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:03.376166 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-97e2d304-d08e-4490-a963-9b0e3d4196ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:03.484569 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2d304-d08e-4490-a963-9b0e3d4196ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:43:03.486012 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2d304-d08e-4490-a963-9b0e3d4196ed service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:43:03.503992 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 733/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:43:05.470331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b802-06f5-4d75-bdeb-caf7f7e93da2 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:05.470930 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b802-06f5-4d75-bdeb-caf7f7e93da2 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:05.470930 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b802-06f5-4d75-bdeb-caf7f7e93da2 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:05.472308 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 22:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:43:05.477619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d603b-578c-4139-81c0-1911ec5c5b80 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:05.478061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d603b-578c-4139-81c0-1911ec5c5b80 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:05.478183 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008d603b-578c-4139-81c0-1911ec5c5b80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:05.542174 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-008d603b-578c-4139-81c0-1911ec5c5b80 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:43:05.543527 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-008d603b-578c-4139-81c0-1911ec5c5b80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:05.595907 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:05.644860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 22:43:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:43:05.691660 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810b802-06f5-4d75-bdeb-caf7f7e93da2 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:43:05.693228 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-c810b802-06f5-4d75-bdeb-caf7f7e93da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:05.802299 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810b802-06f5-4d75-bdeb-caf7f7e93da2 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:43:05.850335 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:05.877512 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0dddf-c382-4175-8d5e-19bfc97c563d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:43:05.878134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0dddf-c382-4175-8d5e-19bfc97c563d service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:05.878459 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0dddf-c382-4175-8d5e-19bfc97c563d service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:05.878740 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0dddf-c382-4175-8d5e-19bfc97c563d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:05.880428 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-43f0dddf-c382-4175-8d5e-19bfc97c563d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:05.996170 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0dddf-c382-4175-8d5e-19bfc97c563d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:43:05.996170 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0dddf-c382-4175-8d5e-19bfc97c563d service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:43:06.009418 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 736/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:43:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:43:15.643024 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=22 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:16.006845 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=66 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:25.617330 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943f27e-c5f3-4c62-9bcd-1828fec0c060 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:25.617790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943f27e-c5f3-4c62-9bcd-1828fec0c060 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:25.617896 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943f27e-c5f3-4c62-9bcd-1828fec0c060 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:25.619276 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 735/1471] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:43:25.624422 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991dfeb-afd7-4c02-b88d-f1a183391bc7 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:25.624929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991dfeb-afd7-4c02-b88d-f1a183391bc7 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:25.625039 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991dfeb-afd7-4c02-b88d-f1a183391bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:25.690416 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-9991dfeb-afd7-4c02-b88d-f1a183391bc7 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:43:25.691614 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-9991dfeb-afd7-4c02-b88d-f1a183391bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:25.792594 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 737/1472] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:43:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:43:25.876761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22384a-8fa8-47b5-8aca-27eaabfbd029 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:25.877092 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22384a-8fa8-47b5-8aca-27eaabfbd029 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:25.877471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc22384a-8fa8-47b5-8aca-27eaabfbd029 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:25.878876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 736/1473] 10.222.0.48 () {54 vars in 966 bytes} [Wed Jul 27 22:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:43:25.884354 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09825642-130e-489f-ae8a-c56e20867fb0 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:25.884649 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09825642-130e-489f-ae8a-c56e20867fb0 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:25.884933 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09825642-130e-489f-ae8a-c56e20867fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:25.960167 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-09825642-130e-489f-ae8a-c56e20867fb0 None None] MFA Rules not processed for user `b26c60d08b9f47aca8404e4173290908`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:43:25.961378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-09825642-130e-489f-ae8a-c56e20867fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:25.982445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:26.036933 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 738/1474] 10.222.0.48 () {58 vars in 1063 bytes} [Wed Jul 27 22:43:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:43:26.044540 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22384a-8fa8-47b5-8aca-27eaabfbd029 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:43:26.046017 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-cc22384a-8fa8-47b5-8aca-27eaabfbd029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:26.150585 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc22384a-8fa8-47b5-8aca-27eaabfbd029 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:43:26.221855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc6e55a-8cbe-4216-b9c3-009459cee0a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b26c60d08b9f47aca8404e4173290908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:43:26.222496 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6e55a-8cbe-4216-b9c3-009459cee0a9 service glance] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:26.222781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6e55a-8cbe-4216-b9c3-009459cee0a9 service glance] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:26.223056 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc6e55a-8cbe-4216-b9c3-009459cee0a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:26.224718 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-fcc6e55a-8cbe-4216-b9c3-009459cee0a9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:26.277139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:26.330777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6e55a-8cbe-4216-b9c3-009459cee0a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:43:26.332119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc6e55a-8cbe-4216-b9c3-009459cee0a9 service glance] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:43:26.351212 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 737/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:43:28.420549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5189d4c-63cb-4d46-97d6-b0c9e57874aa None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:28.421128 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5189d4c-63cb-4d46-97d6-b0c9e57874aa None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:28.421128 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5189d4c-63cb-4d46-97d6-b0c9e57874aa None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:28.422478 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 739/1476] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:43:28.429053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04386c5d-33c6-41be-ae5c-71efce7e5100 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:28.429522 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04386c5d-33c6-41be-ae5c-71efce7e5100 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:28.429634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04386c5d-33c6-41be-ae5c-71efce7e5100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:28.496438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-04386c5d-33c6-41be-ae5c-71efce7e5100 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:43:28.497647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-04386c5d-33c6-41be-ae5c-71efce7e5100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:28.591273 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 738/1477] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:43:28.614704 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5189d4c-63cb-4d46-97d6-b0c9e57874aa None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:43:28.616267 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a5189d4c-63cb-4d46-97d6-b0c9e57874aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:28.737570 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5189d4c-63cb-4d46-97d6-b0c9e57874aa None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:43:28.785146 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:28.830541 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21475c33-44a9-46f2-862a-1043d66b782b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:43:28.831153 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21475c33-44a9-46f2-862a-1043d66b782b admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:28.831433 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21475c33-44a9-46f2-862a-1043d66b782b admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:28.831710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21475c33-44a9-46f2-862a-1043d66b782b admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:28.832395 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21475c33-44a9-46f2-862a-1043d66b782b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:43:28.834093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: WARNING py.warnings [None req-21475c33-44a9-46f2-862a-1043d66b782b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:43:28.834093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: warnings.warn(msg) Jul 27 22:43:28.834093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: Jul 27 22:43:28.835252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21475c33-44a9-46f2-862a-1043d66b782b admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:43:28.853856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 740/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Wed Jul 27 22:43:28 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:43:30.873553 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a893a-7ca9-4919-971b-903325082ebb None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:30.874098 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a893a-7ca9-4919-971b-903325082ebb None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:30.874098 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363a893a-7ca9-4919-971b-903325082ebb None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:30.875419 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 739/1479] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:43:30.881128 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f6623-b7b4-4226-85f6-5d2ef5f57e21 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:30.881601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f6623-b7b4-4226-85f6-5d2ef5f57e21 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:30.881699 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f6623-b7b4-4226-85f6-5d2ef5f57e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:30.946725 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-321f6623-b7b4-4226-85f6-5d2ef5f57e21 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:43:30.947909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-321f6623-b7b4-4226-85f6-5d2ef5f57e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:31.041200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 741/1480] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:43:31.085873 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a893a-7ca9-4919-971b-903325082ebb None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:43:31.087700 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-363a893a-7ca9-4919-971b-903325082ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:31.097924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:31.230640 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363a893a-7ca9-4919-971b-903325082ebb None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:43:31.308415 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:31.340523 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638a6f0-ba07-4bd3-ae2b-abf228ffac8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:43:31.341143 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a6f0-ba07-4bd3-ae2b-abf228ffac8c service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:31.341427 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a6f0-ba07-4bd3-ae2b-abf228ffac8c service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:31.341705 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a6f0-ba07-4bd3-ae2b-abf228ffac8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:31.343389 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e638a6f0-ba07-4bd3-ae2b-abf228ffac8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:31.434028 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638a6f0-ba07-4bd3-ae2b-abf228ffac8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:43:31.435673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638a6f0-ba07-4bd3-ae2b-abf228ffac8c service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:43:31.453022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 740/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:43:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:43:33.633124 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a29dc-7e55-47ce-8bbe-54c57ed42e98 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:33.633628 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a29dc-7e55-47ce-8bbe-54c57ed42e98 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:33.633729 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a29dc-7e55-47ce-8bbe-54c57ed42e98 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:33.635062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 742/1482] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:43:33.640330 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bcec7-48d0-4a0d-a6f6-bdf5e4f522f0 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:33.640767 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bcec7-48d0-4a0d-a6f6-bdf5e4f522f0 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:33.640959 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bcec7-48d0-4a0d-a6f6-bdf5e4f522f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:33.706967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-829bcec7-48d0-4a0d-a6f6-bdf5e4f522f0 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:43:33.708161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-829bcec7-48d0-4a0d-a6f6-bdf5e4f522f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:33.753400 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:33.803844 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 741/1483] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:43:33.839616 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a29dc-7e55-47ce-8bbe-54c57ed42e98 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:43:33.841135 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-112a29dc-7e55-47ce-8bbe-54c57ed42e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:33.864686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:33.942912 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a29dc-7e55-47ce-8bbe-54c57ed42e98 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:43:34.013676 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9b150-5357-40e8-bf0d-a034c8b9e2d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:43:34.014283 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9b150-5357-40e8-bf0d-a034c8b9e2d2 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:34.014594 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9b150-5357-40e8-bf0d-a034c8b9e2d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:34.014869 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9b150-5357-40e8-bf0d-a034c8b9e2d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:34.016462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-f2b9b150-5357-40e8-bf0d-a034c8b9e2d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:34.087315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:34.121554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9b150-5357-40e8-bf0d-a034c8b9e2d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:43:34.122943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9b150-5357-40e8-bf0d-a034c8b9e2d2 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:43:34.142876 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 743/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:43:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:43:36.185537 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a50c-0d92-48e9-bbd8-f42f485a7fc5 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:36.186112 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a50c-0d92-48e9-bbd8-f42f485a7fc5 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:36.186112 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba51a50c-0d92-48e9-bbd8-f42f485a7fc5 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:36.187489 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 742/1485] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:43:36.192950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8e50f-6f4c-4599-b7ed-7c2e82a16cb3 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:36.193374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8e50f-6f4c-4599-b7ed-7c2e82a16cb3 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:36.193494 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b8e50f-6f4c-4599-b7ed-7c2e82a16cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:36.257882 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-b1b8e50f-6f4c-4599-b7ed-7c2e82a16cb3 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:43:36.259131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-b1b8e50f-6f4c-4599-b7ed-7c2e82a16cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:36.355647 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 744/1486] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:43:36.396070 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51a50c-0d92-48e9-bbd8-f42f485a7fc5 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:43:36.397603 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ba51a50c-0d92-48e9-bbd8-f42f485a7fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:36.503456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba51a50c-0d92-48e9-bbd8-f42f485a7fc5 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:43:36.573192 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:36.575228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0783d46c-6fdf-4fcb-ac9c-6a628b41c409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:43:36.576046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783d46c-6fdf-4fcb-ac9c-6a628b41c409 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:36.576512 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783d46c-6fdf-4fcb-ac9c-6a628b41c409 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:36.577078 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0783d46c-6fdf-4fcb-ac9c-6a628b41c409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:36.579126 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-0783d46c-6fdf-4fcb-ac9c-6a628b41c409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:36.687501 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783d46c-6fdf-4fcb-ac9c-6a628b41c409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:43:36.688933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0783d46c-6fdf-4fcb-ac9c-6a628b41c409 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:43:36.707777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 743/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:43:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:43:38.801086 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b838be-ed52-4fa2-aad0-0c37dc8a33ee None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:38.801688 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b838be-ed52-4fa2-aad0-0c37dc8a33ee None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:38.801688 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b838be-ed52-4fa2-aad0-0c37dc8a33ee None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:38.803021 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 745/1488] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:43:38.808176 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ec116-9136-4e78-8568-0056c9f6e834 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:38.808630 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ec116-9136-4e78-8568-0056c9f6e834 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:38.808734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0ec116-9136-4e78-8568-0056c9f6e834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:38.874724 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-5d0ec116-9136-4e78-8568-0056c9f6e834 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:43:38.875861 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5d0ec116-9136-4e78-8568-0056c9f6e834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:38.928553 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:38.972552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 744/1489] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:43:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:43:39.011988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b838be-ed52-4fa2-aad0-0c37dc8a33ee None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:43:39.013501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-42b838be-ed52-4fa2-aad0-0c37dc8a33ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:39.048596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:39.117399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b838be-ed52-4fa2-aad0-0c37dc8a33ee None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:43:39.188566 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54843d6b-f49a-4b0e-b061-d0a4fccdee58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:43:39.189182 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54843d6b-f49a-4b0e-b061-d0a4fccdee58 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:39.189470 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54843d6b-f49a-4b0e-b061-d0a4fccdee58 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:39.190414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54843d6b-f49a-4b0e-b061-d0a4fccdee58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:39.192048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-54843d6b-f49a-4b0e-b061-d0a4fccdee58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:39.269742 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:39.298211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54843d6b-f49a-4b0e-b061-d0a4fccdee58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:43:39.300203 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54843d6b-f49a-4b0e-b061-d0a4fccdee58 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:43:39.318219 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 746/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:43:41.538790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3e3c4-e660-4d46-9201-27de4eb8478f None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:41.539360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3e3c4-e660-4d46-9201-27de4eb8478f None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:41.539360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3e3c4-e660-4d46-9201-27de4eb8478f None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:41.540723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 745/1491] 10.222.0.48 () {54 vars in 926 bytes} [Wed Jul 27 22:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:43:41.546170 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb57e6-0fb3-4ca3-8041-2aa6bb67b408 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:41.546684 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb57e6-0fb3-4ca3-8041-2aa6bb67b408 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:41.546791 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb57e6-0fb3-4ca3-8041-2aa6bb67b408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:41.619468 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-3aeb57e6-0fb3-4ca3-8041-2aa6bb67b408 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:43:41.620712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-3aeb57e6-0fb3-4ca3-8041-2aa6bb67b408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:41.715929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 747/1492] 10.222.0.48 () {58 vars in 1023 bytes} [Wed Jul 27 22:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:43:41.756811 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3e3c4-e660-4d46-9201-27de4eb8478f None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:43:41.758414 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e3a3e3c4-e660-4d46-9201-27de4eb8478f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:41.863146 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3e3c4-e660-4d46-9201-27de4eb8478f None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:43:41.937712 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4718eb-10f2-4a2e-b214-a4c94e369c93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:43:41.938332 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4718eb-10f2-4a2e-b214-a4c94e369c93 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:43:41.938644 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4718eb-10f2-4a2e-b214-a4c94e369c93 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:43:41.938923 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4718eb-10f2-4a2e-b214-a4c94e369c93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:43:41.940588 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-1d4718eb-10f2-4a2e-b214-a4c94e369c93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:43:41.949809 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:42.050118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4718eb-10f2-4a2e-b214-a4c94e369c93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:43:42.051625 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4718eb-10f2-4a2e-b214-a4c94e369c93 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:43:42.069829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 746/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:43:51.714154 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=82 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:43:52.067496 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=50 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:45:15.888256 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc26c7-aa89-44e1-990f-5916c8e16b1f None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:45:15.888888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc26c7-aa89-44e1-990f-5916c8e16b1f None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:45:15.888888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc26c7-aa89-44e1-990f-5916c8e16b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:45:15.963026 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-f2dc26c7-aa89-44e1-990f-5916c8e16b1f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:45:15.964232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-f2dc26c7-aa89-44e1-990f-5916c8e16b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:45:16.066154 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 748/1494] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:45:16.074276 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdd779-f492-4ea2-ae05-3bb401b4335e None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:45:16.074809 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdd779-f492-4ea2-ae05-3bb401b4335e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:45:16.074930 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdd779-f492-4ea2-ae05-3bb401b4335e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:45:16.149117 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-fbbdd779-f492-4ea2-ae05-3bb401b4335e None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:45:16.150240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-fbbdd779-f492-4ea2-ae05-3bb401b4335e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:45:16.245071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 747/1495] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:45:16.249732 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc26c7-aa89-44e1-990f-5916c8e16b1f None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:45:16.250956 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-f2dc26c7-aa89-44e1-990f-5916c8e16b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:45:16.262105 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc26c7-aa89-44e1-990f-5916c8e16b1f None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:45:16.321311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:45:16.365058 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46144fe1-7c0b-40c2-b6d7-3c0c9a2e5eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:45:16.365668 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46144fe1-7c0b-40c2-b6d7-3c0c9a2e5eac admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:45:16.365947 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46144fe1-7c0b-40c2-b6d7-3c0c9a2e5eac admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:45:16.366220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46144fe1-7c0b-40c2-b6d7-3c0c9a2e5eac admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:45:16.366939 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46144fe1-7c0b-40c2-b6d7-3c0c9a2e5eac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:45:16.367244 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46144fe1-7c0b-40c2-b6d7-3c0c9a2e5eac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:45:16.368316 dv-cinder-851249-4-smb devstack@keystone.service[86594]: WARNING py.warnings [None req-46144fe1-7c0b-40c2-b6d7-3c0c9a2e5eac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:45:16.368316 dv-cinder-851249-4-smb devstack@keystone.service[86594]: warnings.warn(msg) Jul 27 22:45:16.368316 dv-cinder-851249-4-smb devstack@keystone.service[86594]: Jul 27 22:45:16.369238 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46144fe1-7c0b-40c2-b6d7-3c0c9a2e5eac admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:45:16.381310 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 749/1496] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:45:16.389522 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdd779-f492-4ea2-ae05-3bb401b4335e None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:45:16.402001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdd779-f492-4ea2-ae05-3bb401b4335e None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:45:16.465938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:45:16.499765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581d0d4-8a51-432a-8246-35c0b0677f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:45:16.500383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581d0d4-8a51-432a-8246-35c0b0677f34 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:45:16.500674 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581d0d4-8a51-432a-8246-35c0b0677f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:45:16.500941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581d0d4-8a51-432a-8246-35c0b0677f34 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:45:16.501612 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581d0d4-8a51-432a-8246-35c0b0677f34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:45:16.503374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: WARNING py.warnings [None req-4581d0d4-8a51-432a-8246-35c0b0677f34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:45:16.503374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: warnings.warn(msg) Jul 27 22:45:16.503374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: Jul 27 22:45:16.504553 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581d0d4-8a51-432a-8246-35c0b0677f34 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:45:16.558295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 748/1497] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:45:16 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:45:16.562525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46144fe1-7c0b-40c2-b6d7-3c0c9a2e5eac admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:45:16.564034 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-46144fe1-7c0b-40c2-b6d7-3c0c9a2e5eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:45:16.598028 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46144fe1-7c0b-40c2-b6d7-3c0c9a2e5eac admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:45:16.694887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95551d51-991a-4d5f-9a8d-a057bda0bb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:45:16.695419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95551d51-991a-4d5f-9a8d-a057bda0bb48 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:45:16.695704 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95551d51-991a-4d5f-9a8d-a057bda0bb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:45:16.695973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95551d51-991a-4d5f-9a8d-a057bda0bb48 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:45:16.696635 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95551d51-991a-4d5f-9a8d-a057bda0bb48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:45:16.697624 dv-cinder-851249-4-smb devstack@keystone.service[86594]: WARNING py.warnings [None req-95551d51-991a-4d5f-9a8d-a057bda0bb48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:45:16.697624 dv-cinder-851249-4-smb devstack@keystone.service[86594]: warnings.warn(msg) Jul 27 22:45:16.697624 dv-cinder-851249-4-smb devstack@keystone.service[86594]: Jul 27 22:45:16.698837 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95551d51-991a-4d5f-9a8d-a057bda0bb48 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:45:16.741215 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 750/1498] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:45:16 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:45:16.745331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581d0d4-8a51-432a-8246-35c0b0677f34 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:45:16.746880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-4581d0d4-8a51-432a-8246-35c0b0677f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:45:16.807902 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581d0d4-8a51-432a-8246-35c0b0677f34 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:45:16.891375 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:45:16.903118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b92443-bb47-41f7-aaf2-b7181463fdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:45:16.903784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b92443-bb47-41f7-aaf2-b7181463fdfd admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:45:16.904066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b92443-bb47-41f7-aaf2-b7181463fdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:45:16.904343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b92443-bb47-41f7-aaf2-b7181463fdfd admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:45:16.905035 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b92443-bb47-41f7-aaf2-b7181463fdfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:45:16.906661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: WARNING py.warnings [None req-e4b92443-bb47-41f7-aaf2-b7181463fdfd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:45:16.906661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: warnings.warn(msg) Jul 27 22:45:16.906661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: Jul 27 22:45:16.907538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b92443-bb47-41f7-aaf2-b7181463fdfd admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:45:16.919680 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 749/1499] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:45:16.923799 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95551d51-991a-4d5f-9a8d-a057bda0bb48 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:45:16.925300 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-95551d51-991a-4d5f-9a8d-a057bda0bb48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:45:16.936601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95551d51-991a-4d5f-9a8d-a057bda0bb48 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:45:16.962388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:45:17.032033 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a0f04a-7c2d-4e63-9d3a-3395a8f0e514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:45:17.032656 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0f04a-7c2d-4e63-9d3a-3395a8f0e514 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:45:17.032940 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0f04a-7c2d-4e63-9d3a-3395a8f0e514 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:45:17.033219 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a0f04a-7c2d-4e63-9d3a-3395a8f0e514 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:45:17.033920 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0f04a-7c2d-4e63-9d3a-3395a8f0e514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:45:17.034957 dv-cinder-851249-4-smb devstack@keystone.service[86594]: WARNING py.warnings [None req-f3a0f04a-7c2d-4e63-9d3a-3395a8f0e514 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:45:17.034957 dv-cinder-851249-4-smb devstack@keystone.service[86594]: warnings.warn(msg) Jul 27 22:45:17.034957 dv-cinder-851249-4-smb devstack@keystone.service[86594]: Jul 27 22:45:17.035856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a0f04a-7c2d-4e63-9d3a-3395a8f0e514 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:45:17.047903 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 751/1500] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:45:17.052105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b92443-bb47-41f7-aaf2-b7181463fdfd admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:45:17.053665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e4b92443-bb47-41f7-aaf2-b7181463fdfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:45:17.087481 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b92443-bb47-41f7-aaf2-b7181463fdfd admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:45:17.180706 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3ff056-5b8e-456d-b560-c8b73b64e4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:45:17.181389 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ff056-5b8e-456d-b560-c8b73b64e4d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:45:17.181693 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ff056-5b8e-456d-b560-c8b73b64e4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:45:17.181958 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3ff056-5b8e-456d-b560-c8b73b64e4d3 admin admin] PATH_INFO: `/v3/projects/d968e120d8774502836fac7e54153eee/users/e492baeed17c4ef395fd320b0be62246/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:45:17.205230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ff056-5b8e-456d-b560-c8b73b64e4d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d968e120d8774502836fac7e54153eee, user_id=e492baeed17c4ef395fd320b0be62246, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:45:17.206323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: WARNING py.warnings [None req-5d3ff056-5b8e-456d-b560-c8b73b64e4d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:45:17.206323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: warnings.warn(msg) Jul 27 22:45:17.206323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: Jul 27 22:45:17.208354 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3ff056-5b8e-456d-b560-c8b73b64e4d3 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:45:17.232011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 750/1501] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:45:17 2022] PUT /identity/v3/projects/d968e120d8774502836fac7e54153eee/users/e492baeed17c4ef395fd320b0be62246/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:45:17.243793 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea038241-d422-4714-b72e-1ad08d169efc None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:45:17.244090 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea038241-d422-4714-b72e-1ad08d169efc None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:45:17.244403 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea038241-d422-4714-b72e-1ad08d169efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:45:17.301698 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-ea038241-d422-4714-b72e-1ad08d169efc None None] MFA Rules not processed for user `e492baeed17c4ef395fd320b0be62246`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:45:17.302977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ea038241-d422-4714-b72e-1ad08d169efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:45:17.379288 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 752/1502] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:45:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:45:17.392363 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6e2f8-d256-4740-922a-4ffdc796e4c3 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:45:17.392654 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6e2f8-d256-4740-922a-4ffdc796e4c3 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:45:17.392936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6e2f8-d256-4740-922a-4ffdc796e4c3 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:45:17.394295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 751/1503] 10.222.0.48 () {54 vars in 964 bytes} [Wed Jul 27 22:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:45:17.399129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43293521-f584-4b42-977e-e3c4b91d9966 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:45:17.399422 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43293521-f584-4b42-977e-e3c4b91d9966 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:45:17.399704 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43293521-f584-4b42-977e-e3c4b91d9966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:45:17.430305 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:45:17.473921 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-43293521-f584-4b42-977e-e3c4b91d9966 None None] MFA Rules not processed for user `9ac8dcdbe57646f79593e7f39dc60900`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:45:17.475150 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-43293521-f584-4b42-977e-e3c4b91d9966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:45:17.549308 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 753/1504] 10.222.0.48 () {58 vars in 1061 bytes} [Wed Jul 27 22:45:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:45:17.556928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6e2f8-d256-4740-922a-4ffdc796e4c3 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:45:17.558547 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-aee6e2f8-d256-4740-922a-4ffdc796e4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:45:17.610313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:45:17.663873 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6e2f8-d256-4740-922a-4ffdc796e4c3 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:45:17.741354 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e7bfb-524f-41f3-86f6-2d4b5430c9e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:45:17.741980 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e7bfb-524f-41f3-86f6-2d4b5430c9e7 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:45:17.742262 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e7bfb-524f-41f3-86f6-2d4b5430c9e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:45:17.742565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e7bfb-524f-41f3-86f6-2d4b5430c9e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:45:17.744176 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d60e7bfb-524f-41f3-86f6-2d4b5430c9e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:45:17.840938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e7bfb-524f-41f3-86f6-2d4b5430c9e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:45:17.842289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e7bfb-524f-41f3-86f6-2d4b5430c9e7 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:45:17.846327 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:45:17.861522 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 752/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:45:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:45:17.906000 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b871d2b-5002-461c-b6dc-f3be6ecb74bd None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:45:17.906311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b871d2b-5002-461c-b6dc-f3be6ecb74bd None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:45:17.906622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b871d2b-5002-461c-b6dc-f3be6ecb74bd None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:45:17.907884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 754/1506] 10.222.0.48 () {52 vars in 830 bytes} [Wed Jul 27 22:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:45:17.911420 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e7bfb-524f-41f3-86f6-2d4b5430c9e7 service cinder] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:45:17.912650 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d60e7bfb-524f-41f3-86f6-2d4b5430c9e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:45:18.010631 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e7bfb-524f-41f3-86f6-2d4b5430c9e7 service cinder] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:45:18.125720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5000d6f-c7ed-45f7-815e-8c3213813482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:45:18.126429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5000d6f-c7ed-45f7-815e-8c3213813482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:45:18.126590 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5000d6f-c7ed-45f7-815e-8c3213813482 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:45:18.126870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5000d6f-c7ed-45f7-815e-8c3213813482 admin admin] PATH_INFO: `/v3/users/e492baeed17c4ef395fd320b0be62246` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:45:18.139195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5000d6f-c7ed-45f7-815e-8c3213813482 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e492baeed17c4ef395fd320b0be62246)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:45:18.140227 dv-cinder-851249-4-smb devstack@keystone.service[86595]: WARNING py.warnings [None req-b5000d6f-c7ed-45f7-815e-8c3213813482 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:45:18.140227 dv-cinder-851249-4-smb devstack@keystone.service[86595]: warnings.warn(msg) Jul 27 22:45:18.140227 dv-cinder-851249-4-smb devstack@keystone.service[86595]: Jul 27 22:45:18.141444 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5000d6f-c7ed-45f7-815e-8c3213813482 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:45:18.150931 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:45:18.204034 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b5000d6f-c7ed-45f7-815e-8c3213813482 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e492baeed17c4ef395fd320b0be62246'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:45:18.204568 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b5000d6f-c7ed-45f7-815e-8c3213813482 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e492baeed17c4ef395fd320b0be62246'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:45:18.214949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b5000d6f-c7ed-45f7-815e-8c3213813482 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e492baeed17c4ef395fd320b0be62246'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:45:18.233308 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b5000d6f-c7ed-45f7-815e-8c3213813482 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e492baeed17c4ef395fd320b0be62246'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:45:18.234275 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b5000d6f-c7ed-45f7-815e-8c3213813482 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e492baeed17c4ef395fd320b0be62246'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:45:18.252006 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 753/1507] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:45:17 2022] DELETE /identity/v3/users/e492baeed17c4ef395fd320b0be62246 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:45:18.256362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4996eb-27e2-41b1-9045-50a1916aaad3 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:45:18.256860 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4996eb-27e2-41b1-9045-50a1916aaad3 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:45:18.256988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4996eb-27e2-41b1-9045-50a1916aaad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:45:18.313082 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-7f4996eb-27e2-41b1-9045-50a1916aaad3 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:45:18.314262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-7f4996eb-27e2-41b1-9045-50a1916aaad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:45:18.390731 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:45:18.403371 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 755/1508] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:45:18.412720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5000d6f-c7ed-45f7-815e-8c3213813482 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:45:18.413929 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-b5000d6f-c7ed-45f7-815e-8c3213813482 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:45:18.511295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5000d6f-c7ed-45f7-815e-8c3213813482 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:45:18.565829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:45:18.588429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7edf11-37fc-4a9a-8f33-0bfc03747e72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:45:18.589054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7edf11-37fc-4a9a-8f33-0bfc03747e72 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:45:18.589339 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7edf11-37fc-4a9a-8f33-0bfc03747e72 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:45:18.589615 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7edf11-37fc-4a9a-8f33-0bfc03747e72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:45:18.591265 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8c7edf11-37fc-4a9a-8f33-0bfc03747e72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:45:18.696391 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7edf11-37fc-4a9a-8f33-0bfc03747e72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:45:18.697727 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7edf11-37fc-4a9a-8f33-0bfc03747e72 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:45:18.715719 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 754/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:45:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:45:19.065425 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4996eb-27e2-41b1-9045-50a1916aaad3 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:45:19.066793 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-7f4996eb-27e2-41b1-9045-50a1916aaad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:45:19.079390 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4996eb-27e2-41b1-9045-50a1916aaad3 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:45:19.182821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbebfe-c051-4ecc-83b5-e15005247358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:45:19.183463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbebfe-c051-4ecc-83b5-e15005247358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:45:19.183744 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbebfe-c051-4ecc-83b5-e15005247358 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:45:19.184018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbebfe-c051-4ecc-83b5-e15005247358 admin admin] PATH_INFO: `/v3/projects/d968e120d8774502836fac7e54153eee` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:45:19.194315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cbebfe-c051-4ecc-83b5-e15005247358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d968e120d8774502836fac7e54153eee)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:45:19.195374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: WARNING py.warnings [None req-e5cbebfe-c051-4ecc-83b5-e15005247358 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:45:19.195374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: warnings.warn(msg) Jul 27 22:45:19.195374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: Jul 27 22:45:19.196562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cbebfe-c051-4ecc-83b5-e15005247358 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:45:19.252708 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e5cbebfe-c051-4ecc-83b5-e15005247358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd968e120d8774502836fac7e54153eee', 'request_id': 'req-e5cbebfe-c051-4ecc-83b5-e15005247358'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:45:19.258468 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e5cbebfe-c051-4ecc-83b5-e15005247358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd968e120d8774502836fac7e54153eee', 'request_id': 'req-e5cbebfe-c051-4ecc-83b5-e15005247358'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:45:19.267812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e5cbebfe-c051-4ecc-83b5-e15005247358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd968e120d8774502836fac7e54153eee', 'request_id': 'req-e5cbebfe-c051-4ecc-83b5-e15005247358'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:45:19.296267 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e5cbebfe-c051-4ecc-83b5-e15005247358 admin admin] The token cache is being invalidate because project d968e120d8774502836fac7e54153eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:45:19.296559 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e5cbebfe-c051-4ecc-83b5-e15005247358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:45:19.297100 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e5cbebfe-c051-4ecc-83b5-e15005247358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:45:19.298550 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 756/1510] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:45:19 2022] DELETE /identity/v3/projects/d968e120d8774502836fac7e54153eee => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:45:28.713490 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=62 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:45:29.294277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:47:01.384670 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cca09f-67a0-4c02-8156-e69f1e2127ba None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:01.385369 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cca09f-67a0-4c02-8156-e69f1e2127ba None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:01.385369 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cca09f-67a0-4c02-8156-e69f1e2127ba None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:01.386746 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 22:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:47:01.393415 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525feba-c2ed-4e52-9d64-67bf961c7e33 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:01.393881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525feba-c2ed-4e52-9d64-67bf961c7e33 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:01.394259 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d525feba-c2ed-4e52-9d64-67bf961c7e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:01.477218 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-d525feba-c2ed-4e52-9d64-67bf961c7e33 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:47:01.478334 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d525feba-c2ed-4e52-9d64-67bf961c7e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:47:01.582088 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 22:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:47:01.736477 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cca09f-67a0-4c02-8156-e69f1e2127ba None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:47:01.738751 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a5cca09f-67a0-4c02-8156-e69f1e2127ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:47:01.855991 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cca09f-67a0-4c02-8156-e69f1e2127ba None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:47:01.861887 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7c8e9-250d-4073-98c1-70fd0d5cac2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:47:01.862603 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7c8e9-250d-4073-98c1-70fd0d5cac2b service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:01.862892 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7c8e9-250d-4073-98c1-70fd0d5cac2b service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:01.863171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7c8e9-250d-4073-98c1-70fd0d5cac2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:01.871075 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7c8e9-250d-4073-98c1-70fd0d5cac2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:47:01.873283 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7c8e9-250d-4073-98c1-70fd0d5cac2b service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:47:01.882528 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 756/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:47:02.702829 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be72978-e112-4c0a-a840-71e200b16943 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:02.703359 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be72978-e112-4c0a-a840-71e200b16943 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:02.703467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be72978-e112-4c0a-a840-71e200b16943 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:02.704736 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 22:47:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:47:02.709629 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e442e7-f214-46d4-a393-2eab828a2d46 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:02.710007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e442e7-f214-46d4-a393-2eab828a2d46 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:02.710181 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e442e7-f214-46d4-a393-2eab828a2d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:02.730534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-13e442e7-f214-46d4-a393-2eab828a2d46 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:47:02.731966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-13e442e7-f214-46d4-a393-2eab828a2d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:47:02.740393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 22:47:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:47:02.892683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be72978-e112-4c0a-a840-71e200b16943 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:47:02.906859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be72978-e112-4c0a-a840-71e200b16943 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:47:02.912206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35812e0e-a2e0-401c-84ca-7b149f942a60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:47:02.912821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35812e0e-a2e0-401c-84ca-7b149f942a60 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:02.913108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35812e0e-a2e0-401c-84ca-7b149f942a60 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:02.913388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35812e0e-a2e0-401c-84ca-7b149f942a60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:02.921293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35812e0e-a2e0-401c-84ca-7b149f942a60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:47:02.922893 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35812e0e-a2e0-401c-84ca-7b149f942a60 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:47:02.932155 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 759/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:47:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:47:03.467427 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34e2c4-502f-49ea-a49f-ddd99db3cb9d None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:03.467643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34e2c4-502f-49ea-a49f-ddd99db3cb9d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:03.467905 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34e2c4-502f-49ea-a49f-ddd99db3cb9d None None] PATH_INFO: `/v3` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:03.469238 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 758/1517] 10.222.0.58 () {54 vars in 925 bytes} [Wed Jul 27 22:47:03 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:47:03.475983 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f68907-782a-4736-9a8a-1aa284eecf64 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:03.476274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f68907-782a-4736-9a8a-1aa284eecf64 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:03.476555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f68907-782a-4736-9a8a-1aa284eecf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:03.538069 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-63f68907-782a-4736-9a8a-1aa284eecf64 None None] MFA Rules not processed for user `2e3a1384f3b34999a75572ee10a1e3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:47:03.539323 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-63f68907-782a-4736-9a8a-1aa284eecf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:47:03.556069 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:47:03.610997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 760/1518] 10.222.0.58 () {58 vars in 1015 bytes} [Wed Jul 27 22:47:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:47:12.725776 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=56 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:47:13.033920 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7b93f-bb65-44c7-b22b-2b316ca1ff42 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:13.034204 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7b93f-bb65-44c7-b22b-2b316ca1ff42 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:13.034506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d7b93f-bb65-44c7-b22b-2b316ca1ff42 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:13.035899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 759/1519] 10.222.0.48 () {54 vars in 961 bytes} [Wed Jul 27 22:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:47:13.040963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95a78f-f12b-4a48-9d28-9136a60787f7 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:13.041459 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95a78f-f12b-4a48-9d28-9136a60787f7 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:13.041578 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95a78f-f12b-4a48-9d28-9136a60787f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:13.060676 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-ea95a78f-f12b-4a48-9d28-9136a60787f7 None None] MFA Rules not processed for user `2e3a1384f3b34999a75572ee10a1e3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:47:13.061869 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ea95a78f-f12b-4a48-9d28-9136a60787f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:47:13.070392 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 761/1520] 10.222.0.48 () {58 vars in 1058 bytes} [Wed Jul 27 22:47:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:47:13.078175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7b93f-bb65-44c7-b22b-2b316ca1ff42 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:47:13.092053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d7b93f-bb65-44c7-b22b-2b316ca1ff42 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:47:13.096928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bff29b-c227-4fb0-9a28-e1cfe917b3ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a1384f3b34999a75572ee10a1e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:47:13.097528 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bff29b-c227-4fb0-9a28-e1cfe917b3ee service placement] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:13.097811 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bff29b-c227-4fb0-9a28-e1cfe917b3ee service placement] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:13.098087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bff29b-c227-4fb0-9a28-e1cfe917b3ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:13.106394 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bff29b-c227-4fb0-9a28-e1cfe917b3ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:47:13.107952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bff29b-c227-4fb0-9a28-e1cfe917b3ee service placement] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:47:13.117292 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 760/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:47:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:47:14.177570 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b3462-6cd7-4bd6-a912-04b9e21ddb98 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:14.178145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b3462-6cd7-4bd6-a912-04b9e21ddb98 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:14.178145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3b3462-6cd7-4bd6-a912-04b9e21ddb98 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:14.179526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 22:47:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:47:14.184364 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc65205-d6b0-44bd-b95e-42adb98fdd82 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:14.184773 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc65205-d6b0-44bd-b95e-42adb98fdd82 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:14.184914 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc65205-d6b0-44bd-b95e-42adb98fdd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:14.203645 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-7dc65205-d6b0-44bd-b95e-42adb98fdd82 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:47:14.204837 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-7dc65205-d6b0-44bd-b95e-42adb98fdd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:47:14.212681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 22:47:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:47:14.366441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b3462-6cd7-4bd6-a912-04b9e21ddb98 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:47:14.381047 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3b3462-6cd7-4bd6-a912-04b9e21ddb98 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:47:14.386599 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb69dd0-49c6-4d24-ad31-add4cd3d5ee7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:47:14.387215 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb69dd0-49c6-4d24-ad31-add4cd3d5ee7 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:14.388004 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb69dd0-49c6-4d24-ad31-add4cd3d5ee7 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:14.388287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb69dd0-49c6-4d24-ad31-add4cd3d5ee7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:14.396493 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb69dd0-49c6-4d24-ad31-add4cd3d5ee7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:47:14.398094 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb69dd0-49c6-4d24-ad31-add4cd3d5ee7 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:47:14.408151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 763/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:47:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:47:15.212696 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28337a-11d0-4f45-b852-e61e4ae4c3de None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:15.213150 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28337a-11d0-4f45-b852-e61e4ae4c3de None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:15.213267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28337a-11d0-4f45-b852-e61e4ae4c3de None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:15.214634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 22:47:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:47:15.219408 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1eb9f-26fa-4f13-9326-fc9527a72b3e None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:15.219852 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1eb9f-26fa-4f13-9326-fc9527a72b3e None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:15.220031 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1eb9f-26fa-4f13-9326-fc9527a72b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:15.239553 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-4de1eb9f-26fa-4f13-9326-fc9527a72b3e None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:47:15.240759 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-4de1eb9f-26fa-4f13-9326-fc9527a72b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:47:15.249120 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 22:47:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:47:15.399883 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28337a-11d0-4f45-b852-e61e4ae4c3de None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:47:15.414642 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28337a-11d0-4f45-b852-e61e4ae4c3de None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:47:15.420596 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e1d9d-da55-43ac-95bf-087e0c2ca362 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:47:15.421197 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e1d9d-da55-43ac-95bf-087e0c2ca362 service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:15.421481 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e1d9d-da55-43ac-95bf-087e0c2ca362 service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:15.421758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e1d9d-da55-43ac-95bf-087e0c2ca362 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:15.429657 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e1d9d-da55-43ac-95bf-087e0c2ca362 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:47:15.431246 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e1d9d-da55-43ac-95bf-087e0c2ca362 service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:47:15.440512 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 763/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:47:19.278509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7fb9-029d-41d1-9b68-5dd091c6209b None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:19.279064 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7fb9-029d-41d1-9b68-5dd091c6209b None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:19.279064 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b7fb9-029d-41d1-9b68-5dd091c6209b None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:19.280418 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 22:47:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:47:19.285449 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cbb2a-a44a-4223-99dd-21556f38cd69 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:19.285853 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cbb2a-a44a-4223-99dd-21556f38cd69 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:19.286000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cbb2a-a44a-4223-99dd-21556f38cd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:19.305459 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-e35cbb2a-a44a-4223-99dd-21556f38cd69 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:47:19.306658 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e35cbb2a-a44a-4223-99dd-21556f38cd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:47:19.314351 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 22:47:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:47:19.390932 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b7fb9-029d-41d1-9b68-5dd091c6209b None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:47:19.392652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-769b7fb9-029d-41d1-9b68-5dd091c6209b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:47:19.470699 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b7fb9-029d-41d1-9b68-5dd091c6209b None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:47:19.474728 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc627a-86ed-48d5-89db-0f37bb723d1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:47:19.475345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc627a-86ed-48d5-89db-0f37bb723d1d service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:19.475626 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc627a-86ed-48d5-89db-0f37bb723d1d service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:19.475898 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc627a-86ed-48d5-89db-0f37bb723d1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:19.485629 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc627a-86ed-48d5-89db-0f37bb723d1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:47:19.487076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc627a-86ed-48d5-89db-0f37bb723d1d service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:47:19.496288 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 766/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:47:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:47:21.485109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdb258-5dd7-4d6a-ade9-83c47564f9be None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:21.485630 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdb258-5dd7-4d6a-ade9-83c47564f9be None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:21.485630 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbdb258-5dd7-4d6a-ade9-83c47564f9be None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:21.486951 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 22:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:47:21.492162 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387cd50-2f09-492e-9050-d93f22818c78 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:21.492594 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387cd50-2f09-492e-9050-d93f22818c78 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:21.492718 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387cd50-2f09-492e-9050-d93f22818c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:21.515474 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-d387cd50-2f09-492e-9050-d93f22818c78 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:47:21.516697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d387cd50-2f09-492e-9050-d93f22818c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:47:21.524685 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 22:47:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:47:21.560338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdb258-5dd7-4d6a-ade9-83c47564f9be None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:47:21.570867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbdb258-5dd7-4d6a-ade9-83c47564f9be None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:47:21.574326 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2057d4ad-6399-458f-ba28-c9dd987ee317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:47:21.575503 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057d4ad-6399-458f-ba28-c9dd987ee317 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:21.575781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057d4ad-6399-458f-ba28-c9dd987ee317 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:21.576059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2057d4ad-6399-458f-ba28-c9dd987ee317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:21.585238 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057d4ad-6399-458f-ba28-c9dd987ee317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:47:21.586682 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2057d4ad-6399-458f-ba28-c9dd987ee317 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:47:21.595823 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 766/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:47:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:47:24.960328 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbd38e-290b-47c4-9310-2b00e982ad2e None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:24.960896 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbd38e-290b-47c4-9310-2b00e982ad2e None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:24.960896 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bbd38e-290b-47c4-9310-2b00e982ad2e None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:24.962253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 22:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:47:24.967747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdc210-ae30-4589-a26b-edc27887a25e None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:24.968156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdc210-ae30-4589-a26b-edc27887a25e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:24.968302 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fdc210-ae30-4589-a26b-edc27887a25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:24.988197 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-e1fdc210-ae30-4589-a26b-edc27887a25e None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:47:24.989383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e1fdc210-ae30-4589-a26b-edc27887a25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:47:24.997786 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 22:47:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:47:25.299669 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbd38e-290b-47c4-9310-2b00e982ad2e None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:47:25.301380 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-c9bbd38e-290b-47c4-9310-2b00e982ad2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:47:25.370964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:47:25.384440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bbd38e-290b-47c4-9310-2b00e982ad2e None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:47:25.388187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b07b9-35fd-4fa1-a645-f4098154eae3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:47:25.388812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b07b9-35fd-4fa1-a645-f4098154eae3 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:25.389099 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b07b9-35fd-4fa1-a645-f4098154eae3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:25.389379 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b07b9-35fd-4fa1-a645-f4098154eae3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:25.398245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b07b9-35fd-4fa1-a645-f4098154eae3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:47:25.399699 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5b07b9-35fd-4fa1-a645-f4098154eae3 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:47:25.409449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 769/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:47:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:47:27.418892 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66947dc1-eff0-41e5-9d45-543ec3af5e49 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:27.419422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66947dc1-eff0-41e5-9d45-543ec3af5e49 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:27.419518 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66947dc1-eff0-41e5-9d45-543ec3af5e49 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:27.420805 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 22:47:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:47:27.425918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389f620-d152-4d9c-b9fa-814edddfbf97 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:27.426315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389f620-d152-4d9c-b9fa-814edddfbf97 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:27.426436 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389f620-d152-4d9c-b9fa-814edddfbf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:27.445241 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-1389f620-d152-4d9c-b9fa-814edddfbf97 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:47:27.446457 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-1389f620-d152-4d9c-b9fa-814edddfbf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:47:27.454065 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 22:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:47:27.751181 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66947dc1-eff0-41e5-9d45-543ec3af5e49 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:47:27.753099 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-66947dc1-eff0-41e5-9d45-543ec3af5e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:47:27.765974 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66947dc1-eff0-41e5-9d45-543ec3af5e49 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:47:27.769542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5238d9-8ec6-47e3-9d64-1f038381327d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:47:27.770188 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5238d9-8ec6-47e3-9d64-1f038381327d service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:47:27.770496 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5238d9-8ec6-47e3-9d64-1f038381327d service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:47:27.770776 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5238d9-8ec6-47e3-9d64-1f038381327d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:47:27.780214 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5238d9-8ec6-47e3-9d64-1f038381327d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:47:27.781621 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5238d9-8ec6-47e3-9d64-1f038381327d service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:47:27.790902 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 769/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:47:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:47:37.440709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=11 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:47:37.786840 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=33 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:04.706744 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019a7af-f038-45b2-8007-710ebfc94685 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:04.707825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019a7af-f038-45b2-8007-710ebfc94685 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:04.708453 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9019a7af-f038-45b2-8007-710ebfc94685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:04.734740 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-9019a7af-f038-45b2-8007-710ebfc94685 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:04.736401 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-9019a7af-f038-45b2-8007-710ebfc94685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:04.749433 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 771/1540] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:04.758609 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf90ca-f075-4f8e-8191-c12cdb4a9c63 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:04.760107 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf90ca-f075-4f8e-8191-c12cdb4a9c63 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:04.760619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf90ca-f075-4f8e-8191-c12cdb4a9c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:04.791348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-afaf90ca-f075-4f8e-8191-c12cdb4a9c63 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:04.792925 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-afaf90ca-f075-4f8e-8191-c12cdb4a9c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:04.799577 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dead6-e700-436d-b42f-9faa7495b075 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:04.800233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dead6-e700-436d-b42f-9faa7495b075 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:04.800731 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240dead6-e700-436d-b42f-9faa7495b075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:04.816547 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 770/1541] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:04.824439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf90ca-f075-4f8e-8191-c12cdb4a9c63 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:04.836597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-240dead6-e700-436d-b42f-9faa7495b075 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:04.839177 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-240dead6-e700-436d-b42f-9faa7495b075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:04.841601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf90ca-f075-4f8e-8191-c12cdb4a9c63 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:04.852578 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b0e704-e057-4a7f-9d15-4765564708da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:04.853624 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0e704-e057-4a7f-9d15-4765564708da admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:04.855316 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0e704-e057-4a7f-9d15-4765564708da admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:04.855983 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0e704-e057-4a7f-9d15-4765564708da admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:04.858676 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 772/1542] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:04.859039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0e704-e057-4a7f-9d15-4765564708da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:04.859571 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0e704-e057-4a7f-9d15-4765564708da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:04.860844 dv-cinder-851249-4-smb devstack@keystone.service[86595]: WARNING py.warnings [None req-80b0e704-e057-4a7f-9d15-4765564708da admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:49:04.860844 dv-cinder-851249-4-smb devstack@keystone.service[86595]: warnings.warn(msg) Jul 27 22:49:04.860844 dv-cinder-851249-4-smb devstack@keystone.service[86595]: Jul 27 22:49:04.862136 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b0e704-e057-4a7f-9d15-4765564708da admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:04.866857 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6f28b-730e-4527-b775-c336f2fac6d3 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:04.867175 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6f28b-730e-4527-b775-c336f2fac6d3 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:04.867424 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6f28b-730e-4527-b775-c336f2fac6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:04.885602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 771/1543] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:49:04.903645 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393385b-d8e3-4e8a-87ef-034d96641a48 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:04.904303 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393385b-d8e3-4e8a-87ef-034d96641a48 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:04.904800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2393385b-d8e3-4e8a-87ef-034d96641a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:04.923608 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-75c6f28b-730e-4527-b775-c336f2fac6d3 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:04.924889 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-75c6f28b-730e-4527-b775-c336f2fac6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:04.947803 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 773/1544] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:04.948661 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6f28b-730e-4527-b775-c336f2fac6d3 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:04.958557 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-2393385b-d8e3-4e8a-87ef-034d96641a48 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:04.959856 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-2393385b-d8e3-4e8a-87ef-034d96641a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:04.966709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6f28b-730e-4527-b775-c336f2fac6d3 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:04.975878 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 772/1545] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:04.976803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393385b-d8e3-4e8a-87ef-034d96641a48 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:04.977060 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997e660-6966-4502-b946-5a48f7adbdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:04.977857 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997e660-6966-4502-b946-5a48f7adbdca admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:04.978145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997e660-6966-4502-b946-5a48f7adbdca admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:04.981310 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997e660-6966-4502-b946-5a48f7adbdca admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:04.982272 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997e660-6966-4502-b946-5a48f7adbdca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:04.983344 dv-cinder-851249-4-smb devstack@keystone.service[86594]: WARNING py.warnings [None req-b997e660-6966-4502-b946-5a48f7adbdca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:49:04.983344 dv-cinder-851249-4-smb devstack@keystone.service[86594]: warnings.warn(msg) Jul 27 22:49:04.983344 dv-cinder-851249-4-smb devstack@keystone.service[86594]: Jul 27 22:49:04.988403 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997e660-6966-4502-b946-5a48f7adbdca admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.000559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2393385b-d8e3-4e8a-87ef-034d96641a48 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.016751 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a40e4a-a255-44e4-9517-99a4d408a377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.017389 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a40e4a-a255-44e4-9517-99a4d408a377 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.017669 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a40e4a-a255-44e4-9517-99a4d408a377 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.017940 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a40e4a-a255-44e4-9517-99a4d408a377 admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.018933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a40e4a-a255-44e4-9517-99a4d408a377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:05.019246 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a40e4a-a255-44e4-9517-99a4d408a377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.020852 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a40e4a-a255-44e4-9517-99a4d408a377 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.044716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 773/1546] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:49:05.045984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6e543-433d-48c2-8801-4fef90dd03fc None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.046274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6e543-433d-48c2-8801-4fef90dd03fc None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.046575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6e543-433d-48c2-8801-4fef90dd03fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.074194 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 774/1547] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:04 2022] POST /identity/v3/projects => generated 377 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:05.075794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c7bce-3b6f-4022-8605-5a268606b0b8 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.076087 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c7bce-3b6f-4022-8605-5a268606b0b8 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.076366 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c7bce-3b6f-4022-8605-5a268606b0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.078954 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-ebc6e543-433d-48c2-8801-4fef90dd03fc None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:05.080193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ebc6e543-433d-48c2-8801-4fef90dd03fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:05.098484 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-da0c7bce-3b6f-4022-8605-5a268606b0b8 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:05.099862 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-da0c7bce-3b6f-4022-8605-5a268606b0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:05.155857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 774/1548] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:05.156701 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6e543-433d-48c2-8801-4fef90dd03fc None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:05.168261 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6e543-433d-48c2-8801-4fef90dd03fc None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.177188 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d3191-2bb7-4995-a01b-5e256ebd5fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.177820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d3191-2bb7-4995-a01b-5e256ebd5fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.178099 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d3191-2bb7-4995-a01b-5e256ebd5fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.178395 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d3191-2bb7-4995-a01b-5e256ebd5fe2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.179063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d3191-2bb7-4995-a01b-5e256ebd5fe2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.183310 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d3191-2bb7-4995-a01b-5e256ebd5fe2 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.184431 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 775/1549] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:05.185703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cf6dc-3430-456d-a3c8-7f59a4d6c9dd None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.186686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cf6dc-3430-456d-a3c8-7f59a4d6c9dd None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.186686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cf6dc-3430-456d-a3c8-7f59a4d6c9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.208005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-fc0cf6dc-3430-456d-a3c8-7f59a4d6c9dd None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:05.209252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-fc0cf6dc-3430-456d-a3c8-7f59a4d6c9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:05.218241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 775/1550] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:05 2022] POST /identity/v3/projects => generated 363 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:05.218241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3e626-69fb-4e19-a9c0-9775bb319781 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.218241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3e626-69fb-4e19-a9c0-9775bb319781 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.218241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3e626-69fb-4e19-a9c0-9775bb319781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.218932 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 776/1551] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:05.218932 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cf6dc-3430-456d-a3c8-7f59a4d6c9dd None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:05.234319 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cf6dc-3430-456d-a3c8-7f59a4d6c9dd None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.235835 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-ade3e626-69fb-4e19-a9c0-9775bb319781 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:05.237099 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ade3e626-69fb-4e19-a9c0-9775bb319781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:05.290741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2f29c-7b3d-44a3-8de2-e015e3db3b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.291369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2f29c-7b3d-44a3-8de2-e015e3db3b01 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.291651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2f29c-7b3d-44a3-8de2-e015e3db3b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.291929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2f29c-7b3d-44a3-8de2-e015e3db3b01 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.292588 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2f29c-7b3d-44a3-8de2-e015e3db3b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.294533 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb2f29c-7b3d-44a3-8de2-e015e3db3b01 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.297558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 776/1552] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:05.298834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a50e48-2449-4f92-9d4e-50730809d94b None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.299238 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a50e48-2449-4f92-9d4e-50730809d94b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.299521 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a50e48-2449-4f92-9d4e-50730809d94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.320846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 777/1553] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:05 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:05.320846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2f29c-7b3d-44a3-8de2-e015e3db3b01 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:05.325235 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-c7a50e48-2449-4f92-9d4e-50730809d94b None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:05.326439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c7a50e48-2449-4f92-9d4e-50730809d94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:05.327994 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2f29c-7b3d-44a3-8de2-e015e3db3b01 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.332837 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c6f81-14ca-4a5a-985d-a7dbb45ac4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.333428 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6f81-14ca-4a5a-985d-a7dbb45ac4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.333712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6f81-14ca-4a5a-985d-a7dbb45ac4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.333990 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c6f81-14ca-4a5a-985d-a7dbb45ac4b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.334511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 777/1554] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:05.334711 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c6f81-14ca-4a5a-985d-a7dbb45ac4b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:05.335029 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c6f81-14ca-4a5a-985d-a7dbb45ac4b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.335677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb326729-01b7-44dd-8ac4-5cadb31e37b6 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.335955 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb326729-01b7-44dd-8ac4-5cadb31e37b6 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.336231 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb326729-01b7-44dd-8ac4-5cadb31e37b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.336611 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c6f81-14ca-4a5a-985d-a7dbb45ac4b4 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.349892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 778/1555] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:49:05.351237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88596609-9444-47a4-89a3-d518953cb207 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.351549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88596609-9444-47a4-89a3-d518953cb207 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.351810 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88596609-9444-47a4-89a3-d518953cb207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.364365 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-fb326729-01b7-44dd-8ac4-5cadb31e37b6 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:05.365671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-fb326729-01b7-44dd-8ac4-5cadb31e37b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:05.371440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-88596609-9444-47a4-89a3-d518953cb207 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:05.372610 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-88596609-9444-47a4-89a3-d518953cb207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:05.374104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 778/1556] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:05.374912 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb326729-01b7-44dd-8ac4-5cadb31e37b6 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:05.384293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 779/1557] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:05.385636 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac77a2a-3e56-4dc2-a9b1-80b1a10b1998 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.386163 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac77a2a-3e56-4dc2-a9b1-80b1a10b1998 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.386609 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac77a2a-3e56-4dc2-a9b1-80b1a10b1998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.386905 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb326729-01b7-44dd-8ac4-5cadb31e37b6 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.392523 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37139ba-0f75-49a6-a18f-0724420eb74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.393197 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37139ba-0f75-49a6-a18f-0724420eb74c admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.393468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37139ba-0f75-49a6-a18f-0724420eb74c admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.393725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37139ba-0f75-49a6-a18f-0724420eb74c admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.394684 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37139ba-0f75-49a6-a18f-0724420eb74c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.396706 dv-cinder-851249-4-smb devstack@keystone.service[86595]: WARNING py.warnings [None req-c37139ba-0f75-49a6-a18f-0724420eb74c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:49:05.396706 dv-cinder-851249-4-smb devstack@keystone.service[86595]: warnings.warn(msg) Jul 27 22:49:05.396706 dv-cinder-851249-4-smb devstack@keystone.service[86595]: Jul 27 22:49:05.398128 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37139ba-0f75-49a6-a18f-0724420eb74c admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.407773 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-2ac77a2a-3e56-4dc2-a9b1-80b1a10b1998 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:05.408935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-2ac77a2a-3e56-4dc2-a9b1-80b1a10b1998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:05.418400 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 780/1558] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:05.422218 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b3bc7-fc9d-4449-8b70-85119cf05223 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.422218 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b3bc7-fc9d-4449-8b70-85119cf05223 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.422218 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b3bc7-fc9d-4449-8b70-85119cf05223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.422513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 779/1559] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:05 2022] POST /identity/v3/users => generated 282 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:05.422513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37139ba-0f75-49a6-a18f-0724420eb74c admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:05.434664 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:05.438458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37139ba-0f75-49a6-a18f-0724420eb74c admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.440719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-0c7b3bc7-fc9d-4449-8b70-85119cf05223 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:05.442529 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-0c7b3bc7-fc9d-4449-8b70-85119cf05223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:05.444290 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799574f-433f-444d-8af3-9a1e7adb1fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.444927 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799574f-433f-444d-8af3-9a1e7adb1fac admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.445184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799574f-433f-444d-8af3-9a1e7adb1fac admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.445945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799574f-433f-444d-8af3-9a1e7adb1fac admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.447175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799574f-433f-444d-8af3-9a1e7adb1fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.452137 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c799574f-433f-444d-8af3-9a1e7adb1fac admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.454982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:05.455227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 781/1560] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:05.459483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7333758-f132-4c66-aef8-8026c27d7c03 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.459483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7333758-f132-4c66-aef8-8026c27d7c03 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.459483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7333758-f132-4c66-aef8-8026c27d7c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.473268 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 780/1561] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:05.473268 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799574f-433f-444d-8af3-9a1e7adb1fac admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:05.484322 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c799574f-433f-444d-8af3-9a1e7adb1fac admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.488948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c098c-92eb-4cc8-a347-1dffdb49d175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.489279 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-d7333758-f132-4c66-aef8-8026c27d7c03 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:05.489558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c098c-92eb-4cc8-a347-1dffdb49d175 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.489838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c098c-92eb-4cc8-a347-1dffdb49d175 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.490110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c098c-92eb-4cc8-a347-1dffdb49d175 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.490522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d7333758-f132-4c66-aef8-8026c27d7c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:05.490829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c098c-92eb-4cc8-a347-1dffdb49d175 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.492715 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c098c-92eb-4cc8-a347-1dffdb49d175 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.499184 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 782/1562] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:05.500380 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd62003-19b6-41b3-9173-f920ebe92f47 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.500665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd62003-19b6-41b3-9173-f920ebe92f47 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.500943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd62003-19b6-41b3-9173-f920ebe92f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.520092 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-dcd62003-19b6-41b3-9173-f920ebe92f47 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:05.521315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-dcd62003-19b6-41b3-9173-f920ebe92f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:05.523682 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 781/1563] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:05 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:05.524360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c098c-92eb-4cc8-a347-1dffdb49d175 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:05.585586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 783/1564] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:05.586251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd62003-19b6-41b3-9173-f920ebe92f47 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:05.592407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c098c-92eb-4cc8-a347-1dffdb49d175 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.595534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd62003-19b6-41b3-9173-f920ebe92f47 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.597000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e673d6-ccdd-4ba2-851d-51ff3c3ce35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.597625 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e673d6-ccdd-4ba2-851d-51ff3c3ce35f admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.597911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e673d6-ccdd-4ba2-851d-51ff3c3ce35f admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.598182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e673d6-ccdd-4ba2-851d-51ff3c3ce35f admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.598907 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e673d6-ccdd-4ba2-851d-51ff3c3ce35f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:05.599214 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e673d6-ccdd-4ba2-851d-51ff3c3ce35f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.600801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e673d6-ccdd-4ba2-851d-51ff3c3ce35f admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.604034 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda1a95-64d9-4f8e-a31a-cf170be70083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.604281 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda1a95-64d9-4f8e-a31a-cf170be70083 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.604569 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda1a95-64d9-4f8e-a31a-cf170be70083 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.604848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda1a95-64d9-4f8e-a31a-cf170be70083 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.605549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda1a95-64d9-4f8e-a31a-cf170be70083 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:05.605891 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda1a95-64d9-4f8e-a31a-cf170be70083 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.607519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda1a95-64d9-4f8e-a31a-cf170be70083 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.612888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 782/1565] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:49:05.613771 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e673d6-ccdd-4ba2-851d-51ff3c3ce35f admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:05.623563 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 784/1566] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:49:05.624050 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda1a95-64d9-4f8e-a31a-cf170be70083 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:05.624356 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e673d6-ccdd-4ba2-851d-51ff3c3ce35f admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.628937 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397a184-5e88-461d-b07c-0772e26e34d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.629551 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397a184-5e88-461d-b07c-0772e26e34d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.629916 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397a184-5e88-461d-b07c-0772e26e34d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.630202 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5397a184-5e88-461d-b07c-0772e26e34d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.630939 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397a184-5e88-461d-b07c-0772e26e34d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.632529 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5397a184-5e88-461d-b07c-0772e26e34d7 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.635161 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda1a95-64d9-4f8e-a31a-cf170be70083 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.640174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516273d-0c3d-44d0-aa8a-d36ea352fdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.640769 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516273d-0c3d-44d0-aa8a-d36ea352fdec admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.641051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516273d-0c3d-44d0-aa8a-d36ea352fdec admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.641325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b516273d-0c3d-44d0-aa8a-d36ea352fdec admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.642034 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516273d-0c3d-44d0-aa8a-d36ea352fdec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:05.642349 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516273d-0c3d-44d0-aa8a-d36ea352fdec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.646098 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 783/1567] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:05.646266 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b516273d-0c3d-44d0-aa8a-d36ea352fdec admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.646399 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397a184-5e88-461d-b07c-0772e26e34d7 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:05.654430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5397a184-5e88-461d-b07c-0772e26e34d7 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.658161 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 785/1568] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:49:05.659002 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516273d-0c3d-44d0-aa8a-d36ea352fdec admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:05.659199 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f298e-9082-4867-bfef-6a4367976762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.659823 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f298e-9082-4867-bfef-6a4367976762 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.660078 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f298e-9082-4867-bfef-6a4367976762 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.660355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f298e-9082-4867-bfef-6a4367976762 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.661041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f298e-9082-4867-bfef-6a4367976762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.662639 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f298e-9082-4867-bfef-6a4367976762 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.670148 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b516273d-0c3d-44d0-aa8a-d36ea352fdec admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.673670 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 784/1569] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:05.674309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f298e-9082-4867-bfef-6a4367976762 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:05.675362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d825e4-ce19-4c95-a2b5-d5f9249e044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.676076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d825e4-ce19-4c95-a2b5-d5f9249e044f admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.676632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d825e4-ce19-4c95-a2b5-d5f9249e044f admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.676759 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d825e4-ce19-4c95-a2b5-d5f9249e044f admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.677533 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d825e4-ce19-4c95-a2b5-d5f9249e044f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:05.677844 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d825e4-ce19-4c95-a2b5-d5f9249e044f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.679498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d825e4-ce19-4c95-a2b5-d5f9249e044f admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.683471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f298e-9082-4867-bfef-6a4367976762 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.688099 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22223839-e11d-4489-a4ee-003c5d2f986b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.688679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22223839-e11d-4489-a4ee-003c5d2f986b admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.688960 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22223839-e11d-4489-a4ee-003c5d2f986b admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.689237 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22223839-e11d-4489-a4ee-003c5d2f986b admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.689887 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22223839-e11d-4489-a4ee-003c5d2f986b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.698319 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 786/1570] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:49:05.698538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22223839-e11d-4489-a4ee-003c5d2f986b admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.698656 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d825e4-ce19-4c95-a2b5-d5f9249e044f admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:05.701555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d825e4-ce19-4c95-a2b5-d5f9249e044f admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.706914 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcda10-4714-45f7-975f-72ce8dd6523c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.707800 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcda10-4714-45f7-975f-72ce8dd6523c admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.707915 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcda10-4714-45f7-975f-72ce8dd6523c admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.708232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcda10-4714-45f7-975f-72ce8dd6523c admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.708928 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcda10-4714-45f7-975f-72ce8dd6523c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:05.709242 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcda10-4714-45f7-975f-72ce8dd6523c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.710862 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fcda10-4714-45f7-975f-72ce8dd6523c admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.714163 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 785/1571] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:05 2022] POST /identity/v3/users => generated 292 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:05.717974 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22223839-e11d-4489-a4ee-003c5d2f986b admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:05.724162 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 787/1572] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:49:05.724942 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcda10-4714-45f7-975f-72ce8dd6523c admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:05.728379 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22223839-e11d-4489-a4ee-003c5d2f986b admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.734517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f34ddb-823d-4f45-ba93-d7519bccbb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.735136 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f34ddb-823d-4f45-ba93-d7519bccbb46 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.735425 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f34ddb-823d-4f45-ba93-d7519bccbb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.735702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f34ddb-823d-4f45-ba93-d7519bccbb46 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.735901 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcda10-4714-45f7-975f-72ce8dd6523c admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.736368 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f34ddb-823d-4f45-ba93-d7519bccbb46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.738273 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f34ddb-823d-4f45-ba93-d7519bccbb46 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.740399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d7af8-66cb-43d9-a874-c9465cdbf8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.740995 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d7af8-66cb-43d9-a874-c9465cdbf8d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.741278 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d7af8-66cb-43d9-a874-c9465cdbf8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.741552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088d7af8-66cb-43d9-a874-c9465cdbf8d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.742200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d7af8-66cb-43d9-a874-c9465cdbf8d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.744583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088d7af8-66cb-43d9-a874-c9465cdbf8d5 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.773897 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 786/1573] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:05 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:05.775299 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f34ddb-823d-4f45-ba93-d7519bccbb46 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:05.794231 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 788/1574] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:05 2022] POST /identity/v3/projects => generated 401 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:05.795039 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d7af8-66cb-43d9-a874-c9465cdbf8d5 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:05.843304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f34ddb-823d-4f45-ba93-d7519bccbb46 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.855665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:05.856391 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088d7af8-66cb-43d9-a874-c9465cdbf8d5 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.861346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbebb5-fd58-4ed4-bf71-c0ef37dc2ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.862066 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbebb5-fd58-4ed4-bf71-c0ef37dc2ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.862361 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbebb5-fd58-4ed4-bf71-c0ef37dc2ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.862705 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbebb5-fd58-4ed4-bf71-c0ef37dc2ee3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.863432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbebb5-fd58-4ed4-bf71-c0ef37dc2ee3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.865338 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbebb5-fd58-4ed4-bf71-c0ef37dc2ee3 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.893688 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 789/1575] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:05 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:05.894603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbebb5-fd58-4ed4-bf71-c0ef37dc2ee3 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:05.903738 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:05.905767 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08770544-f80d-4b39-9e14-4d0ed5b0bdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.906458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08770544-f80d-4b39-9e14-4d0ed5b0bdeb admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.906842 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08770544-f80d-4b39-9e14-4d0ed5b0bdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.907057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08770544-f80d-4b39-9e14-4d0ed5b0bdeb admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.907819 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08770544-f80d-4b39-9e14-4d0ed5b0bdeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.909634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08770544-f80d-4b39-9e14-4d0ed5b0bdeb admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.920372 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 787/1576] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:05.921254 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08770544-f80d-4b39-9e14-4d0ed5b0bdeb admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:05.931073 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08770544-f80d-4b39-9e14-4d0ed5b0bdeb admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.964825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbebb5-fd58-4ed4-bf71-c0ef37dc2ee3 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:05.969488 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd8158-59ad-4eab-8ac3-5b46050be61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.970173 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd8158-59ad-4eab-8ac3-5b46050be61e admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.970491 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd8158-59ad-4eab-8ac3-5b46050be61e admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.970778 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd8158-59ad-4eab-8ac3-5b46050be61e admin admin] PATH_INFO: `/v3/projects/7af9ae6076964b5c8c776085bb1742d5/users/0de16e13f2f948698e9174fcf1e0a3a8/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.985537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd8158-59ad-4eab-8ac3-5b46050be61e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7af9ae6076964b5c8c776085bb1742d5, user_id=0de16e13f2f948698e9174fcf1e0a3a8, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.986593 dv-cinder-851249-4-smb devstack@keystone.service[86594]: WARNING py.warnings [None req-b1dd8158-59ad-4eab-8ac3-5b46050be61e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:49:05.986593 dv-cinder-851249-4-smb devstack@keystone.service[86594]: warnings.warn(msg) Jul 27 22:49:05.986593 dv-cinder-851249-4-smb devstack@keystone.service[86594]: Jul 27 22:49:05.988525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd8158-59ad-4eab-8ac3-5b46050be61e admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:05.988668 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14d2dd-80d0-461f-b5b3-e669762257ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:05.989291 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14d2dd-80d0-461f-b5b3-e669762257ac admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:05.989578 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14d2dd-80d0-461f-b5b3-e669762257ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:05.989857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14d2dd-80d0-461f-b5b3-e669762257ac admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:05.990555 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14d2dd-80d0-461f-b5b3-e669762257ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:05.992688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14d2dd-80d0-461f-b5b3-e669762257ac admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.001698 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 790/1577] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:05 2022] PUT /identity/v3/projects/7af9ae6076964b5c8c776085bb1742d5/users/0de16e13f2f948698e9174fcf1e0a3a8/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:06.002531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd8158-59ad-4eab-8ac3-5b46050be61e admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.020287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 788/1578] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:05 2022] POST /identity/v3/projects => generated 393 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:06.021065 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14d2dd-80d0-461f-b5b3-e669762257ac admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.066641 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd8158-59ad-4eab-8ac3-5b46050be61e admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.082923 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14d2dd-80d0-461f-b5b3-e669762257ac admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.088130 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4b1c5-aea2-462f-a1b6-f11619cf0c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.088761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4b1c5-aea2-462f-a1b6-f11619cf0c12 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.089042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4b1c5-aea2-462f-a1b6-f11619cf0c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.089318 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4b1c5-aea2-462f-a1b6-f11619cf0c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.089980 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4b1c5-aea2-462f-a1b6-f11619cf0c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.091923 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4b1c5-aea2-462f-a1b6-f11619cf0c12 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.117815 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 789/1579] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:06 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:06.119319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4b1c5-aea2-462f-a1b6-f11619cf0c12 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.132391 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ead2c-0236-4b6d-97a4-707121b86459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.133472 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ead2c-0236-4b6d-97a4-707121b86459 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.136164 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ead2c-0236-4b6d-97a4-707121b86459 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.136164 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1ead2c-0236-4b6d-97a4-707121b86459 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.136164 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ead2c-0236-4b6d-97a4-707121b86459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.137367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1ead2c-0236-4b6d-97a4-707121b86459 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.148361 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 791/1580] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:06.149082 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ead2c-0236-4b6d-97a4-707121b86459 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.151517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:06.160316 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1ead2c-0236-4b6d-97a4-707121b86459 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.189883 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:06.191206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4b1c5-aea2-462f-a1b6-f11619cf0c12 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.196189 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aba167-237a-4cc2-8eca-f355d8c612a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.197357 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aba167-237a-4cc2-8eca-f355d8c612a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.197670 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aba167-237a-4cc2-8eca-f355d8c612a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.197950 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aba167-237a-4cc2-8eca-f355d8c612a3 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.198651 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aba167-237a-4cc2-8eca-f355d8c612a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.200634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aba167-237a-4cc2-8eca-f355d8c612a3 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.220250 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3531f-f820-4157-b042-18a9d07f8440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.220867 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3531f-f820-4157-b042-18a9d07f8440 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.221147 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3531f-f820-4157-b042-18a9d07f8440 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.221422 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a3531f-f820-4157-b042-18a9d07f8440 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.222001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 790/1581] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:06 2022] POST /identity/v3/users => generated 289 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:06.225324 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3531f-f820-4157-b042-18a9d07f8440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.225439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aba167-237a-4cc2-8eca-f355d8c612a3 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.225532 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a3531f-f820-4157-b042-18a9d07f8440 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.234108 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aba167-237a-4cc2-8eca-f355d8c612a3 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.239842 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24792782-84c5-4f64-b636-59110440875a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.240574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24792782-84c5-4f64-b636-59110440875a admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.240845 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24792782-84c5-4f64-b636-59110440875a admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.241125 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24792782-84c5-4f64-b636-59110440875a admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.241781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24792782-84c5-4f64-b636-59110440875a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.243725 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24792782-84c5-4f64-b636-59110440875a admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.244793 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 792/1582] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:06 2022] POST /identity/v3/users => generated 301 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:06.245572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3531f-f820-4157-b042-18a9d07f8440 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.255080 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a3531f-f820-4157-b042-18a9d07f8440 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.260344 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389abe17-6422-4026-9842-05a6140d1517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.260997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389abe17-6422-4026-9842-05a6140d1517 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.261276 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389abe17-6422-4026-9842-05a6140d1517 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.261549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389abe17-6422-4026-9842-05a6140d1517 admin admin] PATH_INFO: `/v3/projects/ad4e9b7c11dd4e14845ed1d835de4550/users/0a7633d71c5c4094bc8bf021f495b8af/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.268801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 791/1583] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:06 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:06.268801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6b31f-9056-4051-a218-bfb3d5e949dd None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.268801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6b31f-9056-4051-a218-bfb3d5e949dd None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.268801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d6b31f-9056-4051-a218-bfb3d5e949dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.276788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389abe17-6422-4026-9842-05a6140d1517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4e9b7c11dd4e14845ed1d835de4550, user_id=0a7633d71c5c4094bc8bf021f495b8af, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.279613 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389abe17-6422-4026-9842-05a6140d1517 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.287173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-93d6b31f-9056-4051-a218-bfb3d5e949dd None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:06.288362 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-93d6b31f-9056-4051-a218-bfb3d5e949dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:06.292372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 793/1584] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:06 2022] PUT /identity/v3/projects/ad4e9b7c11dd4e14845ed1d835de4550/users/0a7633d71c5c4094bc8bf021f495b8af/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:06.293204 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389abe17-6422-4026-9842-05a6140d1517 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.351745 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 792/1585] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:06.352566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6b31f-9056-4051-a218-bfb3d5e949dd None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.354258 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389abe17-6422-4026-9842-05a6140d1517 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.359757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c7f3f-ed1b-4ccf-bf90-4c93f33e3ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.360372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c7f3f-ed1b-4ccf-bf90-4c93f33e3ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.360779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c7f3f-ed1b-4ccf-bf90-4c93f33e3ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.361070 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783c7f3f-ed1b-4ccf-bf90-4c93f33e3ba0 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.361644 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d6b31f-9056-4051-a218-bfb3d5e949dd None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.362703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c7f3f-ed1b-4ccf-bf90-4c93f33e3ba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.364630 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783c7f3f-ed1b-4ccf-bf90-4c93f33e3ba0 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.366176 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939679d-4ede-4fb8-bdd4-624ed65120bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.366811 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939679d-4ede-4fb8-bdd4-624ed65120bc admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.367093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939679d-4ede-4fb8-bdd4-624ed65120bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.367369 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7939679d-4ede-4fb8-bdd4-624ed65120bc admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.368022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939679d-4ede-4fb8-bdd4-624ed65120bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.370002 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7939679d-4ede-4fb8-bdd4-624ed65120bc admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.389503 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 794/1586] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:06 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:06.389503 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c7f3f-ed1b-4ccf-bf90-4c93f33e3ba0 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.394181 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 793/1587] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:06 2022] POST /identity/v3/users => generated 294 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:06.394992 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939679d-4ede-4fb8-bdd4-624ed65120bc admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.397290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783c7f3f-ed1b-4ccf-bf90-4c93f33e3ba0 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.402561 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9543fdf-bcd3-4678-a227-1ef162b760cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.403165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9543fdf-bcd3-4678-a227-1ef162b760cc admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.403449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9543fdf-bcd3-4678-a227-1ef162b760cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.403724 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9543fdf-bcd3-4678-a227-1ef162b760cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.404410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9543fdf-bcd3-4678-a227-1ef162b760cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.405116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7939679d-4ede-4fb8-bdd4-624ed65120bc admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.406005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9543fdf-bcd3-4678-a227-1ef162b760cc admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.409780 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec5850-725f-4f30-a6e5-0de3e1e3a770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.410457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec5850-725f-4f30-a6e5-0de3e1e3a770 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.410702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec5850-725f-4f30-a6e5-0de3e1e3a770 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.410977 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec5850-725f-4f30-a6e5-0de3e1e3a770 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.411733 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec5850-725f-4f30-a6e5-0de3e1e3a770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.413296 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec5850-725f-4f30-a6e5-0de3e1e3a770 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.416732 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 795/1588] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:06.421108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9543fdf-bcd3-4678-a227-1ef162b760cc admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.423590 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 794/1589] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:06.425005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec5850-725f-4f30-a6e5-0de3e1e3a770 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.437190 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec5850-725f-4f30-a6e5-0de3e1e3a770 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.438945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9543fdf-bcd3-4678-a227-1ef162b760cc admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.441840 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3da500-76ef-489b-8d46-979380caa470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.442484 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3da500-76ef-489b-8d46-979380caa470 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.442774 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3da500-76ef-489b-8d46-979380caa470 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.443055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3da500-76ef-489b-8d46-979380caa470 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.443754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3da500-76ef-489b-8d46-979380caa470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.445539 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3da500-76ef-489b-8d46-979380caa470 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.448232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbd5611-1ffa-45fa-b127-4dedbe8ad16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.449098 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd5611-1ffa-45fa-b127-4dedbe8ad16f admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.449437 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd5611-1ffa-45fa-b127-4dedbe8ad16f admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.449719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbd5611-1ffa-45fa-b127-4dedbe8ad16f admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.450439 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd5611-1ffa-45fa-b127-4dedbe8ad16f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.452073 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbd5611-1ffa-45fa-b127-4dedbe8ad16f admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.464504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 796/1590] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:06.468366 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de490e-4f55-4ca8-8628-f1b5a69b95ec None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.468514 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 795/1591] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:06.468628 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de490e-4f55-4ca8-8628-f1b5a69b95ec None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.468628 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de490e-4f55-4ca8-8628-f1b5a69b95ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.468810 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3da500-76ef-489b-8d46-979380caa470 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.493157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-e2de490e-4f55-4ca8-8628-f1b5a69b95ec None None] MFA Rules not processed for user `0a7633d71c5c4094bc8bf021f495b8af`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:06.494983 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e2de490e-4f55-4ca8-8628-f1b5a69b95ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:06.523801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3da500-76ef-489b-8d46-979380caa470 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.527619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60593d8-51a8-494d-b6fb-f742df394dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.528348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60593d8-51a8-494d-b6fb-f742df394dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.528711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60593d8-51a8-494d-b6fb-f742df394dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.529064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60593d8-51a8-494d-b6fb-f742df394dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.537947 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60593d8-51a8-494d-b6fb-f742df394dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.539423 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60593d8-51a8-494d-b6fb-f742df394dc9 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.543330 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:06.549835 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:06.550521 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 796/1592] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:06.551422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60593d8-51a8-494d-b6fb-f742df394dc9 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.562681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60593d8-51a8-494d-b6fb-f742df394dc9 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.568134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785127aa-4276-48b3-8cbe-5648525e24cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.568806 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785127aa-4276-48b3-8cbe-5648525e24cc admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.569044 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785127aa-4276-48b3-8cbe-5648525e24cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.569310 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785127aa-4276-48b3-8cbe-5648525e24cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.570004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785127aa-4276-48b3-8cbe-5648525e24cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.572372 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785127aa-4276-48b3-8cbe-5648525e24cc admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.577430 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 797/1593] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:06 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:06.577430 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de490e-4f55-4ca8-8628-f1b5a69b95ec None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.589728 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 797/1594] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:06.589728 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785127aa-4276-48b3-8cbe-5648525e24cc admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.589980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2de490e-4f55-4ca8-8628-f1b5a69b95ec None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.593586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c038f5-d4cc-4782-ab94-53ef974b08f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.594213 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c038f5-d4cc-4782-ab94-53ef974b08f1 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.594560 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c038f5-d4cc-4782-ab94-53ef974b08f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.594844 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c038f5-d4cc-4782-ab94-53ef974b08f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.595789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c038f5-d4cc-4782-ab94-53ef974b08f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.601068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c038f5-d4cc-4782-ab94-53ef974b08f1 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.601211 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785127aa-4276-48b3-8cbe-5648525e24cc admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.607335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7c021-24ea-400f-b6aa-1e4e4691be74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.607696 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7c021-24ea-400f-b6aa-1e4e4691be74 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.607981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7c021-24ea-400f-b6aa-1e4e4691be74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.608259 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7c021-24ea-400f-b6aa-1e4e4691be74 admin admin] PATH_INFO: `/v3/projects/f8a7695b607f42ba9414a93011477162/users/eb48e3cd747c4fb38bbd4781d3297574/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.618052 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 798/1595] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:06.619973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c038f5-d4cc-4782-ab94-53ef974b08f1 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.625494 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7c021-24ea-400f-b6aa-1e4e4691be74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a7695b607f42ba9414a93011477162, user_id=eb48e3cd747c4fb38bbd4781d3297574, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.629434 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7c021-24ea-400f-b6aa-1e4e4691be74 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.631142 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c038f5-d4cc-4782-ab94-53ef974b08f1 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.636824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94d77c-c2aa-4a6f-8b12-693eeb830ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.637483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94d77c-c2aa-4a6f-8b12-693eeb830ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.637768 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94d77c-c2aa-4a6f-8b12-693eeb830ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.638041 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94d77c-c2aa-4a6f-8b12-693eeb830ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.638844 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94d77c-c2aa-4a6f-8b12-693eeb830ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.640436 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94d77c-c2aa-4a6f-8b12-693eeb830ea3 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.647307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 798/1596] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:06 2022] PUT /identity/v3/projects/f8a7695b607f42ba9414a93011477162/users/eb48e3cd747c4fb38bbd4781d3297574/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:06.648524 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7c021-24ea-400f-b6aa-1e4e4691be74 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.660456 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 799/1597] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:06.661671 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94d77c-c2aa-4a6f-8b12-693eeb830ea3 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.672302 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94d77c-c2aa-4a6f-8b12-693eeb830ea3 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.723593 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7c021-24ea-400f-b6aa-1e4e4691be74 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.728681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613c8d8-5c90-4d90-8476-ad0c082ee363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.729395 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613c8d8-5c90-4d90-8476-ad0c082ee363 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.729754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613c8d8-5c90-4d90-8476-ad0c082ee363 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.730028 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613c8d8-5c90-4d90-8476-ad0c082ee363 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.730873 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613c8d8-5c90-4d90-8476-ad0c082ee363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.731655 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc81b4d-1486-4815-bb1c-3595e1dd77e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.732355 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc81b4d-1486-4815-bb1c-3595e1dd77e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.732621 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0613c8d8-5c90-4d90-8476-ad0c082ee363 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.732750 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc81b4d-1486-4815-bb1c-3595e1dd77e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.733069 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc81b4d-1486-4815-bb1c-3595e1dd77e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.733830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc81b4d-1486-4815-bb1c-3595e1dd77e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.735679 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc81b4d-1486-4815-bb1c-3595e1dd77e4 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.745783 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 799/1598] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:06.749953 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613c8d8-5c90-4d90-8476-ad0c082ee363 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.750268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 800/1599] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:06.751263 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc81b4d-1486-4815-bb1c-3595e1dd77e4 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.762100 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc81b4d-1486-4815-bb1c-3595e1dd77e4 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.766891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613c8d8-5c90-4d90-8476-ad0c082ee363 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.768715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb243db1-ff83-4a25-a8a2-613ae526ce4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.769399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb243db1-ff83-4a25-a8a2-613ae526ce4c admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.769690 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb243db1-ff83-4a25-a8a2-613ae526ce4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.769963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb243db1-ff83-4a25-a8a2-613ae526ce4c admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.770856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb243db1-ff83-4a25-a8a2-613ae526ce4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.773326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb243db1-ff83-4a25-a8a2-613ae526ce4c admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.775162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61abb1f-3d70-483f-a3e8-ce45230e251a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.775841 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61abb1f-3d70-483f-a3e8-ce45230e251a admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.776182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61abb1f-3d70-483f-a3e8-ce45230e251a admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.776467 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61abb1f-3d70-483f-a3e8-ce45230e251a admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.777154 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61abb1f-3d70-483f-a3e8-ce45230e251a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.780420 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61abb1f-3d70-483f-a3e8-ce45230e251a admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.787327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 801/1600] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:06.788422 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb243db1-ff83-4a25-a8a2-613ae526ce4c admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.799293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb243db1-ff83-4a25-a8a2-613ae526ce4c admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.805315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891693d-bacd-4b07-8f8c-ee6da23ec083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.806683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891693d-bacd-4b07-8f8c-ee6da23ec083 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.807007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891693d-bacd-4b07-8f8c-ee6da23ec083 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.807229 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891693d-bacd-4b07-8f8c-ee6da23ec083 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.807942 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891693d-bacd-4b07-8f8c-ee6da23ec083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.809808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891693d-bacd-4b07-8f8c-ee6da23ec083 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.820224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 800/1601] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:06 2022] POST /identity/v3/projects => generated 365 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:06.821831 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b8854-e3ff-4931-879d-f6bc3f3b076b None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.822186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b8854-e3ff-4931-879d-f6bc3f3b076b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.822590 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b8854-e3ff-4931-879d-f6bc3f3b076b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.830426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 802/1602] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:06.834777 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891693d-bacd-4b07-8f8c-ee6da23ec083 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.845992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891693d-bacd-4b07-8f8c-ee6da23ec083 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.855108 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-7f9b8854-e3ff-4931-879d-f6bc3f3b076b None None] MFA Rules not processed for user `eb48e3cd747c4fb38bbd4781d3297574`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:06.856647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-7f9b8854-e3ff-4931-879d-f6bc3f3b076b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:06.912800 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaf3d3-fe50-40d3-95c5-332da7d58c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:06.913495 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaf3d3-fe50-40d3-95c5-332da7d58c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:06.913855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaf3d3-fe50-40d3-95c5-332da7d58c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:06.914203 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaf3d3-fe50-40d3-95c5-332da7d58c90 admin admin] PATH_INFO: `/v3/projects/b39bf78701364a34b2110730bdfee792/users/16e9ba7fa4c74a5ea1204daa44e03f28/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:06.927727 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 801/1603] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:06.928645 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b8854-e3ff-4931-879d-f6bc3f3b076b None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.930481 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baaf3d3-fe50-40d3-95c5-332da7d58c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b39bf78701364a34b2110730bdfee792, user_id=16e9ba7fa4c74a5ea1204daa44e03f28, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:06.934032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baaf3d3-fe50-40d3-95c5-332da7d58c90 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:06.942921 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b8854-e3ff-4931-879d-f6bc3f3b076b None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:06.953298 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 803/1604] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:06 2022] PUT /identity/v3/projects/b39bf78701364a34b2110730bdfee792/users/16e9ba7fa4c74a5ea1204daa44e03f28/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:06.953298 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaf3d3-fe50-40d3-95c5-332da7d58c90 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:06.989584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:06.992961 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:07.027706 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b5b8e-d8a7-44f2-a1ec-665a6cb3933f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:07.028534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b5b8e-d8a7-44f2-a1ec-665a6cb3933f admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.028819 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b5b8e-d8a7-44f2-a1ec-665a6cb3933f admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.029095 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b5b8e-d8a7-44f2-a1ec-665a6cb3933f admin admin] PATH_INFO: `/v3/projects/c0bb2e1488c640ee916b734644191080/users/78baf5bebf864c6daa8944297effd304/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.030530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaf3d3-fe50-40d3-95c5-332da7d58c90 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:07.035384 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83cd79-02f2-4849-bed4-a9e124278df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:07.036078 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83cd79-02f2-4849-bed4-a9e124278df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.036362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83cd79-02f2-4849-bed4-a9e124278df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.036633 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e83cd79-02f2-4849-bed4-a9e124278df4 admin admin] PATH_INFO: `/v3/projects/4abc8c6e49dd43548bfbf501b3ea5cad/users/65ccc72f409c475bba8fd3822d3451f8/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.046611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b5b8e-d8a7-44f2-a1ec-665a6cb3933f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0bb2e1488c640ee916b734644191080, user_id=78baf5bebf864c6daa8944297effd304, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:07.049448 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b5b8e-d8a7-44f2-a1ec-665a6cb3933f admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:07.059590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83cd79-02f2-4849-bed4-a9e124278df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4abc8c6e49dd43548bfbf501b3ea5cad, user_id=65ccc72f409c475bba8fd3822d3451f8, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:07.063892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e83cd79-02f2-4849-bed4-a9e124278df4 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:07.067728 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 802/1605] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:06 2022] PUT /identity/v3/projects/c0bb2e1488c640ee916b734644191080/users/78baf5bebf864c6daa8944297effd304/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:07.068680 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b5b8e-d8a7-44f2-a1ec-665a6cb3933f admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:07.083338 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 804/1606] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:06 2022] PUT /identity/v3/projects/4abc8c6e49dd43548bfbf501b3ea5cad/users/65ccc72f409c475bba8fd3822d3451f8/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:07.084166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83cd79-02f2-4849-bed4-a9e124278df4 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:07.151924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b5b8e-d8a7-44f2-a1ec-665a6cb3933f admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:07.166515 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e83cd79-02f2-4849-bed4-a9e124278df4 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:07.172048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d26ab-a352-417a-bda4-32d61fb04ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:07.172874 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d26ab-a352-417a-bda4-32d61fb04ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.173131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d26ab-a352-417a-bda4-32d61fb04ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.173694 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d26ab-a352-417a-bda4-32d61fb04ea1 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.174416 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d26ab-a352-417a-bda4-32d61fb04ea1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:07.176646 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d26ab-a352-417a-bda4-32d61fb04ea1 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:07.199895 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 805/1607] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:07 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:07.200980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d26ab-a352-417a-bda4-32d61fb04ea1 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:07.220132 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d26ab-a352-417a-bda4-32d61fb04ea1 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:07.225551 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2055c60-5407-41f1-b9eb-d85c2531f43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:07.226313 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2055c60-5407-41f1-b9eb-d85c2531f43e admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.226726 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2055c60-5407-41f1-b9eb-d85c2531f43e admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.226957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a23eb-385d-46d4-beb1-8e49f8743aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:07.227157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2055c60-5407-41f1-b9eb-d85c2531f43e admin admin] PATH_INFO: `/v3/projects/fafb887ff5214294811fe568697481ae/users/7276ed630a694d0f844aa402169b938d/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.228392 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a23eb-385d-46d4-beb1-8e49f8743aec admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.228756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a23eb-385d-46d4-beb1-8e49f8743aec admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.229306 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a23eb-385d-46d4-beb1-8e49f8743aec admin admin] PATH_INFO: `/v3/projects/16b144b0bec84b07b68856c10d59e72b/users/7e7b9e21971c432b9f23ceee4c5b7a3d/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.248038 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2055c60-5407-41f1-b9eb-d85c2531f43e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fafb887ff5214294811fe568697481ae, user_id=7276ed630a694d0f844aa402169b938d, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:07.250824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2055c60-5407-41f1-b9eb-d85c2531f43e admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:07.250965 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a23eb-385d-46d4-beb1-8e49f8743aec admin admin] RBAC: Authorizing `identity:create_grant(project_id=16b144b0bec84b07b68856c10d59e72b, user_id=7e7b9e21971c432b9f23ceee4c5b7a3d, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:07.253571 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a23eb-385d-46d4-beb1-8e49f8743aec admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:07.265673 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 806/1608] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:07 2022] PUT /identity/v3/projects/fafb887ff5214294811fe568697481ae/users/7276ed630a694d0f844aa402169b938d/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:07.267036 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95466276-aa50-4f1c-aa12-a5541675d969 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.267400 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95466276-aa50-4f1c-aa12-a5541675d969 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.267739 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95466276-aa50-4f1c-aa12-a5541675d969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.271206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 803/1609] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:07 2022] PUT /identity/v3/projects/16b144b0bec84b07b68856c10d59e72b/users/7e7b9e21971c432b9f23ceee4c5b7a3d/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:07.272480 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45629e0e-4278-4cb9-9c4e-0bc7d4cebc31 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.272770 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45629e0e-4278-4cb9-9c4e-0bc7d4cebc31 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.273048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45629e0e-4278-4cb9-9c4e-0bc7d4cebc31 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.274284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 804/1610] 10.222.0.48 () {54 vars in 962 bytes} [Wed Jul 27 22:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:49:07.275895 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132f806-8936-4ad6-a43b-17f8820e635f None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.276272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132f806-8936-4ad6-a43b-17f8820e635f None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.276536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132f806-8936-4ad6-a43b-17f8820e635f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.289286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-95466276-aa50-4f1c-aa12-a5541675d969 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:07.291362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-95466276-aa50-4f1c-aa12-a5541675d969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:07.297983 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-5132f806-8936-4ad6-a43b-17f8820e635f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:07.299215 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5132f806-8936-4ad6-a43b-17f8820e635f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:07.335988 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:07.361517 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 807/1611] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:07.365081 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266eb46-ed11-4794-9c03-868acbefb122 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.365081 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266eb46-ed11-4794-9c03-868acbefb122 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.365081 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266eb46-ed11-4794-9c03-868acbefb122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.375461 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 805/1612] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:07.376263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132f806-8936-4ad6-a43b-17f8820e635f None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:07.389051 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132f806-8936-4ad6-a43b-17f8820e635f None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:07.395798 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6904d1-290f-411f-9899-5ce845ddd42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:07.396454 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6904d1-290f-411f-9899-5ce845ddd42a admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.396748 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6904d1-290f-411f-9899-5ce845ddd42a admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.397029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6904d1-290f-411f-9899-5ce845ddd42a admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.397751 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6904d1-290f-411f-9899-5ce845ddd42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:07.400125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-9266eb46-ed11-4794-9c03-868acbefb122 None None] MFA Rules not processed for user `65ccc72f409c475bba8fd3822d3451f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:07.400557 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6904d1-290f-411f-9899-5ce845ddd42a admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:07.401357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-9266eb46-ed11-4794-9c03-868acbefb122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:07.407469 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:07.418015 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 806/1613] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:07.418015 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2020d7-af3f-410b-975c-d41e61a2cda8 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.418015 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2020d7-af3f-410b-975c-d41e61a2cda8 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.418015 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2020d7-af3f-410b-975c-d41e61a2cda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.437471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-ba2020d7-af3f-410b-975c-d41e61a2cda8 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:07.438760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ba2020d7-af3f-410b-975c-d41e61a2cda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:07.448213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 807/1614] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:07.449496 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45006e36-2f36-42c6-8956-a4304b6d9667 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.449990 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45006e36-2f36-42c6-8956-a4304b6d9667 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.450322 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45006e36-2f36-42c6-8956-a4304b6d9667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.487900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-45006e36-2f36-42c6-8956-a4304b6d9667 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:07.488968 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 808/1615] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:07.490452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-45006e36-2f36-42c6-8956-a4304b6d9667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:07.491027 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b9144-44c2-45b4-9648-66de87f6484a None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.491436 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b9144-44c2-45b4-9648-66de87f6484a None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.491812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b9144-44c2-45b4-9648-66de87f6484a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.500671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 808/1616] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:07.501496 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45006e36-2f36-42c6-8956-a4304b6d9667 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:07.549325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-527b9144-44c2-45b4-9648-66de87f6484a None None] MFA Rules not processed for user `c621601261e44ca8a7938862d6578639`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:07.550855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-527b9144-44c2-45b4-9648-66de87f6484a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:07.572549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45006e36-2f36-42c6-8956-a4304b6d9667 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:07.578271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c821f-40cc-40be-bb37-b9c53d424255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:07.578999 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c821f-40cc-40be-bb37-b9c53d424255 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.579343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c821f-40cc-40be-bb37-b9c53d424255 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.579625 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c821f-40cc-40be-bb37-b9c53d424255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.593496 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c821f-40cc-40be-bb37-b9c53d424255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:07.596071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008c821f-40cc-40be-bb37-b9c53d424255 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:07.611722 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 809/1617] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:07.612645 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c821f-40cc-40be-bb37-b9c53d424255 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:07.624837 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c821f-40cc-40be-bb37-b9c53d424255 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:07.631932 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cd7af-51f6-4c3b-b094-d586d7faf961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:07.632982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cd7af-51f6-4c3b-b094-d586d7faf961 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.633269 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cd7af-51f6-4c3b-b094-d586d7faf961 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.634665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836cd7af-51f6-4c3b-b094-d586d7faf961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.646279 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 809/1618] 10.222.0.48 () {58 vars in 1059 bytes} [Wed Jul 27 22:49:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:07.648017 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b9144-44c2-45b4-9648-66de87f6484a None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:07.655265 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cd7af-51f6-4c3b-b094-d586d7faf961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:07.657002 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836cd7af-51f6-4c3b-b094-d586d7faf961 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:07.662642 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b9144-44c2-45b4-9648-66de87f6484a None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:07.670393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7feb0-d545-471a-a093-145f3ba83e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:07.671455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7feb0-d545-471a-a093-145f3ba83e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.671843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7feb0-d545-471a-a093-145f3ba83e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.672227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7feb0-d545-471a-a093-145f3ba83e25 admin admin] PATH_INFO: `/v3/projects/e4b2807c3a35488da04787cc6089c04a/users/e2854fb4eefa4a1e9f17d80640e0b334/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.675907 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 810/1619] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:07.676835 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cd7af-51f6-4c3b-b094-d586d7faf961 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:07.687237 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836cd7af-51f6-4c3b-b094-d586d7faf961 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:07.691235 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7feb0-d545-471a-a093-145f3ba83e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b2807c3a35488da04787cc6089c04a, user_id=e2854fb4eefa4a1e9f17d80640e0b334, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:07.691910 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172ac15-a425-4071-ab56-27e468745327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:07.692749 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172ac15-a425-4071-ab56-27e468745327 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.693038 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172ac15-a425-4071-ab56-27e468745327 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.693315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172ac15-a425-4071-ab56-27e468745327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.694604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7feb0-d545-471a-a093-145f3ba83e25 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:07.709074 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172ac15-a425-4071-ab56-27e468745327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:07.711089 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172ac15-a425-4071-ab56-27e468745327 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:07.718139 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 810/1620] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:07 2022] PUT /identity/v3/projects/e4b2807c3a35488da04787cc6089c04a/users/e2854fb4eefa4a1e9f17d80640e0b334/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:07.718139 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7feb0-d545-471a-a093-145f3ba83e25 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:07.726814 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 811/1621] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:07.728031 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172ac15-a425-4071-ab56-27e468745327 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:07.738635 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172ac15-a425-4071-ab56-27e468745327 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:07.807605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7feb0-d545-471a-a093-145f3ba83e25 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:07.810140 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be3fe4-e353-417c-b62a-878aab72e48b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:07.811013 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be3fe4-e353-417c-b62a-878aab72e48b service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.811349 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be3fe4-e353-417c-b62a-878aab72e48b service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.811683 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be3fe4-e353-417c-b62a-878aab72e48b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.813221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22dcec-eb76-4ada-81cd-28cf47dbd3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:07.814069 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22dcec-eb76-4ada-81cd-28cf47dbd3de admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.814539 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22dcec-eb76-4ada-81cd-28cf47dbd3de admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.815877 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22dcec-eb76-4ada-81cd-28cf47dbd3de admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.816736 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22dcec-eb76-4ada-81cd-28cf47dbd3de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:07.818795 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22dcec-eb76-4ada-81cd-28cf47dbd3de admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:07.825367 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be3fe4-e353-417c-b62a-878aab72e48b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:07.825835 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:07.827756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be3fe4-e353-417c-b62a-878aab72e48b service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:07.844449 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 812/1622] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:07.845982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be3fe4-e353-417c-b62a-878aab72e48b service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:07.860152 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 811/1623] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:07 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:07.861420 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22dcec-eb76-4ada-81cd-28cf47dbd3de admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:07.903559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:07.947346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22dcec-eb76-4ada-81cd-28cf47dbd3de admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:07.953697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfef5b-08d3-43f0-b7b6-4ac9421369aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:07.954869 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfef5b-08d3-43f0-b7b6-4ac9421369aa admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.955196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfef5b-08d3-43f0-b7b6-4ac9421369aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.955489 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfef5b-08d3-43f0-b7b6-4ac9421369aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.956768 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dfef5b-08d3-43f0-b7b6-4ac9421369aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:07.958519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dfef5b-08d3-43f0-b7b6-4ac9421369aa admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:07.973788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 812/1624] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:07.973788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfef5b-08d3-43f0-b7b6-4ac9421369aa admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:07.977074 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be3fe4-e353-417c-b62a-878aab72e48b service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:07.984688 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfef5b-08d3-43f0-b7b6-4ac9421369aa admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:07.990748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48415f9-c79d-4ce5-8396-23fabe5597c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:07.991632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48415f9-c79d-4ce5-8396-23fabe5597c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:07.991925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48415f9-c79d-4ce5-8396-23fabe5597c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:07.992252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48415f9-c79d-4ce5-8396-23fabe5597c5 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:07.993143 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48415f9-c79d-4ce5-8396-23fabe5597c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:07.996394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48415f9-c79d-4ce5-8396-23fabe5597c5 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:08.034140 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 813/1625] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:07 2022] POST /identity/v3/users => generated 293 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:08.034140 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48415f9-c79d-4ce5-8396-23fabe5597c5 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:08.046410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48415f9-c79d-4ce5-8396-23fabe5597c5 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:08.054080 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2470d6-a692-48d5-889d-90c97dd62465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:08.055009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2470d6-a692-48d5-889d-90c97dd62465 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:08.055617 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2470d6-a692-48d5-889d-90c97dd62465 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:08.056273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2470d6-a692-48d5-889d-90c97dd62465 admin admin] PATH_INFO: `/v3/projects/e4b2807c3a35488da04787cc6089c04a/users/e2854fb4eefa4a1e9f17d80640e0b334/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:08.058928 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2470d6-a692-48d5-889d-90c97dd62465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b2807c3a35488da04787cc6089c04a, user_id=e2854fb4eefa4a1e9f17d80640e0b334, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:08.062969 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2470d6-a692-48d5-889d-90c97dd62465 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:08.063327 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29511a72-25c7-421d-9e01-7c9a0a003633 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:08.064010 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29511a72-25c7-421d-9e01-7c9a0a003633 service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:08.064347 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29511a72-25c7-421d-9e01-7c9a0a003633 service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:08.064639 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29511a72-25c7-421d-9e01-7c9a0a003633 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:08.089121 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 814/1626] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:08 2022] PUT /identity/v3/projects/e4b2807c3a35488da04787cc6089c04a/users/e2854fb4eefa4a1e9f17d80640e0b334/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:08.089121 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2470d6-a692-48d5-889d-90c97dd62465 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:08.157796 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29511a72-25c7-421d-9e01-7c9a0a003633 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:08.161319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29511a72-25c7-421d-9e01-7c9a0a003633 service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:08.186289 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2470d6-a692-48d5-889d-90c97dd62465 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:08.190678 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 813/1627] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:08.192329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c088811-4a36-4246-a56b-fd6c3c0d7b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:08.193074 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6086-e5f5-4389-9016-1b4bd929bfe7 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:08.193795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6086-e5f5-4389-9016-1b4bd929bfe7 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:08.194150 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c088811-4a36-4246-a56b-fd6c3c0d7b3a admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:08.195207 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c088811-4a36-4246-a56b-fd6c3c0d7b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:08.195369 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea6086-e5f5-4389-9016-1b4bd929bfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:08.195682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c088811-4a36-4246-a56b-fd6c3c0d7b3a admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:08.197199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c088811-4a36-4246-a56b-fd6c3c0d7b3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:08.199359 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c088811-4a36-4246-a56b-fd6c3c0d7b3a admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:08.211954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 815/1628] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:08.219322 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c088811-4a36-4246-a56b-fd6c3c0d7b3a admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:08.233155 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c088811-4a36-4246-a56b-fd6c3c0d7b3a admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:08.240849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39a80c-6af1-41c8-870a-52c37902d579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:08.241618 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39a80c-6af1-41c8-870a-52c37902d579 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:08.244065 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39a80c-6af1-41c8-870a-52c37902d579 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:08.244486 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e39a80c-6af1-41c8-870a-52c37902d579 admin admin] PATH_INFO: `/v3/projects/834b1470d8f84a4fb39323a41d800c1a/users/fbcf222620f742238023232be62dc3af/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:08.267233 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-b6ea6086-e5f5-4389-9016-1b4bd929bfe7 None None] MFA Rules not processed for user `e2854fb4eefa4a1e9f17d80640e0b334`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:08.268483 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-b6ea6086-e5f5-4389-9016-1b4bd929bfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:08.281848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39a80c-6af1-41c8-870a-52c37902d579 admin admin] RBAC: Authorizing `identity:create_grant(project_id=834b1470d8f84a4fb39323a41d800c1a, user_id=fbcf222620f742238023232be62dc3af, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:08.286835 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e39a80c-6af1-41c8-870a-52c37902d579 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:08.326489 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 816/1629] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:08 2022] PUT /identity/v3/projects/834b1470d8f84a4fb39323a41d800c1a/users/fbcf222620f742238023232be62dc3af/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:08.331704 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39a80c-6af1-41c8-870a-52c37902d579 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:08.393633 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:08.406248 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:08.413436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 814/1630] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:08 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:08.447045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea6086-e5f5-4389-9016-1b4bd929bfe7 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:08.454434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e39a80c-6af1-41c8-870a-52c37902d579 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:08.464231 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ce582-a117-44d7-ae82-28a0ff42b994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:08.465960 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ce582-a117-44d7-ae82-28a0ff42b994 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:08.467627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ce582-a117-44d7-ae82-28a0ff42b994 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:08.467997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5ce582-a117-44d7-ae82-28a0ff42b994 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:08.468798 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ce582-a117-44d7-ae82-28a0ff42b994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:08.475560 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5ce582-a117-44d7-ae82-28a0ff42b994 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:08.499929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 817/1631] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:08 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:08.507366 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ce582-a117-44d7-ae82-28a0ff42b994 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:08.533211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5ce582-a117-44d7-ae82-28a0ff42b994 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:08.544344 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f509f-ef09-4f51-ac4c-ae15c686cb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:08.545055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f509f-ef09-4f51-ac4c-ae15c686cb50 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:08.545346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f509f-ef09-4f51-ac4c-ae15c686cb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:08.545633 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f509f-ef09-4f51-ac4c-ae15c686cb50 admin admin] PATH_INFO: `/v3/projects/834b1470d8f84a4fb39323a41d800c1a/users/fbcf222620f742238023232be62dc3af/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:08.547923 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f509f-ef09-4f51-ac4c-ae15c686cb50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=834b1470d8f84a4fb39323a41d800c1a, user_id=fbcf222620f742238023232be62dc3af, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:08.551938 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984f509f-ef09-4f51-ac4c-ae15c686cb50 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:08.566966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea6086-e5f5-4389-9016-1b4bd929bfe7 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:08.568254 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 818/1632] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:08 2022] PUT /identity/v3/projects/834b1470d8f84a4fb39323a41d800c1a/users/fbcf222620f742238023232be62dc3af/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:08.569648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c44ff-935f-4eeb-85c4-dbc7963965bb None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:08.569943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c44ff-935f-4eeb-85c4-dbc7963965bb None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:08.570224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206c44ff-935f-4eeb-85c4-dbc7963965bb None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:08.571608 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 819/1633] 10.222.0.48 () {54 vars in 912 bytes} [Wed Jul 27 22:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:49:08.577249 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d727b-03f0-49ce-bf30-aeb96fd6d18a None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:08.578178 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d727b-03f0-49ce-bf30-aeb96fd6d18a None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:08.578307 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d727b-03f0-49ce-bf30-aeb96fd6d18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:08.600627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-968d727b-03f0-49ce-bf30-aeb96fd6d18a None None] MFA Rules not processed for user `c621601261e44ca8a7938862d6578639`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:08.601813 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-968d727b-03f0-49ce-bf30-aeb96fd6d18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:08.652564 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56690a72-1fc5-405b-8d81-ee9f8e0f8a75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:08.653989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56690a72-1fc5-405b-8d81-ee9f8e0f8a75 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:08.653989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56690a72-1fc5-405b-8d81-ee9f8e0f8a75 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:08.653989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56690a72-1fc5-405b-8d81-ee9f8e0f8a75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:08.712930 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 820/1634] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 22:49:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:49:08.714786 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f851f-3605-4509-9050-a46d37aabb92 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:08.715079 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f851f-3605-4509-9050-a46d37aabb92 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:08.715360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f851f-3605-4509-9050-a46d37aabb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:08.754672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56690a72-1fc5-405b-8d81-ee9f8e0f8a75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:08.756149 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56690a72-1fc5-405b-8d81-ee9f8e0f8a75 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:08.767474 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 815/1635] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:08 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:08.767797 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-b27f851f-3605-4509-9050-a46d37aabb92 None None] MFA Rules not processed for user `fbcf222620f742238023232be62dc3af`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:08.768475 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56690a72-1fc5-405b-8d81-ee9f8e0f8a75 service cinder] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:08.769084 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-b27f851f-3605-4509-9050-a46d37aabb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:08.777838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56690a72-1fc5-405b-8d81-ee9f8e0f8a75 service cinder] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:08.869287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a790b8-f6d7-4c7d-9698-b8c7b9339702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:08.869287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a790b8-f6d7-4c7d-9698-b8c7b9339702 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:08.869287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a790b8-f6d7-4c7d-9698-b8c7b9339702 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:08.869287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a790b8-f6d7-4c7d-9698-b8c7b9339702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:08.870298 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a790b8-f6d7-4c7d-9698-b8c7b9339702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:08.870298 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a790b8-f6d7-4c7d-9698-b8c7b9339702 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:08.870298 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 816/1636] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:08.920234 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 821/1637] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:08.943828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a790b8-f6d7-4c7d-9698-b8c7b9339702 service cinder] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:08.955327 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a790b8-f6d7-4c7d-9698-b8c7b9339702 service cinder] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:08.959711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0271e-7b40-49a4-af7f-f6491b6d114e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:08.960344 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0271e-7b40-49a4-af7f-f6491b6d114e service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:08.960680 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0271e-7b40-49a4-af7f-f6491b6d114e service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:08.960964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0271e-7b40-49a4-af7f-f6491b6d114e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:08.973058 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0271e-7b40-49a4-af7f-f6491b6d114e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:08.975276 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0271e-7b40-49a4-af7f-f6491b6d114e service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:08.986967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 817/1638] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:10.164270 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f851f-3605-4509-9050-a46d37aabb92 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:10.179717 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0271e-7b40-49a4-af7f-f6491b6d114e service cinder] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:10.237213 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:10.292493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:10.326205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f851f-3605-4509-9050-a46d37aabb92 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:10.349600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efbca8-e2dc-4262-938d-4717fe161545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:10.351730 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efbca8-e2dc-4262-938d-4717fe161545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:10.354870 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efbca8-e2dc-4262-938d-4717fe161545 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:10.355047 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efbca8-e2dc-4262-938d-4717fe161545 admin admin] PATH_INFO: `/v3/users/0a7633d71c5c4094bc8bf021f495b8af` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:10.358498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efbca8-e2dc-4262-938d-4717fe161545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a7633d71c5c4094bc8bf021f495b8af)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:10.372485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0271e-7b40-49a4-af7f-f6491b6d114e service cinder] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:10.373314 dv-cinder-851249-4-smb devstack@keystone.service[86594]: WARNING py.warnings [None req-84efbca8-e2dc-4262-938d-4717fe161545 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:49:10.373314 dv-cinder-851249-4-smb devstack@keystone.service[86594]: warnings.warn(msg) Jul 27 22:49:10.373314 dv-cinder-851249-4-smb devstack@keystone.service[86594]: Jul 27 22:49:10.377238 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efbca8-e2dc-4262-938d-4717fe161545 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:10.385652 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6af4298-6fa8-4424-8bf7-7a45067929e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:10.388811 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af4298-6fa8-4424-8bf7-7a45067929e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:10.389472 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af4298-6fa8-4424-8bf7-7a45067929e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:10.389963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6af4298-6fa8-4424-8bf7-7a45067929e7 admin admin] PATH_INFO: `/v3/users/65ccc72f409c475bba8fd3822d3451f8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:10.393110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af4298-6fa8-4424-8bf7-7a45067929e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65ccc72f409c475bba8fd3822d3451f8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:10.397712 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6af4298-6fa8-4424-8bf7-7a45067929e7 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:10.528020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e6af4298-6fa8-4424-8bf7-7a45067929e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65ccc72f409c475bba8fd3822d3451f8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:10.529755 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e6af4298-6fa8-4424-8bf7-7a45067929e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65ccc72f409c475bba8fd3822d3451f8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:10.547451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-84efbca8-e2dc-4262-938d-4717fe161545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a7633d71c5c4094bc8bf021f495b8af'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:10.548193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-84efbca8-e2dc-4262-938d-4717fe161545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a7633d71c5c4094bc8bf021f495b8af'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:10.553767 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e6af4298-6fa8-4424-8bf7-7a45067929e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65ccc72f409c475bba8fd3822d3451f8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:10.582035 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e6af4298-6fa8-4424-8bf7-7a45067929e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65ccc72f409c475bba8fd3822d3451f8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:10.584708 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e6af4298-6fa8-4424-8bf7-7a45067929e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65ccc72f409c475bba8fd3822d3451f8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:10.613482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-84efbca8-e2dc-4262-938d-4717fe161545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a7633d71c5c4094bc8bf021f495b8af'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:10.615115 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 818/1639] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:10 2022] DELETE /identity/v3/users/65ccc72f409c475bba8fd3822d3451f8 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:49:10.616947 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a9f87-583c-4bd5-a65f-34ecccda5397 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:10.617243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a9f87-583c-4bd5-a65f-34ecccda5397 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:10.617523 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a9f87-583c-4bd5-a65f-34ecccda5397 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:10.622463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 819/1640] 10.222.0.48 () {54 vars in 962 bytes} [Wed Jul 27 22:49:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:49:10.625346 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3ca88-c66d-4f58-a9d4-a1919b461b6a None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:10.627104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3ca88-c66d-4f58-a9d4-a1919b461b6a None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:10.627398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa3ca88-c66d-4f58-a9d4-a1919b461b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:10.641793 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-84efbca8-e2dc-4262-938d-4717fe161545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a7633d71c5c4094bc8bf021f495b8af'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:10.664408 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-84efbca8-e2dc-4262-938d-4717fe161545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a7633d71c5c4094bc8bf021f495b8af'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:10.674947 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 822/1641] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:10 2022] DELETE /identity/v3/users/0a7633d71c5c4094bc8bf021f495b8af => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:10.676679 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ef87f-8575-4df4-b41b-45c7bdc48381 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:10.677019 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ef87f-8575-4df4-b41b-45c7bdc48381 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:10.677303 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ef87f-8575-4df4-b41b-45c7bdc48381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:10.678755 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-caa3ca88-c66d-4f58-a9d4-a1919b461b6a None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:10.680317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-caa3ca88-c66d-4f58-a9d4-a1919b461b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:10.717616 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-ff2ef87f-8575-4df4-b41b-45c7bdc48381 None None] MFA Rules not processed for user `c621601261e44ca8a7938862d6578639`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:10.719680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ff2ef87f-8575-4df4-b41b-45c7bdc48381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:10.841109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 820/1642] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:10.845054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfeecc-8036-4591-96b7-1cd52d1f0b3c None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:10.847452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfeecc-8036-4591-96b7-1cd52d1f0b3c None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:10.847937 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dfeecc-8036-4591-96b7-1cd52d1f0b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:10.866372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 823/1643] 10.222.0.48 () {58 vars in 1059 bytes} [Wed Jul 27 22:49:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:10.874505 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2f23a-66ab-47de-9a95-e1d3aa14ae4d None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:10.874795 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2f23a-66ab-47de-9a95-e1d3aa14ae4d None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:10.876026 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2f23a-66ab-47de-9a95-e1d3aa14ae4d None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:10.882925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 824/1644] 10.222.0.48 () {54 vars in 912 bytes} [Wed Jul 27 22:49:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:49:10.888482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bec1c-4711-4573-807a-f059b2d1576e None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:10.888775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bec1c-4711-4573-807a-f059b2d1576e None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:10.889055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9bec1c-4711-4573-807a-f059b2d1576e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:10.890928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-36dfeecc-8036-4591-96b7-1cd52d1f0b3c None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:10.893701 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-36dfeecc-8036-4591-96b7-1cd52d1f0b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:10.907499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 821/1645] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:10.923089 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-ba9bec1c-4711-4573-807a-f059b2d1576e None None] MFA Rules not processed for user `c621601261e44ca8a7938862d6578639`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:10.924492 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ba9bec1c-4711-4573-807a-f059b2d1576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:10.936784 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 825/1646] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 22:49:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:10.950906 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfeecc-8036-4591-96b7-1cd52d1f0b3c None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:10.954258 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-36dfeecc-8036-4591-96b7-1cd52d1f0b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:10.967253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bec1c-4711-4573-807a-f059b2d1576e None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:10.970201 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ba9bec1c-4711-4573-807a-f059b2d1576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:11.064221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:11.111212 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:11.116446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9bec1c-4711-4573-807a-f059b2d1576e None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:11.121920 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9605a0-24e3-4014-acca-f5e74b798157 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:11.122764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9605a0-24e3-4014-acca-f5e74b798157 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:11.123190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9605a0-24e3-4014-acca-f5e74b798157 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:11.123608 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9605a0-24e3-4014-acca-f5e74b798157 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:11.128218 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dfeecc-8036-4591-96b7-1cd52d1f0b3c None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:11.135289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3bc77-61f2-480d-acf9-4901c327f266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:11.137377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3bc77-61f2-480d-acf9-4901c327f266 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:11.137674 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3bc77-61f2-480d-acf9-4901c327f266 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:11.137955 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3bc77-61f2-480d-acf9-4901c327f266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:11.138447 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9605a0-24e3-4014-acca-f5e74b798157 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:11.140282 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9605a0-24e3-4014-acca-f5e74b798157 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:11.168680 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3bc77-61f2-480d-acf9-4901c327f266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:11.170418 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 826/1647] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:11.172927 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3bc77-61f2-480d-acf9-4901c327f266 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:11.173057 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9605a0-24e3-4014-acca-f5e74b798157 service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:11.174944 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-9f9605a0-24e3-4014-acca-f5e74b798157 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:11.207940 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 822/1648] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:11.240682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9605a0-24e3-4014-acca-f5e74b798157 service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:11.252313 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c3965-f2db-4ca5-871b-14183acbb785 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:11.253506 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c3965-f2db-4ca5-871b-14183acbb785 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:11.253821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c3965-f2db-4ca5-871b-14183acbb785 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:11.255900 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c3965-f2db-4ca5-871b-14183acbb785 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:11.289840 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c3965-f2db-4ca5-871b-14183acbb785 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:11.293362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c3965-f2db-4ca5-871b-14183acbb785 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:11.316861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 827/1649] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:12.716321 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3bc77-61f2-480d-acf9-4901c327f266 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:12.722176 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d3d3bc77-61f2-480d-acf9-4901c327f266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:12.754374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3bc77-61f2-480d-acf9-4901c327f266 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:12.763020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd74d8a3-2f2a-4a75-947f-9e6589dc1730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:12.764019 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74d8a3-2f2a-4a75-947f-9e6589dc1730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:12.765441 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74d8a3-2f2a-4a75-947f-9e6589dc1730 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:12.766038 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd74d8a3-2f2a-4a75-947f-9e6589dc1730 admin admin] PATH_INFO: `/v3/projects/ad4e9b7c11dd4e14845ed1d835de4550` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:12.767988 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74d8a3-2f2a-4a75-947f-9e6589dc1730 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4e9b7c11dd4e14845ed1d835de4550)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:12.770701 dv-cinder-851249-4-smb devstack@keystone.service[86595]: WARNING py.warnings [None req-bd74d8a3-2f2a-4a75-947f-9e6589dc1730 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 22:49:12.770701 dv-cinder-851249-4-smb devstack@keystone.service[86595]: warnings.warn(msg) Jul 27 22:49:12.770701 dv-cinder-851249-4-smb devstack@keystone.service[86595]: Jul 27 22:49:12.775363 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd74d8a3-2f2a-4a75-947f-9e6589dc1730 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:12.839735 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c3965-f2db-4ca5-871b-14183acbb785 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:12.841401 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a41c3965-f2db-4ca5-871b-14183acbb785 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:12.873227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c3965-f2db-4ca5-871b-14183acbb785 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:12.901417 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bd74d8a3-2f2a-4a75-947f-9e6589dc1730 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4e9b7c11dd4e14845ed1d835de4550', 'request_id': 'req-bd74d8a3-2f2a-4a75-947f-9e6589dc1730'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:12.929140 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bd74d8a3-2f2a-4a75-947f-9e6589dc1730 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4e9b7c11dd4e14845ed1d835de4550', 'request_id': 'req-bd74d8a3-2f2a-4a75-947f-9e6589dc1730'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:12.943782 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bd74d8a3-2f2a-4a75-947f-9e6589dc1730 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4e9b7c11dd4e14845ed1d835de4550', 'request_id': 'req-bd74d8a3-2f2a-4a75-947f-9e6589dc1730'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:12.969212 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bd74d8a3-2f2a-4a75-947f-9e6589dc1730 admin admin] The token cache is being invalidate because project ad4e9b7c11dd4e14845ed1d835de4550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:12.969677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bd74d8a3-2f2a-4a75-947f-9e6589dc1730 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:12.970223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bd74d8a3-2f2a-4a75-947f-9e6589dc1730 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:12.976922 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 823/1650] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:12 2022] DELETE /identity/v3/projects/ad4e9b7c11dd4e14845ed1d835de4550 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:12.979202 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d917dc5-06d6-4b9d-8af0-53757483eafb None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:12.979202 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d917dc5-06d6-4b9d-8af0-53757483eafb None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:12.979202 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d917dc5-06d6-4b9d-8af0-53757483eafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:13.011386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d4ec7-2e7c-440a-99c7-c3d84dbf4398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:13.012805 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d4ec7-2e7c-440a-99c7-c3d84dbf4398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:13.013525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d4ec7-2e7c-440a-99c7-c3d84dbf4398 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:13.014636 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d4ec7-2e7c-440a-99c7-c3d84dbf4398 admin admin] PATH_INFO: `/v3/projects/4abc8c6e49dd43548bfbf501b3ea5cad` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:13.016231 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d4ec7-2e7c-440a-99c7-c3d84dbf4398 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4abc8c6e49dd43548bfbf501b3ea5cad)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:13.021181 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d4ec7-2e7c-440a-99c7-c3d84dbf4398 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:13.039406 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-0d917dc5-06d6-4b9d-8af0-53757483eafb None None] MFA Rules not processed for user `78baf5bebf864c6daa8944297effd304`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:13.040758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-0d917dc5-06d6-4b9d-8af0-53757483eafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:13.120881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a80d4ec7-2e7c-440a-99c7-c3d84dbf4398 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4abc8c6e49dd43548bfbf501b3ea5cad', 'request_id': 'req-a80d4ec7-2e7c-440a-99c7-c3d84dbf4398'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:13.134314 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a80d4ec7-2e7c-440a-99c7-c3d84dbf4398 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4abc8c6e49dd43548bfbf501b3ea5cad', 'request_id': 'req-a80d4ec7-2e7c-440a-99c7-c3d84dbf4398'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:13.152113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a80d4ec7-2e7c-440a-99c7-c3d84dbf4398 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4abc8c6e49dd43548bfbf501b3ea5cad', 'request_id': 'req-a80d4ec7-2e7c-440a-99c7-c3d84dbf4398'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:13.180200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a80d4ec7-2e7c-440a-99c7-c3d84dbf4398 admin admin] The token cache is being invalidate because project 4abc8c6e49dd43548bfbf501b3ea5cad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:13.180545 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a80d4ec7-2e7c-440a-99c7-c3d84dbf4398 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:13.183763 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a80d4ec7-2e7c-440a-99c7-c3d84dbf4398 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:13.187925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 828/1651] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:12 2022] DELETE /identity/v3/projects/4abc8c6e49dd43548bfbf501b3ea5cad => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:13.190720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d4ec7-2e7c-440a-99c7-c3d84dbf4398 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:13.193844 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a80d4ec7-2e7c-440a-99c7-c3d84dbf4398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:13.205787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 824/1652] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:13.209254 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d917dc5-06d6-4b9d-8af0-53757483eafb None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:13.210729 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-0d917dc5-06d6-4b9d-8af0-53757483eafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:13.233478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d917dc5-06d6-4b9d-8af0-53757483eafb None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:13.332187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:13.341751 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3d8dc-a87e-46cf-9bdb-e0cc50da045a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:13.342943 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3d8dc-a87e-46cf-9bdb-e0cc50da045a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:13.343233 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3d8dc-a87e-46cf-9bdb-e0cc50da045a admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:13.343961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff3d8dc-a87e-46cf-9bdb-e0cc50da045a admin admin] PATH_INFO: `/v3/users/fbcf222620f742238023232be62dc3af` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:13.345261 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3d8dc-a87e-46cf-9bdb-e0cc50da045a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbcf222620f742238023232be62dc3af)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:13.348441 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff3d8dc-a87e-46cf-9bdb-e0cc50da045a admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:13.355470 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:13.372258 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d4ec7-2e7c-440a-99c7-c3d84dbf4398 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:13.387948 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c1b4f-5aba-4b9e-9c09-e90110a1a0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:13.388805 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c1b4f-5aba-4b9e-9c09-e90110a1a0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:13.389132 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c1b4f-5aba-4b9e-9c09-e90110a1a0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:13.389690 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c1b4f-5aba-4b9e-9c09-e90110a1a0b9 admin admin] PATH_INFO: `/v3/users/e2854fb4eefa4a1e9f17d80640e0b334` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:13.391302 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c1b4f-5aba-4b9e-9c09-e90110a1a0b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2854fb4eefa4a1e9f17d80640e0b334)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:13.399946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c1b4f-5aba-4b9e-9c09-e90110a1a0b9 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:13.443326 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4ff3d8dc-a87e-46cf-9bdb-e0cc50da045a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbcf222620f742238023232be62dc3af'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:13.445232 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4ff3d8dc-a87e-46cf-9bdb-e0cc50da045a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbcf222620f742238023232be62dc3af'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:13.466066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4ff3d8dc-a87e-46cf-9bdb-e0cc50da045a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbcf222620f742238023232be62dc3af'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:13.504472 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4ff3d8dc-a87e-46cf-9bdb-e0cc50da045a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbcf222620f742238023232be62dc3af'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:13.506642 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4ff3d8dc-a87e-46cf-9bdb-e0cc50da045a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbcf222620f742238023232be62dc3af'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:13.520743 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ac7c1b4f-5aba-4b9e-9c09-e90110a1a0b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2854fb4eefa4a1e9f17d80640e0b334'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:13.521437 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ac7c1b4f-5aba-4b9e-9c09-e90110a1a0b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2854fb4eefa4a1e9f17d80640e0b334'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:13.536572 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 825/1653] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:13 2022] DELETE /identity/v3/users/fbcf222620f742238023232be62dc3af => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:13.539465 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3d8dc-a87e-46cf-9bdb-e0cc50da045a admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:13.539465 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-4ff3d8dc-a87e-46cf-9bdb-e0cc50da045a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:13.556898 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ac7c1b4f-5aba-4b9e-9c09-e90110a1a0b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2854fb4eefa4a1e9f17d80640e0b334'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:13.570309 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ac7c1b4f-5aba-4b9e-9c09-e90110a1a0b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2854fb4eefa4a1e9f17d80640e0b334'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:13.591693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ac7c1b4f-5aba-4b9e-9c09-e90110a1a0b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2854fb4eefa4a1e9f17d80640e0b334'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:13.599365 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 829/1654] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:13 2022] DELETE /identity/v3/users/e2854fb4eefa4a1e9f17d80640e0b334 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:13.657329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff3d8dc-a87e-46cf-9bdb-e0cc50da045a admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:13.759790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5253da-2655-4e36-8425-08fe52802578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:13.762766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5253da-2655-4e36-8425-08fe52802578 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:13.763879 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5253da-2655-4e36-8425-08fe52802578 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:13.764356 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5253da-2655-4e36-8425-08fe52802578 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:13.774592 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5253da-2655-4e36-8425-08fe52802578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:13.786056 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5253da-2655-4e36-8425-08fe52802578 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:13.880349 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 826/1655] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:13 2022] POST /identity/v3/projects => generated 403 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:13.887927 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c1b4f-5aba-4b9e-9c09-e90110a1a0b9 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:13.890713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ac7c1b4f-5aba-4b9e-9c09-e90110a1a0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:13.916468 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c1b4f-5aba-4b9e-9c09-e90110a1a0b9 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:14.022114 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8f263-bcec-45d3-afb5-e0ab18b17f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:14.023236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8f263-bcec-45d3-afb5-e0ab18b17f1a admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:14.024254 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8f263-bcec-45d3-afb5-e0ab18b17f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:14.025622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8f263-bcec-45d3-afb5-e0ab18b17f1a admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:14.026474 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8f263-bcec-45d3-afb5-e0ab18b17f1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:14.029089 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8f263-bcec-45d3-afb5-e0ab18b17f1a admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:14.074921 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 830/1656] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:13 2022] POST /identity/v3/users => generated 308 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:14.075184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5253da-2655-4e36-8425-08fe52802578 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:14.094287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5253da-2655-4e36-8425-08fe52802578 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:14.116597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c1010-6e35-463a-8399-9f39dfdf3770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:14.120102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c1010-6e35-463a-8399-9f39dfdf3770 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:14.120391 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c1010-6e35-463a-8399-9f39dfdf3770 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:14.120673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c1010-6e35-463a-8399-9f39dfdf3770 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:14.121406 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c1010-6e35-463a-8399-9f39dfdf3770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:14.123159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c1010-6e35-463a-8399-9f39dfdf3770 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:14.154276 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 827/1657] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:49:14.155966 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8f263-bcec-45d3-afb5-e0ab18b17f1a admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:14.172031 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8f263-bcec-45d3-afb5-e0ab18b17f1a admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:14.187055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7a6e5-9566-4cc0-ab07-d4dc64c66a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:14.187767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7a6e5-9566-4cc0-ab07-d4dc64c66a90 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:14.188058 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7a6e5-9566-4cc0-ab07-d4dc64c66a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:14.188342 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7a6e5-9566-4cc0-ab07-d4dc64c66a90 admin admin] PATH_INFO: `/v3/projects/9e9d56215f754148931a220046bec2ba/users/a4ab2aac18054c7e9b2756f6ceb20ca1/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:14.239786 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7a6e5-9566-4cc0-ab07-d4dc64c66a90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9d56215f754148931a220046bec2ba, user_id=a4ab2aac18054c7e9b2756f6ceb20ca1, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:14.243727 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7a6e5-9566-4cc0-ab07-d4dc64c66a90 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:14.276342 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 831/1658] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:14 2022] PUT /identity/v3/projects/9e9d56215f754148931a220046bec2ba/users/a4ab2aac18054c7e9b2756f6ceb20ca1/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:14.280240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c1010-6e35-463a-8399-9f39dfdf3770 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:14.287103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:14.300514 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c1010-6e35-463a-8399-9f39dfdf3770 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:14.500726 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04771a3a-205c-4640-b6ce-4b9879aff1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:14.501514 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04771a3a-205c-4640-b6ce-4b9879aff1a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:14.501827 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04771a3a-205c-4640-b6ce-4b9879aff1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:14.502075 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04771a3a-205c-4640-b6ce-4b9879aff1a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:14.503057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04771a3a-205c-4640-b6ce-4b9879aff1a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:14.505543 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04771a3a-205c-4640-b6ce-4b9879aff1a7 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:14.539323 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7a6e5-9566-4cc0-ab07-d4dc64c66a90 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:14.540553 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 828/1659] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:14 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:14.558787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7a6e5-9566-4cc0-ab07-d4dc64c66a90 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:14.574120 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb187a6-bab0-412b-82af-0c94f2e65652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:14.574900 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb187a6-bab0-412b-82af-0c94f2e65652 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:14.575188 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb187a6-bab0-412b-82af-0c94f2e65652 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:14.575475 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb187a6-bab0-412b-82af-0c94f2e65652 admin admin] PATH_INFO: `/v3/projects/9e9d56215f754148931a220046bec2ba/users/a4ab2aac18054c7e9b2756f6ceb20ca1/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:14.581742 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb187a6-bab0-412b-82af-0c94f2e65652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e9d56215f754148931a220046bec2ba, user_id=a4ab2aac18054c7e9b2756f6ceb20ca1, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:14.584472 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb187a6-bab0-412b-82af-0c94f2e65652 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:14.620718 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 832/1660] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:14 2022] PUT /identity/v3/projects/9e9d56215f754148931a220046bec2ba/users/a4ab2aac18054c7e9b2756f6ceb20ca1/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:15.575134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04771a3a-205c-4640-b6ce-4b9879aff1a7 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:15.577750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-04771a3a-205c-4640-b6ce-4b9879aff1a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:15.593683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb187a6-bab0-412b-82af-0c94f2e65652 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:15.595352 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8eb187a6-bab0-412b-82af-0c94f2e65652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:15.634744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04771a3a-205c-4640-b6ce-4b9879aff1a7 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:15.672927 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=6 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:15.822860 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb187a6-bab0-412b-82af-0c94f2e65652 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:15.828583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77566b16-efc0-4b06-8a25-160195315fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:15.829180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77566b16-efc0-4b06-8a25-160195315fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:15.829548 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77566b16-efc0-4b06-8a25-160195315fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:15.829994 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77566b16-efc0-4b06-8a25-160195315fbe admin admin] PATH_INFO: `/v3/projects/834b1470d8f84a4fb39323a41d800c1a` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:15.831274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77566b16-efc0-4b06-8a25-160195315fbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=834b1470d8f84a4fb39323a41d800c1a)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:15.833810 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77566b16-efc0-4b06-8a25-160195315fbe admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:15.869352 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38410c27-a873-4694-9cce-de5c99ba5d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:15.870034 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38410c27-a873-4694-9cce-de5c99ba5d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:15.870319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38410c27-a873-4694-9cce-de5c99ba5d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:15.870858 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38410c27-a873-4694-9cce-de5c99ba5d66 admin admin] PATH_INFO: `/v3/projects/e4b2807c3a35488da04787cc6089c04a` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:15.872175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38410c27-a873-4694-9cce-de5c99ba5d66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b2807c3a35488da04787cc6089c04a)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:15.878446 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38410c27-a873-4694-9cce-de5c99ba5d66 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:16.001583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-77566b16-efc0-4b06-8a25-160195315fbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '834b1470d8f84a4fb39323a41d800c1a', 'request_id': 'req-77566b16-efc0-4b06-8a25-160195315fbe'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:16.032005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-77566b16-efc0-4b06-8a25-160195315fbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '834b1470d8f84a4fb39323a41d800c1a', 'request_id': 'req-77566b16-efc0-4b06-8a25-160195315fbe'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:16.050635 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-77566b16-efc0-4b06-8a25-160195315fbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '834b1470d8f84a4fb39323a41d800c1a', 'request_id': 'req-77566b16-efc0-4b06-8a25-160195315fbe'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:16.058733 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-38410c27-a873-4694-9cce-de5c99ba5d66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b2807c3a35488da04787cc6089c04a', 'request_id': 'req-38410c27-a873-4694-9cce-de5c99ba5d66'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:16.074943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-77566b16-efc0-4b06-8a25-160195315fbe admin admin] The token cache is being invalidate because project 834b1470d8f84a4fb39323a41d800c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:16.075454 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-77566b16-efc0-4b06-8a25-160195315fbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:16.087734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-38410c27-a873-4694-9cce-de5c99ba5d66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b2807c3a35488da04787cc6089c04a', 'request_id': 'req-38410c27-a873-4694-9cce-de5c99ba5d66'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:16.092666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-77566b16-efc0-4b06-8a25-160195315fbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:16.096063 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 833/1661] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:15 2022] DELETE /identity/v3/projects/834b1470d8f84a4fb39323a41d800c1a => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:16.100620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77566b16-efc0-4b06-8a25-160195315fbe admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:16.107451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-77566b16-efc0-4b06-8a25-160195315fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:16.125819 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-38410c27-a873-4694-9cce-de5c99ba5d66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b2807c3a35488da04787cc6089c04a', 'request_id': 'req-38410c27-a873-4694-9cce-de5c99ba5d66'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:16.165600 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-38410c27-a873-4694-9cce-de5c99ba5d66 admin admin] The token cache is being invalidate because project e4b2807c3a35488da04787cc6089c04a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:16.165991 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-38410c27-a873-4694-9cce-de5c99ba5d66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:16.166746 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-38410c27-a873-4694-9cce-de5c99ba5d66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:16.177975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 829/1662] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:15 2022] DELETE /identity/v3/projects/e4b2807c3a35488da04787cc6089c04a => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:16.177975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233773d-4d3a-4281-be8a-81c0f33d8a73 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:16.177975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233773d-4d3a-4281-be8a-81c0f33d8a73 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:16.177975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233773d-4d3a-4281-be8a-81c0f33d8a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:16.259241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-6233773d-4d3a-4281-be8a-81c0f33d8a73 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:16.261219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-6233773d-4d3a-4281-be8a-81c0f33d8a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:16.316910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77566b16-efc0-4b06-8a25-160195315fbe admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:16.345412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:16.427051 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 830/1663] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:16.428827 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704cdf9-de37-4d1b-a915-ae6ea40b6acf None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:16.430394 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704cdf9-de37-4d1b-a915-ae6ea40b6acf None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:16.430947 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d704cdf9-de37-4d1b-a915-ae6ea40b6acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:16.457974 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-d704cdf9-de37-4d1b-a915-ae6ea40b6acf None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:16.463745 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d704cdf9-de37-4d1b-a915-ae6ea40b6acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:16.476853 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 831/1664] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:16.483517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb10f0-6ab9-4115-b859-0352936e876a None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:16.484063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb10f0-6ab9-4115-b859-0352936e876a None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:16.485947 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb10f0-6ab9-4115-b859-0352936e876a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:16.518835 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:16.532059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-66cb10f0-6ab9-4115-b859-0352936e876a None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:16.534068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49dc0f-a1a4-4b7d-b47b-c3a65a34cb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:16.534839 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49dc0f-a1a4-4b7d-b47b-c3a65a34cb06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:16.535159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49dc0f-a1a4-4b7d-b47b-c3a65a34cb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:16.535468 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f49dc0f-a1a4-4b7d-b47b-c3a65a34cb06 admin admin] PATH_INFO: `/v3/users/eb48e3cd747c4fb38bbd4781d3297574` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:16.538042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49dc0f-a1a4-4b7d-b47b-c3a65a34cb06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb48e3cd747c4fb38bbd4781d3297574)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:16.539286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-66cb10f0-6ab9-4115-b859-0352936e876a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:16.544591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f49dc0f-a1a4-4b7d-b47b-c3a65a34cb06 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:16.567365 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 832/1665] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:16.568948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1b1c6-b039-4401-8b84-6dac64a8c1c1 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:16.569326 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1b1c6-b039-4401-8b84-6dac64a8c1c1 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:16.569851 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe1b1c6-b039-4401-8b84-6dac64a8c1c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:16.634363 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-efe1b1c6-b039-4401-8b84-6dac64a8c1c1 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:16.641046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-efe1b1c6-b039-4401-8b84-6dac64a8c1c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:16.657282 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0f49dc0f-a1a4-4b7d-b47b-c3a65a34cb06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb48e3cd747c4fb38bbd4781d3297574'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:16.658277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0f49dc0f-a1a4-4b7d-b47b-c3a65a34cb06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb48e3cd747c4fb38bbd4781d3297574'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:16.663136 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 833/1666] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:16.664161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1b1c6-b039-4401-8b84-6dac64a8c1c1 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:16.688570 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe1b1c6-b039-4401-8b84-6dac64a8c1c1 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:16.689108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0f49dc0f-a1a4-4b7d-b47b-c3a65a34cb06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb48e3cd747c4fb38bbd4781d3297574'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:16.703894 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0f49dc0f-a1a4-4b7d-b47b-c3a65a34cb06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb48e3cd747c4fb38bbd4781d3297574'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:16.704000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ee8b4-1234-4f0f-9d55-853d5c947afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:16.704708 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ee8b4-1234-4f0f-9d55-853d5c947afd admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:16.705280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ee8b4-1234-4f0f-9d55-853d5c947afd admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:16.705679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ee8b4-1234-4f0f-9d55-853d5c947afd admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:16.706855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ee8b4-1234-4f0f-9d55-853d5c947afd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:16.707330 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ee8b4-1234-4f0f-9d55-853d5c947afd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:16.709135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ee8b4-1234-4f0f-9d55-853d5c947afd admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:16.719110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0f49dc0f-a1a4-4b7d-b47b-c3a65a34cb06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb48e3cd747c4fb38bbd4781d3297574'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:16.729390 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 834/1667] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:16 2022] DELETE /identity/v3/users/eb48e3cd747c4fb38bbd4781d3297574 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:16.731043 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49dc0f-a1a4-4b7d-b47b-c3a65a34cb06 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:16.734058 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-0f49dc0f-a1a4-4b7d-b47b-c3a65a34cb06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:16.743326 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 834/1668] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:49:16.744780 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a38a5d-4d36-40cd-a7c4-11e2f0c13f99 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:16.745073 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a38a5d-4d36-40cd-a7c4-11e2f0c13f99 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:16.745348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a38a5d-4d36-40cd-a7c4-11e2f0c13f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:16.779630 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-c1a38a5d-4d36-40cd-a7c4-11e2f0c13f99 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:16.783359 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c1a38a5d-4d36-40cd-a7c4-11e2f0c13f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:16.933788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f49dc0f-a1a4-4b7d-b47b-c3a65a34cb06 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:16.934965 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 835/1669] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:16.938082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a38a5d-4d36-40cd-a7c4-11e2f0c13f99 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:16.939053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c1a38a5d-4d36-40cd-a7c4-11e2f0c13f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:16.947462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71e7f1-b2e0-4464-916a-ef1f8ec25ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:16.950852 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71e7f1-b2e0-4464-916a-ef1f8ec25ebd admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:16.952101 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71e7f1-b2e0-4464-916a-ef1f8ec25ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:16.952640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71e7f1-b2e0-4464-916a-ef1f8ec25ebd admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:16.955064 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71e7f1-b2e0-4464-916a-ef1f8ec25ebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:16.956338 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71e7f1-b2e0-4464-916a-ef1f8ec25ebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:16.959577 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71e7f1-b2e0-4464-916a-ef1f8ec25ebd admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:16.976574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a38a5d-4d36-40cd-a7c4-11e2f0c13f99 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:16.994496 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35610b6b-f169-4e7a-954c-3937ae9c765d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:16.998504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 835/1670] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:49:16.998958 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35610b6b-f169-4e7a-954c-3937ae9c765d admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:16.999193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35610b6b-f169-4e7a-954c-3937ae9c765d admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:16.999475 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35610b6b-f169-4e7a-954c-3937ae9c765d admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:17.000165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35610b6b-f169-4e7a-954c-3937ae9c765d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:17.007173 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71e7f1-b2e0-4464-916a-ef1f8ec25ebd admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:17.009564 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35610b6b-f169-4e7a-954c-3937ae9c765d admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:17.028343 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71e7f1-b2e0-4464-916a-ef1f8ec25ebd admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:17.037867 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f0c11-25e9-4c69-b5af-430e70e76f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:17.038567 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f0c11-25e9-4c69-b5af-430e70e76f49 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:17.038820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f0c11-25e9-4c69-b5af-430e70e76f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:17.039102 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20f0c11-25e9-4c69-b5af-430e70e76f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:17.039785 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f0c11-25e9-4c69-b5af-430e70e76f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:17.048571 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20f0c11-25e9-4c69-b5af-430e70e76f49 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:17.092387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 836/1671] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:16 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:17.093583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35610b6b-f169-4e7a-954c-3937ae9c765d admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:17.096798 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-35610b6b-f169-4e7a-954c-3937ae9c765d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:17.129370 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 836/1672] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:17 2022] POST /identity/v3/projects => generated 355 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:17.130021 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f0c11-25e9-4c69-b5af-430e70e76f49 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:17.240664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35610b6b-f169-4e7a-954c-3937ae9c765d admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:17.253003 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:17.284043 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20f0c11-25e9-4c69-b5af-430e70e76f49 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:17.299839 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddf131-567b-440f-888b-0b507d9dc6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:17.301212 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddf131-567b-440f-888b-0b507d9dc6dc admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:17.301212 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddf131-567b-440f-888b-0b507d9dc6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:17.301212 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddf131-567b-440f-888b-0b507d9dc6dc admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:17.301841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ddf131-567b-440f-888b-0b507d9dc6dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:17.307754 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ddf131-567b-440f-888b-0b507d9dc6dc admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:17.321574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:17.369392 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 837/1673] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:17 2022] POST /identity/v3/users => generated 288 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:17.374483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddf131-567b-440f-888b-0b507d9dc6dc admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:17.380328 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2a5f9-0fa2-4008-8541-0cabbb279cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:17.381910 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2a5f9-0fa2-4008-8541-0cabbb279cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:17.382466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2a5f9-0fa2-4008-8541-0cabbb279cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:17.382887 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce2a5f9-0fa2-4008-8541-0cabbb279cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:17.398152 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddf131-567b-440f-888b-0b507d9dc6dc admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:17.404721 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a8eb7-d734-4fb7-8b53-7a13f562f219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:17.405642 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a8eb7-d734-4fb7-8b53-7a13f562f219 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:17.406075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a8eb7-d734-4fb7-8b53-7a13f562f219 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:17.406699 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a8eb7-d734-4fb7-8b53-7a13f562f219 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:17.407107 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2a5f9-0fa2-4008-8541-0cabbb279cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:17.407684 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a8eb7-d734-4fb7-8b53-7a13f562f219 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:17.408565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce2a5f9-0fa2-4008-8541-0cabbb279cc1 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:17.410012 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a8eb7-d734-4fb7-8b53-7a13f562f219 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:17.433130 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 837/1674] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:17.434021 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2a5f9-0fa2-4008-8541-0cabbb279cc1 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:17.437283 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 838/1675] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:17 2022] POST /identity/v3/users => generated 278 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:17.441365 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a8eb7-d734-4fb7-8b53-7a13f562f219 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:17.458808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a8eb7-d734-4fb7-8b53-7a13f562f219 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:17.459205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce2a5f9-0fa2-4008-8541-0cabbb279cc1 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:17.467843 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432afc9-1277-409d-bcc4-9fa2da3c9fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:17.468487 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432afc9-1277-409d-bcc4-9fa2da3c9fbd admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:17.468771 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432afc9-1277-409d-bcc4-9fa2da3c9fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:17.469048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432afc9-1277-409d-bcc4-9fa2da3c9fbd admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:17.469761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432afc9-1277-409d-bcc4-9fa2da3c9fbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:17.471373 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9a201-3fb3-448a-9a96-86facec756a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:17.471601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432afc9-1277-409d-bcc4-9fa2da3c9fbd admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:17.472371 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9a201-3fb3-448a-9a96-86facec756a7 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:17.472790 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9a201-3fb3-448a-9a96-86facec756a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:17.473340 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9a201-3fb3-448a-9a96-86facec756a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:17.474217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9a201-3fb3-448a-9a96-86facec756a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:17.476750 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9a201-3fb3-448a-9a96-86facec756a7 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:17.503686 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 838/1676] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:17.506783 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432afc9-1277-409d-bcc4-9fa2da3c9fbd admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:17.514499 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 839/1677] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:17.516444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9a201-3fb3-448a-9a96-86facec756a7 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:17.530854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432afc9-1277-409d-bcc4-9fa2da3c9fbd admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:17.531165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9a201-3fb3-448a-9a96-86facec756a7 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:17.542931 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf003063-9f4b-427d-84a8-5f617ce08502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:17.543142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969dae0-17d1-4654-960d-3ec082c21c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:17.543663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969dae0-17d1-4654-960d-3ec082c21c75 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:17.543944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969dae0-17d1-4654-960d-3ec082c21c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:17.544223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969dae0-17d1-4654-960d-3ec082c21c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:17.544462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf003063-9f4b-427d-84a8-5f617ce08502 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:17.544883 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf003063-9f4b-427d-84a8-5f617ce08502 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:17.544987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969dae0-17d1-4654-960d-3ec082c21c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:17.545398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf003063-9f4b-427d-84a8-5f617ce08502 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:17.546714 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf003063-9f4b-427d-84a8-5f617ce08502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:17.548715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf003063-9f4b-427d-84a8-5f617ce08502 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:17.549742 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969dae0-17d1-4654-960d-3ec082c21c75 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:17.576862 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 840/1678] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:17.579072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 839/1679] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:17.581736 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf003063-9f4b-427d-84a8-5f617ce08502 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:17.583348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969dae0-17d1-4654-960d-3ec082c21c75 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:17.608502 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969dae0-17d1-4654-960d-3ec082c21c75 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:17.618330 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf003063-9f4b-427d-84a8-5f617ce08502 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:17.623190 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1371d9-9b16-49b4-b2a1-d6ad94ad557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:17.624190 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1371d9-9b16-49b4-b2a1-d6ad94ad557b admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:17.624738 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1371d9-9b16-49b4-b2a1-d6ad94ad557b admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:17.625030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1371d9-9b16-49b4-b2a1-d6ad94ad557b admin admin] PATH_INFO: `/v3/projects/75d007bc22884947b98f594e2813d2de/users/a84f76d13f974c94b64643f15020f5fd/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:17.630617 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e594a3a-6557-4d61-b8bc-5eb410c8dbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:17.632784 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e594a3a-6557-4d61-b8bc-5eb410c8dbe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:17.633393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e594a3a-6557-4d61-b8bc-5eb410c8dbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:17.634696 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e594a3a-6557-4d61-b8bc-5eb410c8dbe0 admin admin] PATH_INFO: `/v3/projects/ea47af0d04a94cbda195be1a4c685044/users/85dcfc87407c4a56b69a447a0f9ced1c/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:17.663581 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e594a3a-6557-4d61-b8bc-5eb410c8dbe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea47af0d04a94cbda195be1a4c685044, user_id=85dcfc87407c4a56b69a447a0f9ced1c, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:17.664287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1371d9-9b16-49b4-b2a1-d6ad94ad557b admin admin] RBAC: Authorizing `identity:create_grant(project_id=75d007bc22884947b98f594e2813d2de, user_id=a84f76d13f974c94b64643f15020f5fd, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:17.667571 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1371d9-9b16-49b4-b2a1-d6ad94ad557b admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:17.668091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e594a3a-6557-4d61-b8bc-5eb410c8dbe0 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:17.702953 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 840/1681] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:17 2022] PUT /identity/v3/projects/75d007bc22884947b98f594e2813d2de/users/a84f76d13f974c94b64643f15020f5fd/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:17.708628 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 841/1681] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:17 2022] PUT /identity/v3/projects/ea47af0d04a94cbda195be1a4c685044/users/85dcfc87407c4a56b69a447a0f9ced1c/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:17.710778 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68472ce-e1b7-4d9f-8070-1ecb809a7e82 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:17.711197 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68472ce-e1b7-4d9f-8070-1ecb809a7e82 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:17.711633 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68472ce-e1b7-4d9f-8070-1ecb809a7e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:17.721371 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4a4e9-6993-476c-b89c-b8b70d69714d None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:17.724598 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4a4e9-6993-476c-b89c-b8b70d69714d None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:17.725447 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4a4e9-6993-476c-b89c-b8b70d69714d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:17.768421 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-67d4a4e9-6993-476c-b89c-b8b70d69714d None None] MFA Rules not processed for user `a84f76d13f974c94b64643f15020f5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:17.772205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-67d4a4e9-6993-476c-b89c-b8b70d69714d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:17.780992 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-b68472ce-e1b7-4d9f-8070-1ecb809a7e82 None None] MFA Rules not processed for user `85dcfc87407c4a56b69a447a0f9ced1c`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:17.784621 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-b68472ce-e1b7-4d9f-8070-1ecb809a7e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:17.896859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 842/1682] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:17.901542 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4a4e9-6993-476c-b89c-b8b70d69714d None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:17.955926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 841/1683] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:17 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:17.961010 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68472ce-e1b7-4d9f-8070-1ecb809a7e82 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:18.045949 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4a4e9-6993-476c-b89c-b8b70d69714d None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:18.061418 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47d1d5-ca54-4c1e-8d9f-c866cebf9b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:18.062812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47d1d5-ca54-4c1e-8d9f-c866cebf9b74 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:18.064653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47d1d5-ca54-4c1e-8d9f-c866cebf9b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:18.064943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb47d1d5-ca54-4c1e-8d9f-c866cebf9b74 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:18.066457 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47d1d5-ca54-4c1e-8d9f-c866cebf9b74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:18.072554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb47d1d5-ca54-4c1e-8d9f-c866cebf9b74 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:18.095897 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68472ce-e1b7-4d9f-8070-1ecb809a7e82 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:18.115063 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:18.121024 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef679ae1-a297-4d31-aa45-987a58e80a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:18.121674 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef679ae1-a297-4d31-aa45-987a58e80a8c admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:18.121956 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef679ae1-a297-4d31-aa45-987a58e80a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:18.122230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef679ae1-a297-4d31-aa45-987a58e80a8c admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:18.127057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef679ae1-a297-4d31-aa45-987a58e80a8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:18.132703 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef679ae1-a297-4d31-aa45-987a58e80a8c admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:18.163562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 843/1684] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:17 2022] POST /identity/v3/projects => generated 375 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:18.164620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47d1d5-ca54-4c1e-8d9f-c866cebf9b74 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:18.207559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 842/1685] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:17 2022] POST /identity/v3/projects => generated 355 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:18.209037 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef679ae1-a297-4d31-aa45-987a58e80a8c admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:18.221038 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:18.334619 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb47d1d5-ca54-4c1e-8d9f-c866cebf9b74 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:18.380330 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef679ae1-a297-4d31-aa45-987a58e80a8c admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:18.394317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65507e5d-6f23-4298-81f0-4039a02eee1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:18.395425 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65507e5d-6f23-4298-81f0-4039a02eee1e admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:18.396337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65507e5d-6f23-4298-81f0-4039a02eee1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:18.396337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65507e5d-6f23-4298-81f0-4039a02eee1e admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:18.396703 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65507e5d-6f23-4298-81f0-4039a02eee1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:18.406683 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65507e5d-6f23-4298-81f0-4039a02eee1e admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:18.462031 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 843/1686] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:18 2022] POST /identity/v3/users => generated 284 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:18.469672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65507e5d-6f23-4298-81f0-4039a02eee1e admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:18.498966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65507e5d-6f23-4298-81f0-4039a02eee1e admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:18.518013 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27b118-3b43-4de6-80ac-cd14268c17c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:18.519688 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e28afa-a4e9-4df6-91bd-06a1dddb0cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:18.520899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27b118-3b43-4de6-80ac-cd14268c17c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:18.521371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27b118-3b43-4de6-80ac-cd14268c17c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:18.522704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27b118-3b43-4de6-80ac-cd14268c17c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:18.522993 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e28afa-a4e9-4df6-91bd-06a1dddb0cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:18.523469 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e28afa-a4e9-4df6-91bd-06a1dddb0cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:18.524824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27b118-3b43-4de6-80ac-cd14268c17c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:18.525037 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e28afa-a4e9-4df6-91bd-06a1dddb0cf7 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:18.526931 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e28afa-a4e9-4df6-91bd-06a1dddb0cf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:18.528547 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27b118-3b43-4de6-80ac-cd14268c17c4 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:18.533100 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e28afa-a4e9-4df6-91bd-06a1dddb0cf7 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:18.579816 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 844/1687] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:18.587511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27b118-3b43-4de6-80ac-cd14268c17c4 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:18.610392 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 844/1688] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:18 2022] POST /identity/v3/users => generated 294 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:18.629779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e28afa-a4e9-4df6-91bd-06a1dddb0cf7 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:18.639263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27b118-3b43-4de6-80ac-cd14268c17c4 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:18.651379 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff16abc-0b94-4ac3-bd59-5d6307f6dbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:18.652019 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff16abc-0b94-4ac3-bd59-5d6307f6dbaa admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:18.652300 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff16abc-0b94-4ac3-bd59-5d6307f6dbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:18.652574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff16abc-0b94-4ac3-bd59-5d6307f6dbaa admin admin] PATH_INFO: `/v3/projects/ee8b18a72cde4a4f9691db679966e179/users/b9786fb83c4c4396a86bc632b252ecfd/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:18.656226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e28afa-a4e9-4df6-91bd-06a1dddb0cf7 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:18.669874 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f3bf3-3c6a-4bab-b0d3-bbf88ff0e3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:18.673559 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f3bf3-3c6a-4bab-b0d3-bbf88ff0e3d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:18.673849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f3bf3-3c6a-4bab-b0d3-bbf88ff0e3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:18.674126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0f3bf3-3c6a-4bab-b0d3-bbf88ff0e3d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:18.677530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f3bf3-3c6a-4bab-b0d3-bbf88ff0e3d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:18.682271 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0f3bf3-3c6a-4bab-b0d3-bbf88ff0e3d0 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:18.696109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff16abc-0b94-4ac3-bd59-5d6307f6dbaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8b18a72cde4a4f9691db679966e179, user_id=b9786fb83c4c4396a86bc632b252ecfd, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:18.705763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff16abc-0b94-4ac3-bd59-5d6307f6dbaa admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:18.710156 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 845/1689] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:18.715850 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f3bf3-3c6a-4bab-b0d3-bbf88ff0e3d0 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:18.736875 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 845/1690] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:18 2022] PUT /identity/v3/projects/ee8b18a72cde4a4f9691db679966e179/users/b9786fb83c4c4396a86bc632b252ecfd/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:18.749927 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff16abc-0b94-4ac3-bd59-5d6307f6dbaa admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:18.754228 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0f3bf3-3c6a-4bab-b0d3-bbf88ff0e3d0 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:18.904738 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff16abc-0b94-4ac3-bd59-5d6307f6dbaa admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:18.917140 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c3e1e-047c-46a6-ba50-0cac2b1d8dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:18.917737 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3e1e-047c-46a6-ba50-0cac2b1d8dcb admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:18.918024 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3e1e-047c-46a6-ba50-0cac2b1d8dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:18.918306 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c3e1e-047c-46a6-ba50-0cac2b1d8dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:18.919048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c3e1e-047c-46a6-ba50-0cac2b1d8dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:18.920678 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c3e1e-047c-46a6-ba50-0cac2b1d8dcb admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:18.949933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 846/1691] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:18 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:18.953867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c3e1e-047c-46a6-ba50-0cac2b1d8dcb admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:18.967115 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468b489-dfa6-467a-aa4b-ceda63030dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:18.969970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468b489-dfa6-467a-aa4b-ceda63030dce admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:18.970460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468b489-dfa6-467a-aa4b-ceda63030dce admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:18.970784 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5468b489-dfa6-467a-aa4b-ceda63030dce admin admin] PATH_INFO: `/v3/projects/afb0c26610374ca19d4bbfabaff7dbb2/users/15e87d27a6c542ae91ae6b8784159aef/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:18.971001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c3e1e-047c-46a6-ba50-0cac2b1d8dcb admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:18.983153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0750b78a-4ed9-4602-9fe5-cb5972aac1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:18.983863 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750b78a-4ed9-4602-9fe5-cb5972aac1e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:18.984161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750b78a-4ed9-4602-9fe5-cb5972aac1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:18.984451 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0750b78a-4ed9-4602-9fe5-cb5972aac1e4 admin admin] PATH_INFO: `/v3/projects/ee8b18a72cde4a4f9691db679966e179/users/b9786fb83c4c4396a86bc632b252ecfd/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:18.987123 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750b78a-4ed9-4602-9fe5-cb5972aac1e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8b18a72cde4a4f9691db679966e179, user_id=b9786fb83c4c4396a86bc632b252ecfd, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:18.989827 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0750b78a-4ed9-4602-9fe5-cb5972aac1e4 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:19.007269 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468b489-dfa6-467a-aa4b-ceda63030dce admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb0c26610374ca19d4bbfabaff7dbb2, user_id=15e87d27a6c542ae91ae6b8784159aef, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:19.009954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5468b489-dfa6-467a-aa4b-ceda63030dce admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:19.019348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 847/1692] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:18 2022] PUT /identity/v3/projects/ee8b18a72cde4a4f9691db679966e179/users/b9786fb83c4c4396a86bc632b252ecfd/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:49:19.029504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ea8cb-658b-48c2-aaf2-aaad6d7b2845 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:19.029798 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ea8cb-658b-48c2-aaf2-aaad6d7b2845 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:19.030084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ea8cb-658b-48c2-aaf2-aaad6d7b2845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:19.049636 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:19.060873 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 846/1693] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:18 2022] PUT /identity/v3/projects/afb0c26610374ca19d4bbfabaff7dbb2/users/15e87d27a6c542ae91ae6b8784159aef/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:19.062000 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468b489-dfa6-467a-aa4b-ceda63030dce admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:19.090181 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-e81ea8cb-658b-48c2-aaf2-aaad6d7b2845 None None] MFA Rules not processed for user `b9786fb83c4c4396a86bc632b252ecfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:19.095011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e81ea8cb-658b-48c2-aaf2-aaad6d7b2845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:19.181121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:19.213228 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5468b489-dfa6-467a-aa4b-ceda63030dce admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:19.231653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c102d-c9a6-49d6-adef-d495662bc70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:19.232474 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c102d-c9a6-49d6-adef-d495662bc70d admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:19.232743 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c102d-c9a6-49d6-adef-d495662bc70d admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:19.233028 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c102d-c9a6-49d6-adef-d495662bc70d admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:19.234453 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c102d-c9a6-49d6-adef-d495662bc70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:19.236090 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c102d-c9a6-49d6-adef-d495662bc70d admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:19.258071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 847/1694] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:19 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:19.262238 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c102d-c9a6-49d6-adef-d495662bc70d admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:19.281484 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c102d-c9a6-49d6-adef-d495662bc70d admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:19.284490 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 848/1695] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:19 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:49:19.301250 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37df76b4-bb24-4b0c-85f6-dbb5a6375a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:19.302317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df76b4-bb24-4b0c-85f6-dbb5a6375a84 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:19.302558 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df76b4-bb24-4b0c-85f6-dbb5a6375a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:19.302904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37df76b4-bb24-4b0c-85f6-dbb5a6375a84 admin admin] PATH_INFO: `/v3/projects/afb0c26610374ca19d4bbfabaff7dbb2/users/15e87d27a6c542ae91ae6b8784159aef/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:19.305230 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df76b4-bb24-4b0c-85f6-dbb5a6375a84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afb0c26610374ca19d4bbfabaff7dbb2, user_id=15e87d27a6c542ae91ae6b8784159aef, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:19.306015 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ea8cb-658b-48c2-aaf2-aaad6d7b2845 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:19.307746 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e81ea8cb-658b-48c2-aaf2-aaad6d7b2845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:19.312857 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37df76b4-bb24-4b0c-85f6-dbb5a6375a84 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:19.344228 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 848/1696] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:19 2022] PUT /identity/v3/projects/afb0c26610374ca19d4bbfabaff7dbb2/users/15e87d27a6c542ae91ae6b8784159aef/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:49:19.355367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a48194-9c96-4597-b248-ae74a8ee1be1 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:19.355721 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a48194-9c96-4597-b248-ae74a8ee1be1 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:19.356045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a48194-9c96-4597-b248-ae74a8ee1be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:19.411802 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-85a48194-9c96-4597-b248-ae74a8ee1be1 None None] MFA Rules not processed for user `15e87d27a6c542ae91ae6b8784159aef`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:19.413306 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-85a48194-9c96-4597-b248-ae74a8ee1be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:19.451628 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ea8cb-658b-48c2-aaf2-aaad6d7b2845 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:19.510934 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9220dc0-a692-425e-9dc5-4d6f72d383c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:19.511573 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9220dc0-a692-425e-9dc5-4d6f72d383c5 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:19.511855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9220dc0-a692-425e-9dc5-4d6f72d383c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:19.512130 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9220dc0-a692-425e-9dc5-4d6f72d383c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:19.573576 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 849/1697] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:19.591893 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fff6c6-803c-4dfb-b108-dd7b17c21762 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:19.592271 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fff6c6-803c-4dfb-b108-dd7b17c21762 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:19.592637 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fff6c6-803c-4dfb-b108-dd7b17c21762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:19.618472 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9220dc0-a692-425e-9dc5-4d6f72d383c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:19.619941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9220dc0-a692-425e-9dc5-4d6f72d383c5 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:19.631648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 849/1698] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:19 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:49:19.632511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9220dc0-a692-425e-9dc5-4d6f72d383c5 service cinder] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:19.634760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d9220dc0-a692-425e-9dc5-4d6f72d383c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:19.650522 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9220dc0-a692-425e-9dc5-4d6f72d383c5 service cinder] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:19.653259 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-19fff6c6-803c-4dfb-b108-dd7b17c21762 None None] MFA Rules not processed for user `a4ab2aac18054c7e9b2756f6ceb20ca1`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:19.654532 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9ffdb-0155-4f5f-b9c1-4d888a6e5d95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:19.654664 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-19fff6c6-803c-4dfb-b108-dd7b17c21762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:19.655296 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9ffdb-0155-4f5f-b9c1-4d888a6e5d95 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:19.655639 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9ffdb-0155-4f5f-b9c1-4d888a6e5d95 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:19.655967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e9ffdb-0155-4f5f-b9c1-4d888a6e5d95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:19.692653 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:19.733148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9ffdb-0155-4f5f-b9c1-4d888a6e5d95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:19.734726 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e9ffdb-0155-4f5f-b9c1-4d888a6e5d95 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:19.747602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 850/1699] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:19.780072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9ffdb-0155-4f5f-b9c1-4d888a6e5d95 service cinder] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:19.789018 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e9ffdb-0155-4f5f-b9c1-4d888a6e5d95 service cinder] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:19.798799 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3edb46-b9f8-481f-9043-b875163f4bbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:19.799671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3edb46-b9f8-481f-9043-b875163f4bbb service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:19.803170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3edb46-b9f8-481f-9043-b875163f4bbb service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:19.804546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3edb46-b9f8-481f-9043-b875163f4bbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:19.816920 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:19.893054 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 850/1700] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:19 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:19.956857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3edb46-b9f8-481f-9043-b875163f4bbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:19.958402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3edb46-b9f8-481f-9043-b875163f4bbb service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:19.971093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 851/1701] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:19 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:49:20.411250 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fff6c6-803c-4dfb-b108-dd7b17c21762 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:20.412862 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-19fff6c6-803c-4dfb-b108-dd7b17c21762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:20.544548 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fff6c6-803c-4dfb-b108-dd7b17c21762 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:20.554833 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18336c-80a7-4017-ad73-cf06a2a4c857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:20.556747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18336c-80a7-4017-ad73-cf06a2a4c857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:20.557047 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18336c-80a7-4017-ad73-cf06a2a4c857 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:20.559639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18336c-80a7-4017-ad73-cf06a2a4c857 admin admin] PATH_INFO: `/v3/projects/f8a7695b607f42ba9414a93011477162` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:20.561789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18336c-80a7-4017-ad73-cf06a2a4c857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a7695b607f42ba9414a93011477162)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:20.565794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18336c-80a7-4017-ad73-cf06a2a4c857 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:20.669802 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ae18336c-80a7-4017-ad73-cf06a2a4c857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a7695b607f42ba9414a93011477162', 'request_id': 'req-ae18336c-80a7-4017-ad73-cf06a2a4c857'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:20.693715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ae18336c-80a7-4017-ad73-cf06a2a4c857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a7695b607f42ba9414a93011477162', 'request_id': 'req-ae18336c-80a7-4017-ad73-cf06a2a4c857'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:20.717672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ae18336c-80a7-4017-ad73-cf06a2a4c857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a7695b607f42ba9414a93011477162', 'request_id': 'req-ae18336c-80a7-4017-ad73-cf06a2a4c857'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:20.743708 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ae18336c-80a7-4017-ad73-cf06a2a4c857 admin admin] The token cache is being invalidate because project f8a7695b607f42ba9414a93011477162 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:20.744478 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ae18336c-80a7-4017-ad73-cf06a2a4c857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:20.746696 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ae18336c-80a7-4017-ad73-cf06a2a4c857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:20.751717 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 851/1702] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:20 2022] DELETE /identity/v3/projects/f8a7695b607f42ba9414a93011477162 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:20.752572 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca3cf4-576f-424d-8010-24cc8bdbb82b None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:20.753023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca3cf4-576f-424d-8010-24cc8bdbb82b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:20.753118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ca3cf4-576f-424d-8010-24cc8bdbb82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:20.788444 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-49ca3cf4-576f-424d-8010-24cc8bdbb82b None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:20.798567 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-49ca3cf4-576f-424d-8010-24cc8bdbb82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:20.938865 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 852/1703] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:20.944618 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b78f4-61e5-492d-9c22-d62114ee5da5 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:20.945542 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b78f4-61e5-492d-9c22-d62114ee5da5 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:20.945828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b78f4-61e5-492d-9c22-d62114ee5da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:20.997273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-b90b78f4-61e5-492d-9c22-d62114ee5da5 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:20.998610 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-b90b78f4-61e5-492d-9c22-d62114ee5da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:21.012483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 852/1704] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:21.016584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca3cf4-576f-424d-8010-24cc8bdbb82b None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:21.028875 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ca3cf4-576f-424d-8010-24cc8bdbb82b None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:21.037467 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038ebb6-9425-4cc3-bd80-4f5f9b26dba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:21.038982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038ebb6-9425-4cc3-bd80-4f5f9b26dba9 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:21.039677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038ebb6-9425-4cc3-bd80-4f5f9b26dba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:21.040704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c038ebb6-9425-4cc3-bd80-4f5f9b26dba9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:21.042711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038ebb6-9425-4cc3-bd80-4f5f9b26dba9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:21.043139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038ebb6-9425-4cc3-bd80-4f5f9b26dba9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:21.046855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c038ebb6-9425-4cc3-bd80-4f5f9b26dba9 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:21.060420 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 853/1705] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:49:21.064436 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b78f4-61e5-492d-9c22-d62114ee5da5 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:21.077592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b78f4-61e5-492d-9c22-d62114ee5da5 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:21.088798 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69499089-f88c-4b85-a309-3464b9c17add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:21.089469 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69499089-f88c-4b85-a309-3464b9c17add admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:21.089762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69499089-f88c-4b85-a309-3464b9c17add admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:21.090190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69499089-f88c-4b85-a309-3464b9c17add admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:21.090911 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69499089-f88c-4b85-a309-3464b9c17add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:21.093693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69499089-f88c-4b85-a309-3464b9c17add admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:21.163090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038ebb6-9425-4cc3-bd80-4f5f9b26dba9 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:21.172166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 853/1706] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:21 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:21.177877 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c038ebb6-9425-4cc3-bd80-4f5f9b26dba9 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:21.314331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:21.327270 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ea41a-993a-4e1f-ac60-8f46d2d202da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:21.328520 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ea41a-993a-4e1f-ac60-8f46d2d202da admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:21.329081 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ea41a-993a-4e1f-ac60-8f46d2d202da admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:21.329646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677ea41a-993a-4e1f-ac60-8f46d2d202da admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:21.330619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ea41a-993a-4e1f-ac60-8f46d2d202da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:21.335255 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677ea41a-993a-4e1f-ac60-8f46d2d202da admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:21.410755 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69499089-f88c-4b85-a309-3464b9c17add admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:21.420074 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 854/1707] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:21 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:49:21.427457 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69499089-f88c-4b85-a309-3464b9c17add admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:21.443496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61dd4a-058b-4353-8593-4e7f16a9d0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:21.444728 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61dd4a-058b-4353-8593-4e7f16a9d0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:21.445024 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61dd4a-058b-4353-8593-4e7f16a9d0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:21.447219 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61dd4a-058b-4353-8593-4e7f16a9d0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:21.448017 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61dd4a-058b-4353-8593-4e7f16a9d0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:21.454201 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61dd4a-058b-4353-8593-4e7f16a9d0a1 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:21.490369 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ea41a-993a-4e1f-ac60-8f46d2d202da admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:21.502372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 854/1708] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:21.506060 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677ea41a-993a-4e1f-ac60-8f46d2d202da admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:21.524953 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe73ea7-a360-4c21-b251-f8b6b85b470f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:21.526810 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe73ea7-a360-4c21-b251-f8b6b85b470f admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:21.528514 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe73ea7-a360-4c21-b251-f8b6b85b470f admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:21.528951 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe73ea7-a360-4c21-b251-f8b6b85b470f admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:21.531137 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe73ea7-a360-4c21-b251-f8b6b85b470f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:21.535428 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe73ea7-a360-4c21-b251-f8b6b85b470f admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:21.566441 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 855/1709] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:21 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:49:21.570373 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61dd4a-058b-4353-8593-4e7f16a9d0a1 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:21.622565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61dd4a-058b-4353-8593-4e7f16a9d0a1 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:21.666230 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6450677-899e-483e-a164-3c33cf90b7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:21.667181 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6450677-899e-483e-a164-3c33cf90b7f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:21.667613 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6450677-899e-483e-a164-3c33cf90b7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:21.668036 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6450677-899e-483e-a164-3c33cf90b7f6 admin admin] PATH_INFO: `/v3/projects/4ede8e984b3e4b40808a30409cb15685/users/12eb6b98ed1f4d8a8d004c03a7c0f8c6/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:21.691716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82059b67-55d2-4cc2-adee-40dca114215c None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:21.692106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82059b67-55d2-4cc2-adee-40dca114215c None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:21.692587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82059b67-55d2-4cc2-adee-40dca114215c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:21.717794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6450677-899e-483e-a164-3c33cf90b7f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ede8e984b3e4b40808a30409cb15685, user_id=12eb6b98ed1f4d8a8d004c03a7c0f8c6, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:21.721686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6450677-899e-483e-a164-3c33cf90b7f6 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:21.765111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 855/1710] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:21 2022] PUT /identity/v3/projects/4ede8e984b3e4b40808a30409cb15685/users/12eb6b98ed1f4d8a8d004c03a7c0f8c6/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:21.777316 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b4206-5294-4da2-9aa8-4fb3e887c125 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:21.777615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b4206-5294-4da2-9aa8-4fb3e887c125 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:21.777976 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b4206-5294-4da2-9aa8-4fb3e887c125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:21.802872 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-82059b67-55d2-4cc2-adee-40dca114215c None None] MFA Rules not processed for user `0de16e13f2f948698e9174fcf1e0a3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:21.804210 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-82059b67-55d2-4cc2-adee-40dca114215c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:21.850542 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-6b6b4206-5294-4da2-9aa8-4fb3e887c125 None None] MFA Rules not processed for user `12eb6b98ed1f4d8a8d004c03a7c0f8c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:21.853333 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6b6b4206-5294-4da2-9aa8-4fb3e887c125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:21.861334 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:22.060829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 856/1711] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:22.066065 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 856/1712] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:49:22.072541 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82059b67-55d2-4cc2-adee-40dca114215c None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:22.087149 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b4206-5294-4da2-9aa8-4fb3e887c125 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:22.088888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6b6b4206-5294-4da2-9aa8-4fb3e887c125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:22.146107 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82059b67-55d2-4cc2-adee-40dca114215c None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:22.163074 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae5ee8-8bc3-44b4-ae47-eb40fbece070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:22.163734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae5ee8-8bc3-44b4-ae47-eb40fbece070 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:22.164033 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae5ee8-8bc3-44b4-ae47-eb40fbece070 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:22.164318 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae5ee8-8bc3-44b4-ae47-eb40fbece070 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:22.166170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae5ee8-8bc3-44b4-ae47-eb40fbece070 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:22.170912 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae5ee8-8bc3-44b4-ae47-eb40fbece070 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:22.226248 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 857/1713] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:22 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:22.228452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae5ee8-8bc3-44b4-ae47-eb40fbece070 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:22.245410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b4206-5294-4da2-9aa8-4fb3e887c125 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:22.390062 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:22.392868 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082ec91-7f9d-4952-b686-877daf911c4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:22.393683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082ec91-7f9d-4952-b686-877daf911c4f service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:22.393964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082ec91-7f9d-4952-b686-877daf911c4f service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:22.394256 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082ec91-7f9d-4952-b686-877daf911c4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:22.424529 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae5ee8-8bc3-44b4-ae47-eb40fbece070 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:22.439871 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59547098-2531-400e-b09e-7db23b6a9883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:22.440535 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59547098-2531-400e-b09e-7db23b6a9883 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:22.440824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59547098-2531-400e-b09e-7db23b6a9883 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:22.441102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59547098-2531-400e-b09e-7db23b6a9883 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:22.441784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59547098-2531-400e-b09e-7db23b6a9883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:22.453059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59547098-2531-400e-b09e-7db23b6a9883 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:22.492936 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:22.523005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 858/1714] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:22 2022] POST /identity/v3/users => generated 297 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:22.527422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59547098-2531-400e-b09e-7db23b6a9883 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:22.534499 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082ec91-7f9d-4952-b686-877daf911c4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:22.536942 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082ec91-7f9d-4952-b686-877daf911c4f service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:22.551643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59547098-2531-400e-b09e-7db23b6a9883 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:22.560884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 857/1715] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:49:22.577049 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c214a-6dd0-46f3-9a1a-db1bad82fbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:22.577049 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c214a-6dd0-46f3-9a1a-db1bad82fbb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:22.577338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c214a-6dd0-46f3-9a1a-db1bad82fbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:22.577577 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c214a-6dd0-46f3-9a1a-db1bad82fbb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:22.582460 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c214a-6dd0-46f3-9a1a-db1bad82fbb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:22.584206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c214a-6dd0-46f3-9a1a-db1bad82fbb3 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:22.619137 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 859/1716] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:49:22.623533 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082ec91-7f9d-4952-b686-877daf911c4f service nova] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:22.642179 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082ec91-7f9d-4952-b686-877daf911c4f service nova] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:22.657682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d250a-dea9-4ca4-ac13-f164382e6b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:22.658515 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d250a-dea9-4ca4-ac13-f164382e6b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:22.658859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d250a-dea9-4ca4-ac13-f164382e6b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:22.659150 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d250a-dea9-4ca4-ac13-f164382e6b31 admin admin] PATH_INFO: `/v3/projects/1b18ebf23ec249098bf8508ce7ed3c7d/users/f4071af2115f4ee481304c84ac958807/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:22.698410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d250a-dea9-4ca4-ac13-f164382e6b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b18ebf23ec249098bf8508ce7ed3c7d, user_id=f4071af2115f4ee481304c84ac958807, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:22.703736 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d250a-dea9-4ca4-ac13-f164382e6b31 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:22.739674 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 858/1717] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:22 2022] PUT /identity/v3/projects/1b18ebf23ec249098bf8508ce7ed3c7d/users/f4071af2115f4ee481304c84ac958807/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:22.739982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c214a-6dd0-46f3-9a1a-db1bad82fbb3 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:22.764474 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c214a-6dd0-46f3-9a1a-db1bad82fbb3 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:22.956500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f3fdd-cbaa-4f7a-ab77-c4c37f114b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:22.958612 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f3fdd-cbaa-4f7a-ab77-c4c37f114b60 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:22.962278 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f3fdd-cbaa-4f7a-ab77-c4c37f114b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:22.963216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f3fdd-cbaa-4f7a-ab77-c4c37f114b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:22.964118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f3fdd-cbaa-4f7a-ab77-c4c37f114b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:22.969634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f3fdd-cbaa-4f7a-ab77-c4c37f114b60 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:22.985352 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 860/1718] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:22 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:22.989533 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d250a-dea9-4ca4-ac13-f164382e6b31 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:23.010398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d250a-dea9-4ca4-ac13-f164382e6b31 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:23.021967 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205cf7e1-91a3-4df7-b491-2217d714da73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:23.033719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cf7e1-91a3-4df7-b491-2217d714da73 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:23.033719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cf7e1-91a3-4df7-b491-2217d714da73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:23.033719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205cf7e1-91a3-4df7-b491-2217d714da73 admin admin] PATH_INFO: `/v3/projects/1b18ebf23ec249098bf8508ce7ed3c7d/users/f4071af2115f4ee481304c84ac958807/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:23.034527 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205cf7e1-91a3-4df7-b491-2217d714da73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b18ebf23ec249098bf8508ce7ed3c7d, user_id=f4071af2115f4ee481304c84ac958807, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:23.036699 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2b297-3cbb-4fbb-94e5-b341a417aa6c None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:23.037082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2b297-3cbb-4fbb-94e5-b341a417aa6c None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:23.037507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2b297-3cbb-4fbb-94e5-b341a417aa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:23.042011 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205cf7e1-91a3-4df7-b491-2217d714da73 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:23.127334 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 859/1719] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:22 2022] PUT /identity/v3/projects/1b18ebf23ec249098bf8508ce7ed3c7d/users/f4071af2115f4ee481304c84ac958807/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:23.131286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09045cd-54d7-4edd-afe8-53fe37502c30 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:23.135258 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09045cd-54d7-4edd-afe8-53fe37502c30 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:23.136046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09045cd-54d7-4edd-afe8-53fe37502c30 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:23.142920 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 860/1720] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 22:49:23 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:49:23.145601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792843a-45fe-43b3-a37f-43ba9b7a53e6 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:23.147576 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792843a-45fe-43b3-a37f-43ba9b7a53e6 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:23.153796 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792843a-45fe-43b3-a37f-43ba9b7a53e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:23.176543 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-29e2b297-3cbb-4fbb-94e5-b341a417aa6c None None] MFA Rules not processed for user `7276ed630a694d0f844aa402169b938d`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:23.180143 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-29e2b297-3cbb-4fbb-94e5-b341a417aa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:23.245725 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-8792843a-45fe-43b3-a37f-43ba9b7a53e6 None None] MFA Rules not processed for user `f4071af2115f4ee481304c84ac958807`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:23.250578 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8792843a-45fe-43b3-a37f-43ba9b7a53e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:23.346413 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 861/1721] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:23.362242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2b297-3cbb-4fbb-94e5-b341a417aa6c None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:23.364259 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-29e2b297-3cbb-4fbb-94e5-b341a417aa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:23.421186 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 861/1722] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:23.433439 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792843a-45fe-43b3-a37f-43ba9b7a53e6 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:23.435647 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8792843a-45fe-43b3-a37f-43ba9b7a53e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:23.515872 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:23.614711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2b297-3cbb-4fbb-94e5-b341a417aa6c None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:23.616991 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792843a-45fe-43b3-a37f-43ba9b7a53e6 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:23.628904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0168b762-1e0b-4db3-b195-95f91ebc8d9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:23.629886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168b762-1e0b-4db3-b195-95f91ebc8d9c service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:23.630298 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168b762-1e0b-4db3-b195-95f91ebc8d9c service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:23.631135 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0168b762-1e0b-4db3-b195-95f91ebc8d9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:23.642445 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608c5b9-3792-41fd-ace7-eb3f6670355f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:23.643138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608c5b9-3792-41fd-ace7-eb3f6670355f service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:23.645621 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608c5b9-3792-41fd-ace7-eb3f6670355f service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:23.646189 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d608c5b9-3792-41fd-ace7-eb3f6670355f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:23.669472 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168b762-1e0b-4db3-b195-95f91ebc8d9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:23.672859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0168b762-1e0b-4db3-b195-95f91ebc8d9c service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:23.673354 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608c5b9-3792-41fd-ace7-eb3f6670355f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:23.677116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d608c5b9-3792-41fd-ace7-eb3f6670355f service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:23.698705 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 862/1723] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:23.702222 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 862/1724] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:49:23.703739 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f2efa-dda1-4eab-99b7-6f16e0fa9f5e None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:23.704185 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f2efa-dda1-4eab-99b7-6f16e0fa9f5e None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:23.704564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f2efa-dda1-4eab-99b7-6f16e0fa9f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:23.751404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-661f2efa-dda1-4eab-99b7-6f16e0fa9f5e None None] MFA Rules not processed for user `2e3a1384f3b34999a75572ee10a1e3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:23.754122 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-661f2efa-dda1-4eab-99b7-6f16e0fa9f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:23.882875 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:23.951109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608c5b9-3792-41fd-ace7-eb3f6670355f service nova] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:23.982445 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d608c5b9-3792-41fd-ace7-eb3f6670355f service nova] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:23.999617 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6eae17-9493-484b-9754-15581eeb7e47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:24.002120 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6eae17-9493-484b-9754-15581eeb7e47 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:24.003448 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6eae17-9493-484b-9754-15581eeb7e47 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:24.004710 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6eae17-9493-484b-9754-15581eeb7e47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:24.047357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 863/1725] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 22:49:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:24.083760 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dbeb7-7c7e-4dfe-981a-d90a52009d81 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:24.084224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dbeb7-7c7e-4dfe-981a-d90a52009d81 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:24.084684 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923dbeb7-7c7e-4dfe-981a-d90a52009d81 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:24.088027 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 864/1726] 10.222.0.48 () {54 vars in 961 bytes} [Wed Jul 27 22:49:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 22:49:24.094022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628659b1-bd35-4403-b3de-9d6380b8e258 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:24.094439 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628659b1-bd35-4403-b3de-9d6380b8e258 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:24.094786 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628659b1-bd35-4403-b3de-9d6380b8e258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:24.164255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-628659b1-bd35-4403-b3de-9d6380b8e258 None None] MFA Rules not processed for user `2e3a1384f3b34999a75572ee10a1e3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:24.167220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-628659b1-bd35-4403-b3de-9d6380b8e258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:24.195144 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 865/1727] 10.222.0.48 () {58 vars in 1058 bytes} [Wed Jul 27 22:49:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:49:24.196908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ed23d-c290-4031-ae0d-7b629c109af6 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:24.197609 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ed23d-c290-4031-ae0d-7b629c109af6 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:24.198073 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598ed23d-c290-4031-ae0d-7b629c109af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:24.267027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6eae17-9493-484b-9754-15581eeb7e47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:24.268674 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6eae17-9493-484b-9754-15581eeb7e47 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:24.290958 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-598ed23d-c290-4031-ae0d-7b629c109af6 None None] MFA Rules not processed for user `7e7b9e21971c432b9f23ceee4c5b7a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:24.295205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-598ed23d-c290-4031-ae0d-7b629c109af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:24.299047 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 863/1728] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:24.320607 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6eae17-9493-484b-9754-15581eeb7e47 service cinder] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:24.377025 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6eae17-9493-484b-9754-15581eeb7e47 service cinder] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:24.418843 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cae4a-7041-4b62-8104-71f0f5982f00 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a1384f3b34999a75572ee10a1e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:24.418843 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cae4a-7041-4b62-8104-71f0f5982f00 service placement] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:24.418843 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cae4a-7041-4b62-8104-71f0f5982f00 service placement] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:24.418843 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334cae4a-7041-4b62-8104-71f0f5982f00 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:24.458629 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cae4a-7041-4b62-8104-71f0f5982f00 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:24.460336 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334cae4a-7041-4b62-8104-71f0f5982f00 service placement] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:24.504362 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 864/1729] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:24.505242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cae4a-7041-4b62-8104-71f0f5982f00 service placement] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:24.536353 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-334cae4a-7041-4b62-8104-71f0f5982f00 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:24.567339 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 866/1730] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:24.580723 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3951e-73f5-4d75-bf67-c27c62549fbb None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:24.583606 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334cae4a-7041-4b62-8104-71f0f5982f00 service placement] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:24.584229 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3951e-73f5-4d75-bf67-c27c62549fbb None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:24.584723 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3951e-73f5-4d75-bf67-c27c62549fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:24.595265 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3d4d83-1059-4463-8882-5f3bc0ec576b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:24.596173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d4d83-1059-4463-8882-5f3bc0ec576b service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:24.596470 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d4d83-1059-4463-8882-5f3bc0ec576b service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:24.596756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d4d83-1059-4463-8882-5f3bc0ec576b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:24.603336 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-df3d4d83-1059-4463-8882-5f3bc0ec576b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:24.651505 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-99b3951e-73f5-4d75-bf67-c27c62549fbb None None] MFA Rules not processed for user `7e7b9e21971c432b9f23ceee4c5b7a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:24.652884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-99b3951e-73f5-4d75-bf67-c27c62549fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:24.686653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 867/1731] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:24.694597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3951e-73f5-4d75-bf67-c27c62549fbb None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:24.715510 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3951e-73f5-4d75-bf67-c27c62549fbb None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:24.751786 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a0837-5ce0-4374-8071-e2d222d6c8c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:24.752435 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a0837-5ce0-4374-8071-e2d222d6c8c4 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:24.752726 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a0837-5ce0-4374-8071-e2d222d6c8c4 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:24.753002 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a0837-5ce0-4374-8071-e2d222d6c8c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:24.783018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a0837-5ce0-4374-8071-e2d222d6c8c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:24.792285 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6a0837-5ce0-4374-8071-e2d222d6c8c4 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:24.824327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 868/1732] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:24.851678 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d4d83-1059-4463-8882-5f3bc0ec576b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:24.853191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3d4d83-1059-4463-8882-5f3bc0ec576b service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:24.890247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 865/1733] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:24 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:26.101300 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b846ff-a993-45d7-a861-6e8da5a49888 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:26.101899 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b846ff-a993-45d7-a861-6e8da5a49888 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:26.101899 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b846ff-a993-45d7-a861-6e8da5a49888 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:26.104053 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 869/1734] 10.222.0.48 () {54 vars in 912 bytes} [Wed Jul 27 22:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:49:26.110437 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1f705-e6ac-4b1e-bb73-5f85e4214013 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:26.110990 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1f705-e6ac-4b1e-bb73-5f85e4214013 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:26.111322 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc1f705-e6ac-4b1e-bb73-5f85e4214013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:26.238422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-5cc1f705-e6ac-4b1e-bb73-5f85e4214013 None None] MFA Rules not processed for user `c266721767004428b9b54dd200f3cd6b`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:26.239890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5cc1f705-e6ac-4b1e-bb73-5f85e4214013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:26.434082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:26.462167 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 866/1735] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 22:49:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:26.507818 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b846ff-a993-45d7-a861-6e8da5a49888 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:26.511025 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a9b846ff-a993-45d7-a861-6e8da5a49888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:26.543279 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b846ff-a993-45d7-a861-6e8da5a49888 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:26.550756 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de058541-8e72-42d5-867c-1e4e3f85c3ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:26.552819 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de058541-8e72-42d5-867c-1e4e3f85c3ca service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:26.553153 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de058541-8e72-42d5-867c-1e4e3f85c3ca service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:26.554582 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de058541-8e72-42d5-867c-1e4e3f85c3ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:26.579767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de058541-8e72-42d5-867c-1e4e3f85c3ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:26.585138 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de058541-8e72-42d5-867c-1e4e3f85c3ca service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:26.617197 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 870/1736] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:26.931882 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1f705-e6ac-4b1e-bb73-5f85e4214013 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:26.933910 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5cc1f705-e6ac-4b1e-bb73-5f85e4214013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:27.095129 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc1f705-e6ac-4b1e-bb73-5f85e4214013 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:27.103185 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f0c56-0b5d-4c91-8983-5f0d04c2ef54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:27.104721 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f0c56-0b5d-4c91-8983-5f0d04c2ef54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:27.105136 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f0c56-0b5d-4c91-8983-5f0d04c2ef54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:27.105486 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231f0c56-0b5d-4c91-8983-5f0d04c2ef54 admin admin] PATH_INFO: `/v3/users/78baf5bebf864c6daa8944297effd304` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:27.107121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f0c56-0b5d-4c91-8983-5f0d04c2ef54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78baf5bebf864c6daa8944297effd304)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:27.113660 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231f0c56-0b5d-4c91-8983-5f0d04c2ef54 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:27.247482 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-231f0c56-0b5d-4c91-8983-5f0d04c2ef54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78baf5bebf864c6daa8944297effd304'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:27.248457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-231f0c56-0b5d-4c91-8983-5f0d04c2ef54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78baf5bebf864c6daa8944297effd304'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:27.259939 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-231f0c56-0b5d-4c91-8983-5f0d04c2ef54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78baf5bebf864c6daa8944297effd304'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:27.306040 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-231f0c56-0b5d-4c91-8983-5f0d04c2ef54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78baf5bebf864c6daa8944297effd304'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:27.306867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-231f0c56-0b5d-4c91-8983-5f0d04c2ef54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78baf5bebf864c6daa8944297effd304'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:27.325928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 867/1737] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:26 2022] DELETE /identity/v3/users/78baf5bebf864c6daa8944297effd304 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:27.766087 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de058541-8e72-42d5-867c-1e4e3f85c3ca service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:27.792922 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de058541-8e72-42d5-867c-1e4e3f85c3ca service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:27.906263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f0c56-0b5d-4c91-8983-5f0d04c2ef54 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:27.908118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-231f0c56-0b5d-4c91-8983-5f0d04c2ef54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:27.957870 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c4765d-0b56-4a14-b2f5-031e050645d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a1384f3b34999a75572ee10a1e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:27.960141 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4765d-0b56-4a14-b2f5-031e050645d1 service placement] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:27.961253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4765d-0b56-4a14-b2f5-031e050645d1 service placement] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:27.962465 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c4765d-0b56-4a14-b2f5-031e050645d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:27.968725 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-82c4765d-0b56-4a14-b2f5-031e050645d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:27.995759 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4765d-0b56-4a14-b2f5-031e050645d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:27.997866 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c4765d-0b56-4a14-b2f5-031e050645d1 service placement] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:28.029422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231f0c56-0b5d-4c91-8983-5f0d04c2ef54 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:28.035633 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e37d2d-b7eb-4359-b49e-7a736fcbc467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:28.036678 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e37d2d-b7eb-4359-b49e-7a736fcbc467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:28.037330 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e37d2d-b7eb-4359-b49e-7a736fcbc467 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:28.037814 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e37d2d-b7eb-4359-b49e-7a736fcbc467 admin admin] PATH_INFO: `/v3/users/12eb6b98ed1f4d8a8d004c03a7c0f8c6` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:28.039711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e37d2d-b7eb-4359-b49e-7a736fcbc467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12eb6b98ed1f4d8a8d004c03a7c0f8c6)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:28.042481 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e37d2d-b7eb-4359-b49e-7a736fcbc467 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:28.048919 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 871/1738] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:28.055743 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41271069-a093-41fc-89ed-1ea41813d9ca None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:28.056751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41271069-a093-41fc-89ed-1ea41813d9ca None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:28.057045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41271069-a093-41fc-89ed-1ea41813d9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:28.095486 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:28.137101 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-41271069-a093-41fc-89ed-1ea41813d9ca None None] MFA Rules not processed for user `7e7b9e21971c432b9f23ceee4c5b7a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:28.140695 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-41271069-a093-41fc-89ed-1ea41813d9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:28.153223 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:28.203490 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-97e37d2d-b7eb-4359-b49e-7a736fcbc467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12eb6b98ed1f4d8a8d004c03a7c0f8c6'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:28.204681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-97e37d2d-b7eb-4359-b49e-7a736fcbc467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12eb6b98ed1f4d8a8d004c03a7c0f8c6'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:28.229175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-97e37d2d-b7eb-4359-b49e-7a736fcbc467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12eb6b98ed1f4d8a8d004c03a7c0f8c6'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:28.276244 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-97e37d2d-b7eb-4359-b49e-7a736fcbc467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12eb6b98ed1f4d8a8d004c03a7c0f8c6'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:28.278984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-97e37d2d-b7eb-4359-b49e-7a736fcbc467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12eb6b98ed1f4d8a8d004c03a7c0f8c6'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:28.307236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 872/1739] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:28.308933 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d31a24-1b66-496f-9e65-4fd8d328cab7 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:28.309251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d31a24-1b66-496f-9e65-4fd8d328cab7 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:28.309527 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d31a24-1b66-496f-9e65-4fd8d328cab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:28.338395 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 868/1740] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:27 2022] DELETE /identity/v3/users/12eb6b98ed1f4d8a8d004c03a7c0f8c6 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:49:28.344087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b32cf0-bee6-436b-a522-0fc0cff20a88 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:28.345367 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b32cf0-bee6-436b-a522-0fc0cff20a88 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:28.345367 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b32cf0-bee6-436b-a522-0fc0cff20a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:28.374554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-18d31a24-1b66-496f-9e65-4fd8d328cab7 None None] MFA Rules not processed for user `0de16e13f2f948698e9174fcf1e0a3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:28.379840 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-18d31a24-1b66-496f-9e65-4fd8d328cab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:28.417202 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-53b32cf0-bee6-436b-a522-0fc0cff20a88 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:28.418877 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-53b32cf0-bee6-436b-a522-0fc0cff20a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:28.565919 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 873/1741] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:28.580542 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d31a24-1b66-496f-9e65-4fd8d328cab7 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:28.583676 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-18d31a24-1b66-496f-9e65-4fd8d328cab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:28.710677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 869/1742] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:28.756297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b32cf0-bee6-436b-a522-0fc0cff20a88 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:28.760114 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-53b32cf0-bee6-436b-a522-0fc0cff20a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:28.826279 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d31a24-1b66-496f-9e65-4fd8d328cab7 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:28.842957 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e93439-2ad8-4800-963b-5761f13cec60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:28.845808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e93439-2ad8-4800-963b-5761f13cec60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:28.846778 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e93439-2ad8-4800-963b-5761f13cec60 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:28.856678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e93439-2ad8-4800-963b-5761f13cec60 admin admin] PATH_INFO: `/v3/projects/c0bb2e1488c640ee916b734644191080` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:28.860471 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e93439-2ad8-4800-963b-5761f13cec60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0bb2e1488c640ee916b734644191080)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:28.889329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e93439-2ad8-4800-963b-5761f13cec60 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:28.955262 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b32cf0-bee6-436b-a522-0fc0cff20a88 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:28.960167 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7dbb3-37e3-485f-bdb2-b9a5fb5dd19c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:28.966855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7dbb3-37e3-485f-bdb2-b9a5fb5dd19c service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:28.967394 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7dbb3-37e3-485f-bdb2-b9a5fb5dd19c service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:28.967780 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b7dbb3-37e3-485f-bdb2-b9a5fb5dd19c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:28.996378 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7dbb3-37e3-485f-bdb2-b9a5fb5dd19c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:28.998107 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b7dbb3-37e3-485f-bdb2-b9a5fb5dd19c service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:29.044159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 870/1743] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:29.073906 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-14e93439-2ad8-4800-963b-5761f13cec60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0bb2e1488c640ee916b734644191080', 'request_id': 'req-14e93439-2ad8-4800-963b-5761f13cec60'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:29.105163 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-14e93439-2ad8-4800-963b-5761f13cec60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0bb2e1488c640ee916b734644191080', 'request_id': 'req-14e93439-2ad8-4800-963b-5761f13cec60'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:29.112314 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:29.136940 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-14e93439-2ad8-4800-963b-5761f13cec60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0bb2e1488c640ee916b734644191080', 'request_id': 'req-14e93439-2ad8-4800-963b-5761f13cec60'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:29.169926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-14e93439-2ad8-4800-963b-5761f13cec60 admin admin] The token cache is being invalidate because project c0bb2e1488c640ee916b734644191080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:29.170613 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-14e93439-2ad8-4800-963b-5761f13cec60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:29.173386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-14e93439-2ad8-4800-963b-5761f13cec60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:29.189374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 874/1744] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:28 2022] DELETE /identity/v3/projects/c0bb2e1488c640ee916b734644191080 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:29.190194 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7dbb3-37e3-485f-bdb2-b9a5fb5dd19c service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:29.212994 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b7dbb3-37e3-485f-bdb2-b9a5fb5dd19c service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:29.348098 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:29.405778 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b170c-79af-4a04-a18b-623846c8a2c8 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:29.406320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b170c-79af-4a04-a18b-623846c8a2c8 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:29.406633 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b170c-79af-4a04-a18b-623846c8a2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:29.410788 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f417fd-c6c3-42ba-bd9a-4455e09fc1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:29.411793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f417fd-c6c3-42ba-bd9a-4455e09fc1f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:29.412247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f417fd-c6c3-42ba-bd9a-4455e09fc1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:29.412877 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f417fd-c6c3-42ba-bd9a-4455e09fc1f1 admin admin] PATH_INFO: `/v3/users/a4ab2aac18054c7e9b2756f6ceb20ca1` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:29.415342 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f417fd-c6c3-42ba-bd9a-4455e09fc1f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ab2aac18054c7e9b2756f6ceb20ca1)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:29.421497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f417fd-c6c3-42ba-bd9a-4455e09fc1f1 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:29.533823 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-d66b170c-79af-4a04-a18b-623846c8a2c8 None None] MFA Rules not processed for user `16e9ba7fa4c74a5ea1204daa44e03f28`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:29.538899 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d66b170c-79af-4a04-a18b-623846c8a2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:29.591380 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-05f417fd-c6c3-42ba-bd9a-4455e09fc1f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ab2aac18054c7e9b2756f6ceb20ca1'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:29.594804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-05f417fd-c6c3-42ba-bd9a-4455e09fc1f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ab2aac18054c7e9b2756f6ceb20ca1'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:29.613346 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-05f417fd-c6c3-42ba-bd9a-4455e09fc1f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ab2aac18054c7e9b2756f6ceb20ca1'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:29.655923 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-05f417fd-c6c3-42ba-bd9a-4455e09fc1f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ab2aac18054c7e9b2756f6ceb20ca1'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:29.657611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-05f417fd-c6c3-42ba-bd9a-4455e09fc1f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ab2aac18054c7e9b2756f6ceb20ca1'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:29.696812 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 871/1745] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:29 2022] DELETE /identity/v3/users/a4ab2aac18054c7e9b2756f6ceb20ca1 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:29.826296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 875/1746] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:49:29.840602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65c198-7373-493b-b363-8257046905d1 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:29.840996 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65c198-7373-493b-b363-8257046905d1 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:29.841411 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65c198-7373-493b-b363-8257046905d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:29.895471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-7d65c198-7373-493b-b363-8257046905d1 None None] MFA Rules not processed for user `16e9ba7fa4c74a5ea1204daa44e03f28`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:29.901025 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-7d65c198-7373-493b-b363-8257046905d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:30.169116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 872/1747] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:30.553513 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b170c-79af-4a04-a18b-623846c8a2c8 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:30.555722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d66b170c-79af-4a04-a18b-623846c8a2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:30.587874 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b170c-79af-4a04-a18b-623846c8a2c8 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:30.723393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197f11d-f629-4a46-8d42-70438fe5633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:30.724556 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197f11d-f629-4a46-8d42-70438fe5633e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:30.724886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197f11d-f629-4a46-8d42-70438fe5633e admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:30.725171 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197f11d-f629-4a46-8d42-70438fe5633e admin admin] PATH_INFO: `/v3/projects/4ede8e984b3e4b40808a30409cb15685` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:30.729488 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197f11d-f629-4a46-8d42-70438fe5633e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ede8e984b3e4b40808a30409cb15685)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:30.736779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197f11d-f629-4a46-8d42-70438fe5633e admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:30.765195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65c198-7373-493b-b363-8257046905d1 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:30.768095 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-7d65c198-7373-493b-b363-8257046905d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:30.795913 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65c198-7373-493b-b363-8257046905d1 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:30.808606 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fd184-e40c-439b-a9e7-5d5bbdc30a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:30.809580 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fd184-e40c-439b-a9e7-5d5bbdc30a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:30.810055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fd184-e40c-439b-a9e7-5d5bbdc30a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:30.811589 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fd184-e40c-439b-a9e7-5d5bbdc30a74 admin admin] PATH_INFO: `/v3/projects/9e9d56215f754148931a220046bec2ba` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:30.814489 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fd184-e40c-439b-a9e7-5d5bbdc30a74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e9d56215f754148931a220046bec2ba)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:30.818925 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fd184-e40c-439b-a9e7-5d5bbdc30a74 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:30.847516 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8197f11d-f629-4a46-8d42-70438fe5633e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ede8e984b3e4b40808a30409cb15685', 'request_id': 'req-8197f11d-f629-4a46-8d42-70438fe5633e'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:30.863388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8197f11d-f629-4a46-8d42-70438fe5633e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ede8e984b3e4b40808a30409cb15685', 'request_id': 'req-8197f11d-f629-4a46-8d42-70438fe5633e'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:30.876938 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8197f11d-f629-4a46-8d42-70438fe5633e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ede8e984b3e4b40808a30409cb15685', 'request_id': 'req-8197f11d-f629-4a46-8d42-70438fe5633e'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:30.909413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8197f11d-f629-4a46-8d42-70438fe5633e admin admin] The token cache is being invalidate because project 4ede8e984b3e4b40808a30409cb15685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:30.911384 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8197f11d-f629-4a46-8d42-70438fe5633e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:30.912781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8197f11d-f629-4a46-8d42-70438fe5633e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:30.921433 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 876/1748] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:30 2022] DELETE /identity/v3/projects/4ede8e984b3e4b40808a30409cb15685 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:30.924293 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f21fd184-e40c-439b-a9e7-5d5bbdc30a74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e9d56215f754148931a220046bec2ba', 'request_id': 'req-f21fd184-e40c-439b-a9e7-5d5bbdc30a74'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:30.933868 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197f11d-f629-4a46-8d42-70438fe5633e admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:30.939560 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f21fd184-e40c-439b-a9e7-5d5bbdc30a74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e9d56215f754148931a220046bec2ba', 'request_id': 'req-f21fd184-e40c-439b-a9e7-5d5bbdc30a74'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:30.941336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8197f11d-f629-4a46-8d42-70438fe5633e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:30.960777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:30.971004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f21fd184-e40c-439b-a9e7-5d5bbdc30a74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e9d56215f754148931a220046bec2ba', 'request_id': 'req-f21fd184-e40c-439b-a9e7-5d5bbdc30a74'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:30.986654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:31.037816 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f21fd184-e40c-439b-a9e7-5d5bbdc30a74 admin admin] The token cache is being invalidate because project 9e9d56215f754148931a220046bec2ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:31.038115 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f21fd184-e40c-439b-a9e7-5d5bbdc30a74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:31.040273 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f21fd184-e40c-439b-a9e7-5d5bbdc30a74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:31.053534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 873/1749] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:30 2022] DELETE /identity/v3/projects/9e9d56215f754148931a220046bec2ba => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:31.055051 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fd184-e40c-439b-a9e7-5d5bbdc30a74 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:31.057611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-f21fd184-e40c-439b-a9e7-5d5bbdc30a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:31.135260 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197f11d-f629-4a46-8d42-70438fe5633e admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:31.229828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fd184-e40c-439b-a9e7-5d5bbdc30a74 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:31.260407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b57150b-3b54-4e81-a30b-36e4736b2f4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:31.261906 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57150b-3b54-4e81-a30b-36e4736b2f4a service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:31.261906 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57150b-3b54-4e81-a30b-36e4736b2f4a service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:31.261906 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b57150b-3b54-4e81-a30b-36e4736b2f4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:31.267033 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-9b57150b-3b54-4e81-a30b-36e4736b2f4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:31.346147 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a53a80-2cb8-4786-b200-a5c54d577551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:31.347940 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53a80-2cb8-4786-b200-a5c54d577551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:31.349474 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53a80-2cb8-4786-b200-a5c54d577551 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:31.350233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a53a80-2cb8-4786-b200-a5c54d577551 admin admin] PATH_INFO: `/v3/users/f4071af2115f4ee481304c84ac958807` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:31.351986 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a53a80-2cb8-4786-b200-a5c54d577551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4071af2115f4ee481304c84ac958807)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:31.354958 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a53a80-2cb8-4786-b200-a5c54d577551 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:31.402227 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57150b-3b54-4e81-a30b-36e4736b2f4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:31.404904 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b57150b-3b54-4e81-a30b-36e4736b2f4a service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:31.426230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 874/1750] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:31.427797 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c6fe7-5136-4d2a-80c5-50ddfdebff1d None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:31.428851 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c6fe7-5136-4d2a-80c5-50ddfdebff1d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:31.429131 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c6fe7-5136-4d2a-80c5-50ddfdebff1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:31.458029 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-d2a53a80-2cb8-4786-b200-a5c54d577551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4071af2115f4ee481304c84ac958807'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:31.460959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-d2a53a80-2cb8-4786-b200-a5c54d577551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4071af2115f4ee481304c84ac958807'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:31.469937 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-5c6c6fe7-5136-4d2a-80c5-50ddfdebff1d None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:31.471548 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5c6c6fe7-5136-4d2a-80c5-50ddfdebff1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:31.491533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 875/1751] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:31.493585 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-d2a53a80-2cb8-4786-b200-a5c54d577551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4071af2115f4ee481304c84ac958807'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:31.493871 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5f295-429c-4cf1-84ca-2b4e8a848935 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:31.494881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5f295-429c-4cf1-84ca-2b4e8a848935 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:31.494881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5f295-429c-4cf1-84ca-2b4e8a848935 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:31.497365 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 876/1752] 10.222.0.48 () {54 vars in 912 bytes} [Wed Jul 27 22:49:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:49:31.498747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62964f85-cd2d-45cc-b854-287bd026042a None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:31.499140 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62964f85-cd2d-45cc-b854-287bd026042a None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:31.499597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62964f85-cd2d-45cc-b854-287bd026042a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:31.505795 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-d2a53a80-2cb8-4786-b200-a5c54d577551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4071af2115f4ee481304c84ac958807'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:31.520095 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-d2a53a80-2cb8-4786-b200-a5c54d577551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4071af2115f4ee481304c84ac958807'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:31.535189 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 877/1753] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:30 2022] DELETE /identity/v3/users/f4071af2115f4ee481304c84ac958807 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:31.535189 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26213fd-d24d-427a-a3ad-f10053233d7b None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:31.538200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-62964f85-cd2d-45cc-b854-287bd026042a None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:31.540215 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-62964f85-cd2d-45cc-b854-287bd026042a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:31.559545 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26213fd-d24d-427a-a3ad-f10053233d7b None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:31.559914 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26213fd-d24d-427a-a3ad-f10053233d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:31.712387 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-e26213fd-d24d-427a-a3ad-f10053233d7b None None] MFA Rules not processed for user `c266721767004428b9b54dd200f3cd6b`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:31.714754 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e26213fd-d24d-427a-a3ad-f10053233d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:31.732315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 877/1754] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:31.733319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62964f85-cd2d-45cc-b854-287bd026042a None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:31.759024 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62964f85-cd2d-45cc-b854-287bd026042a None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:31.780825 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5dba4a-d03b-4e3f-8ecb-7ec72d7a2fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:31.782156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dba4a-d03b-4e3f-8ecb-7ec72d7a2fad admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:31.782679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dba4a-d03b-4e3f-8ecb-7ec72d7a2fad admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:31.784939 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dba4a-d03b-4e3f-8ecb-7ec72d7a2fad admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:31.785867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5dba4a-d03b-4e3f-8ecb-7ec72d7a2fad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:31.786330 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5dba4a-d03b-4e3f-8ecb-7ec72d7a2fad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:31.790595 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5dba4a-d03b-4e3f-8ecb-7ec72d7a2fad admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:31.823860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 878/1755] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:49:31.831383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5dba4a-d03b-4e3f-8ecb-7ec72d7a2fad admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:31.843157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:31.852746 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:31.893089 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5dba4a-d03b-4e3f-8ecb-7ec72d7a2fad admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:31.905776 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 878/1756] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 22:49:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:31.916738 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d3625-466f-4636-b818-d4545a43e78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:31.917390 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d3625-466f-4636-b818-d4545a43e78e admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:31.917676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d3625-466f-4636-b818-d4545a43e78e admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:31.917959 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d3625-466f-4636-b818-d4545a43e78e admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:31.918674 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d3625-466f-4636-b818-d4545a43e78e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:31.925969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d3625-466f-4636-b818-d4545a43e78e admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:31.988436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 879/1757] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:31 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:31.993533 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26213fd-d24d-427a-a3ad-f10053233d7b None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:32.025068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26213fd-d24d-427a-a3ad-f10053233d7b None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:32.122293 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d3625-466f-4636-b818-d4545a43e78e admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:32.125505 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-3a9d3625-466f-4636-b818-d4545a43e78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:32.381287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d3625-466f-4636-b818-d4545a43e78e admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:32.392789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a85a8-d920-4e4a-b0f5-4239f450432f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:32.394912 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a85a8-d920-4e4a-b0f5-4239f450432f admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:32.400289 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a85a8-d920-4e4a-b0f5-4239f450432f admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:32.406587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40d1c0-0138-43ff-a2b2-69cd181facd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:32.406723 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839a85a8-d920-4e4a-b0f5-4239f450432f admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:32.407506 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a85a8-d920-4e4a-b0f5-4239f450432f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:32.408714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40d1c0-0138-43ff-a2b2-69cd181facd3 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:32.409010 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40d1c0-0138-43ff-a2b2-69cd181facd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:32.409334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40d1c0-0138-43ff-a2b2-69cd181facd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:32.409496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839a85a8-d920-4e4a-b0f5-4239f450432f admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:32.465075 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40d1c0-0138-43ff-a2b2-69cd181facd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:32.472534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40d1c0-0138-43ff-a2b2-69cd181facd3 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:32.513052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 880/1758] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:32.536255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 879/1759] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:31 2022] POST /identity/v3/users => generated 283 bytes in 541 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:32.537984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40d1c0-0138-43ff-a2b2-69cd181facd3 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:32.563366 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40d1c0-0138-43ff-a2b2-69cd181facd3 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:32.587770 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1db1bb-ea1e-498c-9ae9-5a302305659e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:32.588426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1db1bb-ea1e-498c-9ae9-5a302305659e admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:32.588954 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1db1bb-ea1e-498c-9ae9-5a302305659e admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:32.588954 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1db1bb-ea1e-498c-9ae9-5a302305659e admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:32.595402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1db1bb-ea1e-498c-9ae9-5a302305659e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:32.606808 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1db1bb-ea1e-498c-9ae9-5a302305659e admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:32.634394 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 881/1760] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:32.639836 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a85a8-d920-4e4a-b0f5-4239f450432f admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:32.665258 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839a85a8-d920-4e4a-b0f5-4239f450432f admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:32.712542 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fac5347-706a-4be5-8e19-5e43dde066a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:32.713206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac5347-706a-4be5-8e19-5e43dde066a1 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:32.713498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac5347-706a-4be5-8e19-5e43dde066a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:32.713781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fac5347-706a-4be5-8e19-5e43dde066a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:32.714536 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac5347-706a-4be5-8e19-5e43dde066a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:32.716231 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fac5347-706a-4be5-8e19-5e43dde066a1 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:32.752904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 880/1761] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:32.756389 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1db1bb-ea1e-498c-9ae9-5a302305659e admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:32.775369 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1db1bb-ea1e-498c-9ae9-5a302305659e admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:32.791070 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae99f7-fc6a-40de-b3ae-1dbca91ba62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:32.791786 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae99f7-fc6a-40de-b3ae-1dbca91ba62c admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:32.792090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae99f7-fc6a-40de-b3ae-1dbca91ba62c admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:32.792366 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae99f7-fc6a-40de-b3ae-1dbca91ba62c admin admin] PATH_INFO: `/v3/projects/d3a4a1f42cc24479b210ba29ef58a75d/users/9a3c57bc7d2640cc859bf2f125c182f8/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:32.838200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea0542-3656-4e77-8d86-5fae298e8b94 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:32.838533 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea0542-3656-4e77-8d86-5fae298e8b94 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:32.838976 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea0542-3656-4e77-8d86-5fae298e8b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:32.883228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae99f7-fc6a-40de-b3ae-1dbca91ba62c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a4a1f42cc24479b210ba29ef58a75d, user_id=9a3c57bc7d2640cc859bf2f125c182f8, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:32.895315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ae99f7-fc6a-40de-b3ae-1dbca91ba62c admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:32.939860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 882/1762] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:32 2022] PUT /identity/v3/projects/d3a4a1f42cc24479b210ba29ef58a75d/users/9a3c57bc7d2640cc859bf2f125c182f8/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:32.953251 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8e492-25aa-4e18-b645-d99a81a57ae5 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:32.953560 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8e492-25aa-4e18-b645-d99a81a57ae5 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:32.954250 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8e492-25aa-4e18-b645-d99a81a57ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:33.024967 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-d1ea0542-3656-4e77-8d86-5fae298e8b94 None None] MFA Rules not processed for user `db10ad54ec9948a3bb8b04c708fc4ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:33.026220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d1ea0542-3656-4e77-8d86-5fae298e8b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:33.026751 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-4bc8e492-25aa-4e18-b645-d99a81a57ae5 None None] MFA Rules not processed for user `9a3c57bc7d2640cc859bf2f125c182f8`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:33.030678 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-4bc8e492-25aa-4e18-b645-d99a81a57ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:33.214673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 883/1763] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:49:33.217588 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8e492-25aa-4e18-b645-d99a81a57ae5 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:33.278950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 881/1764] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 22:49:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:33.281459 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea0542-3656-4e77-8d86-5fae298e8b94 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:33.290413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d1ea0542-3656-4e77-8d86-5fae298e8b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:33.318817 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:33.372650 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:33.379027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8e492-25aa-4e18-b645-d99a81a57ae5 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:33.394679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb89a6-b6a5-49e1-a388-8b62ffc20bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:33.395507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb89a6-b6a5-49e1-a388-8b62ffc20bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:33.397187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb89a6-b6a5-49e1-a388-8b62ffc20bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:33.399808 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efb89a6-b6a5-49e1-a388-8b62ffc20bb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:33.400667 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb89a6-b6a5-49e1-a388-8b62ffc20bb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:33.408506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efb89a6-b6a5-49e1-a388-8b62ffc20bb8 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:33.478068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 884/1765] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:33 2022] POST /identity/v3/projects => generated 365 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:33.482292 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb89a6-b6a5-49e1-a388-8b62ffc20bb8 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:33.492405 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea0542-3656-4e77-8d86-5fae298e8b94 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:33.714107 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efb89a6-b6a5-49e1-a388-8b62ffc20bb8 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:33.715131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8fbd9-9ea5-477a-aeee-faa1a3f4fe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:33.717777 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8fbd9-9ea5-477a-aeee-faa1a3f4fe17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:33.718495 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8fbd9-9ea5-477a-aeee-faa1a3f4fe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:33.719660 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8fbd9-9ea5-477a-aeee-faa1a3f4fe17 admin admin] PATH_INFO: `/v3/projects/1b18ebf23ec249098bf8508ce7ed3c7d` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:33.721949 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8fbd9-9ea5-477a-aeee-faa1a3f4fe17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b18ebf23ec249098bf8508ce7ed3c7d)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:33.724515 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8fbd9-9ea5-477a-aeee-faa1a3f4fe17 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:33.732459 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73292fc-a153-4898-bd6a-60c0424ade95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:33.734492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73292fc-a153-4898-bd6a-60c0424ade95 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:33.734792 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73292fc-a153-4898-bd6a-60c0424ade95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:33.735661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73292fc-a153-4898-bd6a-60c0424ade95 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:33.736558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73292fc-a153-4898-bd6a-60c0424ade95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:33.739110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73292fc-a153-4898-bd6a-60c0424ade95 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:33.783870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 885/1766] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:33 2022] POST /identity/v3/users => generated 289 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:49:33.785179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73292fc-a153-4898-bd6a-60c0424ade95 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:33.787285 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c73292fc-a153-4898-bd6a-60c0424ade95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:33.906149 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a1c8fbd9-9ea5-477a-aeee-faa1a3f4fe17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b18ebf23ec249098bf8508ce7ed3c7d', 'request_id': 'req-a1c8fbd9-9ea5-477a-aeee-faa1a3f4fe17'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:33.939357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a1c8fbd9-9ea5-477a-aeee-faa1a3f4fe17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b18ebf23ec249098bf8508ce7ed3c7d', 'request_id': 'req-a1c8fbd9-9ea5-477a-aeee-faa1a3f4fe17'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:33.973389 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a1c8fbd9-9ea5-477a-aeee-faa1a3f4fe17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b18ebf23ec249098bf8508ce7ed3c7d', 'request_id': 'req-a1c8fbd9-9ea5-477a-aeee-faa1a3f4fe17'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:33.993261 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73292fc-a153-4898-bd6a-60c0424ade95 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:34.003130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a1c8fbd9-9ea5-477a-aeee-faa1a3f4fe17 admin admin] The token cache is being invalidate because project 1b18ebf23ec249098bf8508ce7ed3c7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:34.005434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a1c8fbd9-9ea5-477a-aeee-faa1a3f4fe17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:34.006642 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a1c8fbd9-9ea5-477a-aeee-faa1a3f4fe17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:34.014205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 882/1767] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:33 2022] DELETE /identity/v3/projects/1b18ebf23ec249098bf8508ce7ed3c7d => generated 0 bytes in 734 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:34.021218 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd6f41-2705-485a-b26e-d5133e339b94 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:34.021577 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd6f41-2705-485a-b26e-d5133e339b94 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:34.021868 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddd6f41-2705-485a-b26e-d5133e339b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:34.090868 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:34.102633 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-8ddd6f41-2705-485a-b26e-d5133e339b94 None None] MFA Rules not processed for user `7276ed630a694d0f844aa402169b938d`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:34.103925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8ddd6f41-2705-485a-b26e-d5133e339b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:34.137722 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f75b3f-c47a-48ff-a444-f428c0b4516f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf405258b9d413fae1192e10250b6a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:34.138720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f75b3f-c47a-48ff-a444-f428c0b4516f service swift] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:34.139180 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f75b3f-c47a-48ff-a444-f428c0b4516f service swift] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:34.139596 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f75b3f-c47a-48ff-a444-f428c0b4516f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:34.143798 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a4f75b3f-c47a-48ff-a444-f428c0b4516f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:34.265583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f75b3f-c47a-48ff-a444-f428c0b4516f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:34.270951 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f75b3f-c47a-48ff-a444-f428c0b4516f service swift] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:34.296681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 886/1768] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 22:49:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 22:49:34.299475 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f75b3f-c47a-48ff-a444-f428c0b4516f service swift] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:34.303352 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a4f75b3f-c47a-48ff-a444-f428c0b4516f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:34.372273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 883/1769] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:34.373971 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e793710-3020-4c6c-be4b-b0731bf6bf8e None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:34.374695 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e793710-3020-4c6c-be4b-b0731bf6bf8e None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:34.377370 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e793710-3020-4c6c-be4b-b0731bf6bf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:34.467882 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-6e793710-3020-4c6c-be4b-b0731bf6bf8e None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:34.469111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6e793710-3020-4c6c-be4b-b0731bf6bf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:34.549550 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:34.602251 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f75b3f-c47a-48ff-a444-f428c0b4516f service swift] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:34.652492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c6b37-524f-4a99-8f24-081632d152e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:34.658366 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c6b37-524f-4a99-8f24-081632d152e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:34.658833 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c6b37-524f-4a99-8f24-081632d152e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:34.659136 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c6b37-524f-4a99-8f24-081632d152e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:34.663451 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c6b37-524f-4a99-8f24-081632d152e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:34.676858 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583c6b37-524f-4a99-8f24-081632d152e1 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:34.761847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 884/1770] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:34.772637 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3200a-32b6-453c-86d7-5b41175f404e None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:34.773099 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3200a-32b6-453c-86d7-5b41175f404e None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:34.773457 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de3200a-32b6-453c-86d7-5b41175f404e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:34.790421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 887/1771] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 493 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:34.802032 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c6b37-524f-4a99-8f24-081632d152e1 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:34.874373 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-3de3200a-32b6-453c-86d7-5b41175f404e None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:34.875618 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-3de3200a-32b6-453c-86d7-5b41175f404e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:34.887217 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c6b37-524f-4a99-8f24-081632d152e1 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:34.918000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0cf7d-7aee-44bc-9230-3cc481d72e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:34.921453 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0cf7d-7aee-44bc-9230-3cc481d72e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:34.922782 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0cf7d-7aee-44bc-9230-3cc481d72e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:34.923753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0cf7d-7aee-44bc-9230-3cc481d72e90 admin admin] PATH_INFO: `/v3/projects/d7befb16800d458c95c057390bb9d76c/users/a77c8f4e49854e4c90b27fea5c126ff8/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:34.965333 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 885/1772] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:34.972180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3200a-32b6-453c-86d7-5b41175f404e None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:34.995672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0cf7d-7aee-44bc-9230-3cc481d72e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7befb16800d458c95c057390bb9d76c, user_id=a77c8f4e49854e4c90b27fea5c126ff8, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:35.012211 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0cf7d-7aee-44bc-9230-3cc481d72e90 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:35.050880 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de3200a-32b6-453c-86d7-5b41175f404e None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:35.080873 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 888/1773] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:34 2022] PUT /identity/v3/projects/d7befb16800d458c95c057390bb9d76c/users/a77c8f4e49854e4c90b27fea5c126ff8/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:35.088464 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0cf7d-7aee-44bc-9230-3cc481d72e90 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:35.319231 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ba0ed-2626-49c9-ac72-b6d499b45d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:35.319911 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ba0ed-2626-49c9-ac72-b6d499b45d37 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:35.320202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ba0ed-2626-49c9-ac72-b6d499b45d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:35.320482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4ba0ed-2626-49c9-ac72-b6d499b45d37 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:35.321724 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ba0ed-2626-49c9-ac72-b6d499b45d37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:35.322029 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ba0ed-2626-49c9-ac72-b6d499b45d37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:35.324346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4ba0ed-2626-49c9-ac72-b6d499b45d37 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:35.357339 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:35.409705 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0cf7d-7aee-44bc-9230-3cc481d72e90 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:35.411931 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 886/1774] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:49:35.417233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ba0ed-2626-49c9-ac72-b6d499b45d37 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:35.436290 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c333d-ede9-41f5-958f-02f8da747a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:35.439123 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c333d-ede9-41f5-958f-02f8da747a78 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:35.439429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c333d-ede9-41f5-958f-02f8da747a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:35.439716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c333d-ede9-41f5-958f-02f8da747a78 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:35.441842 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c333d-ede9-41f5-958f-02f8da747a78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:35.452844 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c333d-ede9-41f5-958f-02f8da747a78 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:35.460569 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4ba0ed-2626-49c9-ac72-b6d499b45d37 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:35.466953 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2457b6-cc88-4536-ba27-d8ee677febd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:35.482209 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2457b6-cc88-4536-ba27-d8ee677febd7 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:35.482756 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2457b6-cc88-4536-ba27-d8ee677febd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:35.483228 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2457b6-cc88-4536-ba27-d8ee677febd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:35.485418 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2457b6-cc88-4536-ba27-d8ee677febd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:35.491124 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 889/1775] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:35 2022] GET /identity/v3/roles => generated 1420 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:35.492107 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c333d-ede9-41f5-958f-02f8da747a78 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:35.504261 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2457b6-cc88-4536-ba27-d8ee677febd7 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:35.524521 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c333d-ede9-41f5-958f-02f8da747a78 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:35.563531 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f695212-2841-40a7-b7f5-dd60a63fa000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:35.566423 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f695212-2841-40a7-b7f5-dd60a63fa000 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:35.566719 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f695212-2841-40a7-b7f5-dd60a63fa000 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:35.569393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f695212-2841-40a7-b7f5-dd60a63fa000 admin admin] PATH_INFO: `/v3/projects/d7befb16800d458c95c057390bb9d76c/users/a77c8f4e49854e4c90b27fea5c126ff8/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:35.590858 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f695212-2841-40a7-b7f5-dd60a63fa000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7befb16800d458c95c057390bb9d76c, user_id=a77c8f4e49854e4c90b27fea5c126ff8, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:35.609064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f695212-2841-40a7-b7f5-dd60a63fa000 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:35.631131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 887/1776] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:35 2022] POST /identity/v3/projects => generated 379 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:35.639500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2457b6-cc88-4536-ba27-d8ee677febd7 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:35.685335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 890/1777] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:35 2022] PUT /identity/v3/projects/d7befb16800d458c95c057390bb9d76c/users/a77c8f4e49854e4c90b27fea5c126ff8/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:35.697981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb01f6-4f4a-49ba-836c-401156ab2602 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:35.698276 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb01f6-4f4a-49ba-836c-401156ab2602 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:35.703990 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb01f6-4f4a-49ba-836c-401156ab2602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:35.829244 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-24cb01f6-4f4a-49ba-836c-401156ab2602 None None] MFA Rules not processed for user `a77c8f4e49854e4c90b27fea5c126ff8`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:35.836690 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-24cb01f6-4f4a-49ba-836c-401156ab2602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:35.944080 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2457b6-cc88-4536-ba27-d8ee677febd7 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:36.079743 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:36.222523 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd8621-5dfc-439b-8424-96fe4dc0ad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:36.223180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd8621-5dfc-439b-8424-96fe4dc0ad94 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:36.223540 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd8621-5dfc-439b-8424-96fe4dc0ad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:36.246094 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfd8621-5dfc-439b-8424-96fe4dc0ad94 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:36.246974 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd8621-5dfc-439b-8424-96fe4dc0ad94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:36.257316 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfd8621-5dfc-439b-8424-96fe4dc0ad94 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:36.317186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 891/1778] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:35 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 626 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:36.329578 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 888/1779] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:35 2022] POST /identity/v3/users => generated 290 bytes in 694 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:36.334145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd8621-5dfc-439b-8424-96fe4dc0ad94 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:36.334321 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb01f6-4f4a-49ba-836c-401156ab2602 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:36.335772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-24cb01f6-4f4a-49ba-836c-401156ab2602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:36.352603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfd8621-5dfc-439b-8424-96fe4dc0ad94 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:36.361684 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40eba7b-e992-427f-abf0-9485926d912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:36.362925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40eba7b-e992-427f-abf0-9485926d912e admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:36.363565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40eba7b-e992-427f-abf0-9485926d912e admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:36.364209 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40eba7b-e992-427f-abf0-9485926d912e admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:36.365279 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40eba7b-e992-427f-abf0-9485926d912e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:36.367263 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40eba7b-e992-427f-abf0-9485926d912e admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:36.389346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 889/1780] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:36.390983 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40eba7b-e992-427f-abf0-9485926d912e admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:36.416317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40eba7b-e992-427f-abf0-9485926d912e admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:36.425438 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adda648-31e2-4215-bfe1-57133076b760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:36.427535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda648-31e2-4215-bfe1-57133076b760 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:36.428011 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda648-31e2-4215-bfe1-57133076b760 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:36.428414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adda648-31e2-4215-bfe1-57133076b760 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:36.429396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adda648-31e2-4215-bfe1-57133076b760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:36.432466 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adda648-31e2-4215-bfe1-57133076b760 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:36.474018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 890/1781] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:36 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:36.474018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adda648-31e2-4215-bfe1-57133076b760 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:36.494315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb01f6-4f4a-49ba-836c-401156ab2602 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:36.501361 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b35245-b6e0-4352-a80e-57a2df300dd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:36.502233 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b35245-b6e0-4352-a80e-57a2df300dd3 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:36.502437 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b35245-b6e0-4352-a80e-57a2df300dd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:36.502742 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b35245-b6e0-4352-a80e-57a2df300dd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:36.513775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adda648-31e2-4215-bfe1-57133076b760 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:36.535321 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b35245-b6e0-4352-a80e-57a2df300dd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:36.535869 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b617ff6-7bbe-4125-923b-18c373d57557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:36.536906 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b35245-b6e0-4352-a80e-57a2df300dd3 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:36.539979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b617ff6-7bbe-4125-923b-18c373d57557 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:36.545289 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b617ff6-7bbe-4125-923b-18c373d57557 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:36.545289 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b617ff6-7bbe-4125-923b-18c373d57557 admin admin] PATH_INFO: `/v3/projects/a78ced0a2a584178b0ed34a711954010/users/4cc87591bf2746e5bea09a5d91c82d28/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:36.580748 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 892/1782] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:36 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:36.621292 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b617ff6-7bbe-4125-923b-18c373d57557 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a78ced0a2a584178b0ed34a711954010, user_id=4cc87591bf2746e5bea09a5d91c82d28, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:36.633562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b617ff6-7bbe-4125-923b-18c373d57557 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:36.694930 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 891/1783] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:36 2022] PUT /identity/v3/projects/a78ced0a2a584178b0ed34a711954010/users/4cc87591bf2746e5bea09a5d91c82d28/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:36.695591 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c6af9-d811-4072-b53a-7f5481a6263c None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:36.695956 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c6af9-d811-4072-b53a-7f5481a6263c None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:36.696312 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c6af9-d811-4072-b53a-7f5481a6263c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:36.800886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-bc0c6af9-d811-4072-b53a-7f5481a6263c None None] MFA Rules not processed for user `4cc87591bf2746e5bea09a5d91c82d28`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:36.816672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-bc0c6af9-d811-4072-b53a-7f5481a6263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:36.849547 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b617ff6-7bbe-4125-923b-18c373d57557 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:37.075665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:37.104951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b617ff6-7bbe-4125-923b-18c373d57557 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:37.121035 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2fd9c-a8a9-49b1-bc45-fa932ea21525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:37.121801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2fd9c-a8a9-49b1-bc45-fa932ea21525 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:37.121918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2fd9c-a8a9-49b1-bc45-fa932ea21525 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:37.122279 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2fd9c-a8a9-49b1-bc45-fa932ea21525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:37.138866 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d0a2fd9c-a8a9-49b1-bc45-fa932ea21525 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:37.178208 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 893/1784] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:37.179247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c6af9-d811-4072-b53a-7f5481a6263c None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:37.483177 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2fd9c-a8a9-49b1-bc45-fa932ea21525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:37.489003 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c6af9-d811-4072-b53a-7f5481a6263c None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:37.494453 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4c695d-2c16-433e-a7d2-418bad39f3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:37.495099 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c695d-2c16-433e-a7d2-418bad39f3bb admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:37.495434 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c695d-2c16-433e-a7d2-418bad39f3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:37.495713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4c695d-2c16-433e-a7d2-418bad39f3bb admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:37.496753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c695d-2c16-433e-a7d2-418bad39f3bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:37.499281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4c695d-2c16-433e-a7d2-418bad39f3bb admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:37.499386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2fd9c-a8a9-49b1-bc45-fa932ea21525 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:37.556926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 892/1785] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 707 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:49:37.678165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 894/1786] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:37 2022] POST /identity/v3/projects => generated 375 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:37.678265 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2fd9c-a8a9-49b1-bc45-fa932ea21525 service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:37.692137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2fd9c-a8a9-49b1-bc45-fa932ea21525 service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:37.747941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2227d1-1a6e-459e-8b90-f63a9b0d00e4 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:37.748246 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2227d1-1a6e-459e-8b90-f63a9b0d00e4 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:37.750542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2227d1-1a6e-459e-8b90-f63a9b0d00e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:37.835455 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:37.897597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-ce2227d1-1a6e-459e-8b90-f63a9b0d00e4 None None] MFA Rules not processed for user `c266721767004428b9b54dd200f3cd6b`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:37.914286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ce2227d1-1a6e-459e-8b90-f63a9b0d00e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:38.000465 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87c12b-6112-49e0-b501-63d0ff29e2dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:38.001006 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87c12b-6112-49e0-b501-63d0ff29e2dc admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:38.001302 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87c12b-6112-49e0-b501-63d0ff29e2dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:38.001588 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be87c12b-6112-49e0-b501-63d0ff29e2dc admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:38.002282 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87c12b-6112-49e0-b501-63d0ff29e2dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:38.011797 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be87c12b-6112-49e0-b501-63d0ff29e2dc admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:38.107334 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 893/1787] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:37 2022] POST /identity/v3/users => generated 288 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:49:38.111370 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87c12b-6112-49e0-b501-63d0ff29e2dc admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:38.143625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be87c12b-6112-49e0-b501-63d0ff29e2dc admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:38.150264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 895/1788] 10.222.0.58 () {58 vars in 1015 bytes} [Wed Jul 27 22:49:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:38.176148 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbad22-d26b-425c-a754-ac35cbb9a290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:38.176961 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbad22-d26b-425c-a754-ac35cbb9a290 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:38.177077 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbad22-d26b-425c-a754-ac35cbb9a290 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:38.177354 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcbad22-d26b-425c-a754-ac35cbb9a290 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:38.178141 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbad22-d26b-425c-a754-ac35cbb9a290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:38.187476 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcbad22-d26b-425c-a754-ac35cbb9a290 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:38.231814 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2227d1-1a6e-459e-8b90-f63a9b0d00e4 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:38.232189 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 894/1789] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:38.307013 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2227d1-1a6e-459e-8b90-f63a9b0d00e4 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:38.337395 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de055bf9-59f5-4f1a-b9fb-36a3cf27d282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:38.338099 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de055bf9-59f5-4f1a-b9fb-36a3cf27d282 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:38.338458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de055bf9-59f5-4f1a-b9fb-36a3cf27d282 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:38.338881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de055bf9-59f5-4f1a-b9fb-36a3cf27d282 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:38.339477 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de055bf9-59f5-4f1a-b9fb-36a3cf27d282 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:38.341100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de055bf9-59f5-4f1a-b9fb-36a3cf27d282 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:38.382817 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 896/1790] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:38 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:38.390909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbad22-d26b-425c-a754-ac35cbb9a290 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:38.406160 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcbad22-d26b-425c-a754-ac35cbb9a290 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:38.421672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5659d1-af51-4950-8e88-a524293b0386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:38.422594 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5659d1-af51-4950-8e88-a524293b0386 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:38.423662 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5659d1-af51-4950-8e88-a524293b0386 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:38.424120 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5659d1-af51-4950-8e88-a524293b0386 admin admin] PATH_INFO: `/v3/projects/633a9ac8fe5249d0a4679148a62a001d/users/71511047b380415ca7dba9baf4f19754/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:38.455946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5659d1-af51-4950-8e88-a524293b0386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=633a9ac8fe5249d0a4679148a62a001d, user_id=71511047b380415ca7dba9baf4f19754, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:38.463460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5659d1-af51-4950-8e88-a524293b0386 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:38.494810 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 895/1791] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:38 2022] PUT /identity/v3/projects/633a9ac8fe5249d0a4679148a62a001d/users/71511047b380415ca7dba9baf4f19754/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:38.505089 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ca5af-3baa-4642-b7cf-1593aea1082e None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:38.505618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ca5af-3baa-4642-b7cf-1593aea1082e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:38.505887 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ca5af-3baa-4642-b7cf-1593aea1082e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:38.558184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-b91ca5af-3baa-4642-b7cf-1593aea1082e None None] MFA Rules not processed for user `71511047b380415ca7dba9baf4f19754`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:38.563363 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-b91ca5af-3baa-4642-b7cf-1593aea1082e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:38.647261 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5659d1-af51-4950-8e88-a524293b0386 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:38.649921 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-7d5659d1-af51-4950-8e88-a524293b0386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:38.847123 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5659d1-af51-4950-8e88-a524293b0386 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:38.860996 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd12283-c411-4123-b9fb-8fd873482708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:38.862302 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd12283-c411-4123-b9fb-8fd873482708 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:38.863803 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd12283-c411-4123-b9fb-8fd873482708 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:38.864099 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd12283-c411-4123-b9fb-8fd873482708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:38.878463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 897/1792] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:38.884206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ca5af-3baa-4642-b7cf-1593aea1082e None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:38.895582 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:38.896467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd12283-c411-4123-b9fb-8fd873482708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:38.900365 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd12283-c411-4123-b9fb-8fd873482708 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:38.933883 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 896/1793] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:49:39.230144 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ca5af-3baa-4642-b7cf-1593aea1082e None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:39.264276 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ae9ac-8334-4148-89f8-e0182d556a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:39.264942 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ae9ac-8334-4148-89f8-e0182d556a40 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:39.265234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ae9ac-8334-4148-89f8-e0182d556a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:39.265519 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ae9ac-8334-4148-89f8-e0182d556a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:39.269250 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ae9ac-8334-4148-89f8-e0182d556a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:39.279229 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ae9ac-8334-4148-89f8-e0182d556a40 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:39.397116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 898/1794] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:38 2022] POST /identity/v3/projects => generated 379 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:39.399363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd12283-c411-4123-b9fb-8fd873482708 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:39.427944 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd12283-c411-4123-b9fb-8fd873482708 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:39.602668 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbcdcb-f1ad-47ee-b799-2735b69a1362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:39.602668 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbcdcb-f1ad-47ee-b799-2735b69a1362 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:39.602668 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbcdcb-f1ad-47ee-b799-2735b69a1362 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:39.602668 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbcdcb-f1ad-47ee-b799-2735b69a1362 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:39.603511 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbcdcb-f1ad-47ee-b799-2735b69a1362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:39.605016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbcdcb-f1ad-47ee-b799-2735b69a1362 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:39.666432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 897/1795] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:39 2022] POST /identity/v3/users => generated 296 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:49:39.669207 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ae9ac-8334-4148-89f8-e0182d556a40 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:39.693192 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ae9ac-8334-4148-89f8-e0182d556a40 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:39.699337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3442f2-06df-4754-b6ec-2e4c28b096b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:39.699987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3442f2-06df-4754-b6ec-2e4c28b096b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:39.700274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3442f2-06df-4754-b6ec-2e4c28b096b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:39.700690 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3442f2-06df-4754-b6ec-2e4c28b096b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:39.701441 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3442f2-06df-4754-b6ec-2e4c28b096b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:39.716552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3442f2-06df-4754-b6ec-2e4c28b096b8 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:39.738569 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbcdcb-f1ad-47ee-b799-2735b69a1362 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:39.755037 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 899/1796] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:39.760008 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbcdcb-f1ad-47ee-b799-2735b69a1362 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:39.766989 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f89967-15df-4c00-afa9-95a09c39a1c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:39.768005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f89967-15df-4c00-afa9-95a09c39a1c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:39.768288 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f89967-15df-4c00-afa9-95a09c39a1c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:39.768774 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f89967-15df-4c00-afa9-95a09c39a1c4 admin admin] PATH_INFO: `/v3/projects/2410b4dc91d646908f9215dc76e23647/users/f7b959435f42465a8dccb29b2596708b/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:39.811896 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:39.824427 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f89967-15df-4c00-afa9-95a09c39a1c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2410b4dc91d646908f9215dc76e23647, user_id=f7b959435f42465a8dccb29b2596708b, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:39.836819 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f89967-15df-4c00-afa9-95a09c39a1c4 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:39.877042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 898/1797] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:39 2022] PUT /identity/v3/projects/2410b4dc91d646908f9215dc76e23647/users/f7b959435f42465a8dccb29b2596708b/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:39.878611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3442f2-06df-4754-b6ec-2e4c28b096b8 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:39.896172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3442f2-06df-4754-b6ec-2e4c28b096b8 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:40.139183 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4378cc0-0bf4-4013-abef-b7d258d19cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:40.139915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4378cc0-0bf4-4013-abef-b7d258d19cdc admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:40.140045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4378cc0-0bf4-4013-abef-b7d258d19cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:40.140332 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4378cc0-0bf4-4013-abef-b7d258d19cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:40.141053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4378cc0-0bf4-4013-abef-b7d258d19cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:40.142706 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4378cc0-0bf4-4013-abef-b7d258d19cdc admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:40.204337 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f89967-15df-4c00-afa9-95a09c39a1c4 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:40.206427 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 900/1798] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:39 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:49:40.223033 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f89967-15df-4c00-afa9-95a09c39a1c4 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:40.238620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7ce37-2d33-484b-8247-33aae26b856f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:40.241054 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7ce37-2d33-484b-8247-33aae26b856f admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:40.243216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7ce37-2d33-484b-8247-33aae26b856f admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:40.243725 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7ce37-2d33-484b-8247-33aae26b856f admin admin] PATH_INFO: `/v3/projects/2410b4dc91d646908f9215dc76e23647/users/f7b959435f42465a8dccb29b2596708b/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:40.249587 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7ce37-2d33-484b-8247-33aae26b856f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2410b4dc91d646908f9215dc76e23647, user_id=f7b959435f42465a8dccb29b2596708b, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:40.272030 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf7ce37-2d33-484b-8247-33aae26b856f admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:40.319622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 899/1799] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:40 2022] PUT /identity/v3/projects/2410b4dc91d646908f9215dc76e23647/users/f7b959435f42465a8dccb29b2596708b/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:40.332327 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aa251-5d1c-4e87-af19-c3062d678a8e None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:40.332638 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aa251-5d1c-4e87-af19-c3062d678a8e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:40.332953 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aa251-5d1c-4e87-af19-c3062d678a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:40.425983 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-574aa251-5d1c-4e87-af19-c3062d678a8e None None] MFA Rules not processed for user `f7b959435f42465a8dccb29b2596708b`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:40.427277 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-574aa251-5d1c-4e87-af19-c3062d678a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:40.825271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:40.868538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 901/1800] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 533 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:41.096883 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7ce37-2d33-484b-8247-33aae26b856f admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:41.099576 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-7cf7ce37-2d33-484b-8247-33aae26b856f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:41.484437 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7ce37-2d33-484b-8247-33aae26b856f admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:41.504078 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aa2c8-bf90-4994-b02b-2fb902f5c1e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:41.507480 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aa2c8-bf90-4994-b02b-2fb902f5c1e4 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:41.508533 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aa2c8-bf90-4994-b02b-2fb902f5c1e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:41.510091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0aa2c8-bf90-4994-b02b-2fb902f5c1e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:41.543771 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0aa2c8-bf90-4994-b02b-2fb902f5c1e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:41.549422 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0aa2c8-bf90-4994-b02b-2fb902f5c1e4 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:41.630282 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 900/1801] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:41.707168 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aa251-5d1c-4e87-af19-c3062d678a8e None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:41.728441 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aa251-5d1c-4e87-af19-c3062d678a8e None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:41.741648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de1f008-acd2-49ef-83b0-9bdb878bc4b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:41.748359 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f008-acd2-49ef-83b0-9bdb878bc4b4 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:41.749222 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f008-acd2-49ef-83b0-9bdb878bc4b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:41.749713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de1f008-acd2-49ef-83b0-9bdb878bc4b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:41.983815 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1f008-acd2-49ef-83b0-9bdb878bc4b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:41.988593 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de1f008-acd2-49ef-83b0-9bdb878bc4b4 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:42.024734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 902/1802] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:42.625906 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aa2c8-bf90-4994-b02b-2fb902f5c1e4 service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:42.628735 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ad0aa2c8-bf90-4994-b02b-2fb902f5c1e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:42.888834 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0aa2c8-bf90-4994-b02b-2fb902f5c1e4 service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:42.923102 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dede6e-6e74-439e-aeb4-7e8b368587b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:42.931067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dede6e-6e74-439e-aeb4-7e8b368587b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:42.931811 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dede6e-6e74-439e-aeb4-7e8b368587b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:42.932459 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dede6e-6e74-439e-aeb4-7e8b368587b7 admin admin] PATH_INFO: `/v3/users/a84f76d13f974c94b64643f15020f5fd` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:42.934093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dede6e-6e74-439e-aeb4-7e8b368587b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a84f76d13f974c94b64643f15020f5fd)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:42.937435 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dede6e-6e74-439e-aeb4-7e8b368587b7 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:43.108661 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e2dede6e-6e74-439e-aeb4-7e8b368587b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a84f76d13f974c94b64643f15020f5fd'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:43.109577 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e2dede6e-6e74-439e-aeb4-7e8b368587b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a84f76d13f974c94b64643f15020f5fd'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:43.125444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e2dede6e-6e74-439e-aeb4-7e8b368587b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a84f76d13f974c94b64643f15020f5fd'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:43.136696 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e2dede6e-6e74-439e-aeb4-7e8b368587b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a84f76d13f974c94b64643f15020f5fd'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:43.151882 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e2dede6e-6e74-439e-aeb4-7e8b368587b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a84f76d13f974c94b64643f15020f5fd'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:43.155700 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:43.178663 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 901/1803] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:42 2022] DELETE /identity/v3/users/a84f76d13f974c94b64643f15020f5fd => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:43.183886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebbf24-3d9d-48dc-bc21-37b92b40992d None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:43.184435 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebbf24-3d9d-48dc-bc21-37b92b40992d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:43.184657 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceebbf24-3d9d-48dc-bc21-37b92b40992d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:43.264686 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-ceebbf24-3d9d-48dc-bc21-37b92b40992d None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:43.265856 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ceebbf24-3d9d-48dc-bc21-37b92b40992d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:43.499867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 903/1804] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:43.562522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dede6e-6e74-439e-aeb4-7e8b368587b7 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:43.566848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e2dede6e-6e74-439e-aeb4-7e8b368587b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:43.870111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dede6e-6e74-439e-aeb4-7e8b368587b7 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:43.889322 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8006596-ddbf-4da5-9f3b-2f6b79404f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:43.894623 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8006596-ddbf-4da5-9f3b-2f6b79404f29 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:43.895735 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8006596-ddbf-4da5-9f3b-2f6b79404f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:43.897130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8006596-ddbf-4da5-9f3b-2f6b79404f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:43.924281 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8006596-ddbf-4da5-9f3b-2f6b79404f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:43.931430 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8006596-ddbf-4da5-9f3b-2f6b79404f29 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:43.950666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 902/1805] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:43.979050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebbf24-3d9d-48dc-bc21-37b92b40992d None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:43.983719 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ceebbf24-3d9d-48dc-bc21-37b92b40992d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:44.016033 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceebbf24-3d9d-48dc-bc21-37b92b40992d None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:44.038155 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4136de4-f7d0-4ca4-bfe5-075304f4af8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:44.042063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136de4-f7d0-4ca4-bfe5-075304f4af8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:44.042593 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136de4-f7d0-4ca4-bfe5-075304f4af8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:44.042989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136de4-f7d0-4ca4-bfe5-075304f4af8c admin admin] PATH_INFO: `/v3/users/85dcfc87407c4a56b69a447a0f9ced1c` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:44.048576 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4136de4-f7d0-4ca4-bfe5-075304f4af8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=85dcfc87407c4a56b69a447a0f9ced1c)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:44.057159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4136de4-f7d0-4ca4-bfe5-075304f4af8c admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:44.242616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f4136de4-f7d0-4ca4-bfe5-075304f4af8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85dcfc87407c4a56b69a447a0f9ced1c'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:44.244918 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f4136de4-f7d0-4ca4-bfe5-075304f4af8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85dcfc87407c4a56b69a447a0f9ced1c'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:44.264092 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f4136de4-f7d0-4ca4-bfe5-075304f4af8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85dcfc87407c4a56b69a447a0f9ced1c'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:44.320237 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f4136de4-f7d0-4ca4-bfe5-075304f4af8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85dcfc87407c4a56b69a447a0f9ced1c'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:44.324070 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f4136de4-f7d0-4ca4-bfe5-075304f4af8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85dcfc87407c4a56b69a447a0f9ced1c'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:44.358142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 904/1806] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:43 2022] DELETE /identity/v3/users/85dcfc87407c4a56b69a447a0f9ced1c => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:44.364275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474055e-c363-4483-b501-f97be45f34f6 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:44.364575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474055e-c363-4483-b501-f97be45f34f6 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:44.364923 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474055e-c363-4483-b501-f97be45f34f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:44.403006 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-9474055e-c363-4483-b501-f97be45f34f6 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:44.404452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-9474055e-c363-4483-b501-f97be45f34f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:44.590749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 903/1807] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:44.675557 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4136de4-f7d0-4ca4-bfe5-075304f4af8c admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:44.677076 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-f4136de4-f7d0-4ca4-bfe5-075304f4af8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:44.719191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:44.881798 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4136de4-f7d0-4ca4-bfe5-075304f4af8c admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:44.899340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e436eaa-fd59-469b-96db-db94757aa0d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:44.900545 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e436eaa-fd59-469b-96db-db94757aa0d6 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:44.901101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e436eaa-fd59-469b-96db-db94757aa0d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:44.901624 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e436eaa-fd59-469b-96db-db94757aa0d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:44.945286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e436eaa-fd59-469b-96db-db94757aa0d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:44.952694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e436eaa-fd59-469b-96db-db94757aa0d6 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:44.978125 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 905/1808] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:45.469563 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f05c7a-8ea0-41ca-978b-d01bf851e300 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:45.470034 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f05c7a-8ea0-41ca-978b-d01bf851e300 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:45.470306 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f05c7a-8ea0-41ca-978b-d01bf851e300 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:45.474990 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 904/1809] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 22:49:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:49:45.488580 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750b18d-7d11-4f8f-9afc-4ad020e4a813 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:45.489623 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750b18d-7d11-4f8f-9afc-4ad020e4a813 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:45.490074 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750b18d-7d11-4f8f-9afc-4ad020e4a813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:45.567116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-a750b18d-7d11-4f8f-9afc-4ad020e4a813 None None] MFA Rules not processed for user `c621601261e44ca8a7938862d6578639`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:45.568548 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a750b18d-7d11-4f8f-9afc-4ad020e4a813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:45.817013 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 906/1810] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 22:49:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:46.032296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f05c7a-8ea0-41ca-978b-d01bf851e300 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:46.034645 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d3f05c7a-8ea0-41ca-978b-d01bf851e300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:46.144620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f05c7a-8ea0-41ca-978b-d01bf851e300 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:46.178254 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd976961-1035-4818-b399-60a3c1de6d29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:46.179354 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd976961-1035-4818-b399-60a3c1de6d29 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:46.179354 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd976961-1035-4818-b399-60a3c1de6d29 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:46.195168 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd976961-1035-4818-b399-60a3c1de6d29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:46.231341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd976961-1035-4818-b399-60a3c1de6d29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:46.234406 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd976961-1035-4818-b399-60a3c1de6d29 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:46.344783 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 905/1811] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:46.411993 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750b18d-7d11-4f8f-9afc-4ad020e4a813 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:46.413705 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a750b18d-7d11-4f8f-9afc-4ad020e4a813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:46.458129 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750b18d-7d11-4f8f-9afc-4ad020e4a813 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:46.470524 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb338d76-54da-419c-8334-222174fb3fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:46.471489 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb338d76-54da-419c-8334-222174fb3fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:46.471999 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb338d76-54da-419c-8334-222174fb3fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:46.472468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb338d76-54da-419c-8334-222174fb3fe4 admin admin] PATH_INFO: `/v3/users/4cc87591bf2746e5bea09a5d91c82d28` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:46.487385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb338d76-54da-419c-8334-222174fb3fe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cc87591bf2746e5bea09a5d91c82d28)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:46.489724 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb338d76-54da-419c-8334-222174fb3fe4 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:46.673547 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-cb338d76-54da-419c-8334-222174fb3fe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cc87591bf2746e5bea09a5d91c82d28'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:46.674396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-cb338d76-54da-419c-8334-222174fb3fe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cc87591bf2746e5bea09a5d91c82d28'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:46.698652 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-cb338d76-54da-419c-8334-222174fb3fe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cc87591bf2746e5bea09a5d91c82d28'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:46.746616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-cb338d76-54da-419c-8334-222174fb3fe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cc87591bf2746e5bea09a5d91c82d28'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:46.750472 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-cb338d76-54da-419c-8334-222174fb3fe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cc87591bf2746e5bea09a5d91c82d28'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:46.791784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 907/1812] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:46 2022] DELETE /identity/v3/users/4cc87591bf2746e5bea09a5d91c82d28 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:46.797400 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae828a-5032-40f7-a4bb-2b57fe193178 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:46.798413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae828a-5032-40f7-a4bb-2b57fe193178 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:46.798837 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae828a-5032-40f7-a4bb-2b57fe193178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:46.847666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-d7ae828a-5032-40f7-a4bb-2b57fe193178 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:46.850875 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d7ae828a-5032-40f7-a4bb-2b57fe193178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:46.921263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb338d76-54da-419c-8334-222174fb3fe4 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:46.922759 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-cb338d76-54da-419c-8334-222174fb3fe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:46.953102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:47.078583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 906/1813] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:47.113262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0b9d9-0e41-4844-80a2-c509bf694573 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:47.113579 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0b9d9-0e41-4844-80a2-c509bf694573 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:47.113830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d0b9d9-0e41-4844-80a2-c509bf694573 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:47.115345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 907/1814] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 22:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:49:47.157385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb338d76-54da-419c-8334-222174fb3fe4 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:47.174511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61006b92-c9eb-48ef-b764-92b15479c5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:47.175825 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61006b92-c9eb-48ef-b764-92b15479c5de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:47.176856 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61006b92-c9eb-48ef-b764-92b15479c5de admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:47.179436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61006b92-c9eb-48ef-b764-92b15479c5de admin admin] PATH_INFO: `/v3/users/9a3c57bc7d2640cc859bf2f125c182f8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:47.187961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61006b92-c9eb-48ef-b764-92b15479c5de admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a3c57bc7d2640cc859bf2f125c182f8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:47.192250 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61006b92-c9eb-48ef-b764-92b15479c5de admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:47.222299 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a291a-06fa-4b10-a415-9781f086e211 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:47.222639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a291a-06fa-4b10-a415-9781f086e211 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:47.222997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a291a-06fa-4b10-a415-9781f086e211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:47.287681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-042a291a-06fa-4b10-a415-9781f086e211 None None] MFA Rules not processed for user `c621601261e44ca8a7938862d6578639`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:47.298382 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-042a291a-06fa-4b10-a415-9781f086e211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:47.360155 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:47.366871 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-61006b92-c9eb-48ef-b764-92b15479c5de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a3c57bc7d2640cc859bf2f125c182f8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:47.374974 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-61006b92-c9eb-48ef-b764-92b15479c5de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a3c57bc7d2640cc859bf2f125c182f8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:47.398403 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-61006b92-c9eb-48ef-b764-92b15479c5de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a3c57bc7d2640cc859bf2f125c182f8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:47.436256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-61006b92-c9eb-48ef-b764-92b15479c5de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a3c57bc7d2640cc859bf2f125c182f8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:47.437868 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-61006b92-c9eb-48ef-b764-92b15479c5de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a3c57bc7d2640cc859bf2f125c182f8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:47.444873 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 908/1815] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 22:49:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:47.446864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a291a-06fa-4b10-a415-9781f086e211 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:47.449808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-042a291a-06fa-4b10-a415-9781f086e211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:47.482474 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 908/1816] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:46 2022] DELETE /identity/v3/users/9a3c57bc7d2640cc859bf2f125c182f8 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:49:47.488151 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875b162-5097-4553-883a-18fc72a6f768 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:47.488662 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875b162-5097-4553-883a-18fc72a6f768 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:47.489088 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875b162-5097-4553-883a-18fc72a6f768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:47.546486 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-d875b162-5097-4553-883a-18fc72a6f768 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:47.547944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d875b162-5097-4553-883a-18fc72a6f768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:47.571857 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a291a-06fa-4b10-a415-9781f086e211 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:47.672681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 909/1817] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:49:47.673927 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875b162-5097-4553-883a-18fc72a6f768 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:47.677334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d875b162-5097-4553-883a-18fc72a6f768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:47.692450 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875b162-5097-4553-883a-18fc72a6f768 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:47.694773 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793365d-ca6c-4211-b20c-07348acaf3e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:47.695478 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793365d-ca6c-4211-b20c-07348acaf3e2 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:47.695799 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793365d-ca6c-4211-b20c-07348acaf3e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:47.696611 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7793365d-ca6c-4211-b20c-07348acaf3e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:47.698737 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-7793365d-ca6c-4211-b20c-07348acaf3e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:47.699208 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb322b-287d-4b66-8b8b-3476060c89ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:47.700142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb322b-287d-4b66-8b8b-3476060c89ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:47.700580 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb322b-287d-4b66-8b8b-3476060c89ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:47.701092 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecb322b-287d-4b66-8b8b-3476060c89ee admin admin] PATH_INFO: `/v3/projects/75d007bc22884947b98f594e2813d2de` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:47.714603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793365d-ca6c-4211-b20c-07348acaf3e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:47.716118 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7793365d-ca6c-4211-b20c-07348acaf3e2 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:47.723280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb322b-287d-4b66-8b8b-3476060c89ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=75d007bc22884947b98f594e2813d2de)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:47.729747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 909/1818] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:47.737451 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecb322b-287d-4b66-8b8b-3476060c89ee admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:47.754752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793365d-ca6c-4211-b20c-07348acaf3e2 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:47.770057 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7793365d-ca6c-4211-b20c-07348acaf3e2 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:47.782147 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342d3ca-3334-4b14-97b6-76528ef1efcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:47.783162 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342d3ca-3334-4b14-97b6-76528ef1efcf service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:47.783867 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342d3ca-3334-4b14-97b6-76528ef1efcf service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:47.784792 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342d3ca-3334-4b14-97b6-76528ef1efcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:47.792655 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:47.811776 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342d3ca-3334-4b14-97b6-76528ef1efcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:47.815103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342d3ca-3334-4b14-97b6-76528ef1efcf service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:47.821331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-5ecb322b-287d-4b66-8b8b-3476060c89ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75d007bc22884947b98f594e2813d2de', 'request_id': 'req-5ecb322b-287d-4b66-8b8b-3476060c89ee'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:47.833022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-5ecb322b-287d-4b66-8b8b-3476060c89ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75d007bc22884947b98f594e2813d2de', 'request_id': 'req-5ecb322b-287d-4b66-8b8b-3476060c89ee'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:47.841835 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-5ecb322b-287d-4b66-8b8b-3476060c89ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75d007bc22884947b98f594e2813d2de', 'request_id': 'req-5ecb322b-287d-4b66-8b8b-3476060c89ee'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:47.842528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 910/1819] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:49:47.877297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-5ecb322b-287d-4b66-8b8b-3476060c89ee admin admin] The token cache is being invalidate because project 75d007bc22884947b98f594e2813d2de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:47.877602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-5ecb322b-287d-4b66-8b8b-3476060c89ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:47.878730 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-5ecb322b-287d-4b66-8b8b-3476060c89ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:47.884607 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 910/1820] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:47 2022] DELETE /identity/v3/projects/75d007bc22884947b98f594e2813d2de => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:47.885257 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342d3ca-3334-4b14-97b6-76528ef1efcf service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:47.901643 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342d3ca-3334-4b14-97b6-76528ef1efcf service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:48.071243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec536ef-9ca7-442b-909e-356f2a93c92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:48.072872 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec536ef-9ca7-442b-909e-356f2a93c92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:48.074475 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec536ef-9ca7-442b-909e-356f2a93c92f admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:48.075137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec536ef-9ca7-442b-909e-356f2a93c92f admin admin] PATH_INFO: `/v3/users/15e87d27a6c542ae91ae6b8784159aef` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:48.079071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec536ef-9ca7-442b-909e-356f2a93c92f admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e87d27a6c542ae91ae6b8784159aef)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:48.083983 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec536ef-9ca7-442b-909e-356f2a93c92f admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:48.111705 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:48.189925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-eec536ef-9ca7-442b-909e-356f2a93c92f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e87d27a6c542ae91ae6b8784159aef'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:48.191503 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-eec536ef-9ca7-442b-909e-356f2a93c92f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e87d27a6c542ae91ae6b8784159aef'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:48.209806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-eec536ef-9ca7-442b-909e-356f2a93c92f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e87d27a6c542ae91ae6b8784159aef'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:48.249826 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-eec536ef-9ca7-442b-909e-356f2a93c92f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e87d27a6c542ae91ae6b8784159aef'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:48.261154 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-eec536ef-9ca7-442b-909e-356f2a93c92f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e87d27a6c542ae91ae6b8784159aef'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:48.274458 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 911/1821] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:47 2022] DELETE /identity/v3/users/15e87d27a6c542ae91ae6b8784159aef => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:49:48.419236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb322b-287d-4b66-8b8b-3476060c89ee admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:48.422286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5ecb322b-287d-4b66-8b8b-3476060c89ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:48.687762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecb322b-287d-4b66-8b8b-3476060c89ee admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:48.855548 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df77e10-17ea-4883-af53-869dd7910324 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:48.860324 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df77e10-17ea-4883-af53-869dd7910324 service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:48.860922 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df77e10-17ea-4883-af53-869dd7910324 service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:48.861257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df77e10-17ea-4883-af53-869dd7910324 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:48.868275 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5df77e10-17ea-4883-af53-869dd7910324 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:48.886204 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df77e10-17ea-4883-af53-869dd7910324 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:48.893788 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df77e10-17ea-4883-af53-869dd7910324 service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:48.912592 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 911/1822] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:49.119884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec536ef-9ca7-442b-909e-356f2a93c92f admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:49.122314 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-eec536ef-9ca7-442b-909e-356f2a93c92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:49.299904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec536ef-9ca7-442b-909e-356f2a93c92f admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:49.305741 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df77e10-17ea-4883-af53-869dd7910324 service nova] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:49.307473 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5df77e10-17ea-4883-af53-869dd7910324 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:49.312157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1684ce-a918-40f1-bc20-da6183761864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:49.313071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1684ce-a918-40f1-bc20-da6183761864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:49.313462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1684ce-a918-40f1-bc20-da6183761864 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:49.313850 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1684ce-a918-40f1-bc20-da6183761864 admin admin] PATH_INFO: `/v3/projects/ea47af0d04a94cbda195be1a4c685044` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:49.316038 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1684ce-a918-40f1-bc20-da6183761864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea47af0d04a94cbda195be1a4c685044)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:49.319246 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1684ce-a918-40f1-bc20-da6183761864 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:49.352084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df77e10-17ea-4883-af53-869dd7910324 service nova] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:49.367755 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731f957-8492-4454-928a-5fd18e5db771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:49.368665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731f957-8492-4454-928a-5fd18e5db771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:49.368956 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731f957-8492-4454-928a-5fd18e5db771 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:49.369710 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731f957-8492-4454-928a-5fd18e5db771 admin admin] PATH_INFO: `/v3/projects/d3a4a1f42cc24479b210ba29ef58a75d` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:49.381738 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731f957-8492-4454-928a-5fd18e5db771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a4a1f42cc24479b210ba29ef58a75d)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:49.384154 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c731f957-8492-4454-928a-5fd18e5db771 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:49.415790 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-bc1684ce-a918-40f1-bc20-da6183761864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea47af0d04a94cbda195be1a4c685044', 'request_id': 'req-bc1684ce-a918-40f1-bc20-da6183761864'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:49.423002 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-bc1684ce-a918-40f1-bc20-da6183761864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea47af0d04a94cbda195be1a4c685044', 'request_id': 'req-bc1684ce-a918-40f1-bc20-da6183761864'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:49.432682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-bc1684ce-a918-40f1-bc20-da6183761864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea47af0d04a94cbda195be1a4c685044', 'request_id': 'req-bc1684ce-a918-40f1-bc20-da6183761864'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:49.449763 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-bc1684ce-a918-40f1-bc20-da6183761864 admin admin] The token cache is being invalidate because project ea47af0d04a94cbda195be1a4c685044 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:49.449763 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-bc1684ce-a918-40f1-bc20-da6183761864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:49.450301 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-bc1684ce-a918-40f1-bc20-da6183761864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:49.452292 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 912/1823] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:49 2022] DELETE /identity/v3/projects/ea47af0d04a94cbda195be1a4c685044 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:49.457540 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1684ce-a918-40f1-bc20-da6183761864 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:49.459935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-bc1684ce-a918-40f1-bc20-da6183761864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:49.474041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:49.486083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c731f957-8492-4454-928a-5fd18e5db771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a4a1f42cc24479b210ba29ef58a75d', 'request_id': 'req-c731f957-8492-4454-928a-5fd18e5db771'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:49.495091 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c731f957-8492-4454-928a-5fd18e5db771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a4a1f42cc24479b210ba29ef58a75d', 'request_id': 'req-c731f957-8492-4454-928a-5fd18e5db771'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:49.500777 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:49.502415 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c731f957-8492-4454-928a-5fd18e5db771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a4a1f42cc24479b210ba29ef58a75d', 'request_id': 'req-c731f957-8492-4454-928a-5fd18e5db771'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:49.527665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c731f957-8492-4454-928a-5fd18e5db771 admin admin] The token cache is being invalidate because project d3a4a1f42cc24479b210ba29ef58a75d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:49.528637 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c731f957-8492-4454-928a-5fd18e5db771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:49.529351 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c731f957-8492-4454-928a-5fd18e5db771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:49.531641 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 912/1824] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:49 2022] DELETE /identity/v3/projects/d3a4a1f42cc24479b210ba29ef58a75d => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:49:49.536297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731f957-8492-4454-928a-5fd18e5db771 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:49.538222 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c731f957-8492-4454-928a-5fd18e5db771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:49.602634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1684ce-a918-40f1-bc20-da6183761864 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:49.667492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731f957-8492-4454-928a-5fd18e5db771 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:49.681163 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfab95-6176-4254-a1ab-cc2d1b7dd8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:49.681850 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfab95-6176-4254-a1ab-cc2d1b7dd8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:49.682128 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfab95-6176-4254-a1ab-cc2d1b7dd8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:49.682449 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfab95-6176-4254-a1ab-cc2d1b7dd8e7 admin admin] PATH_INFO: `/v3/users/a77c8f4e49854e4c90b27fea5c126ff8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:49.685367 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfab95-6176-4254-a1ab-cc2d1b7dd8e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a77c8f4e49854e4c90b27fea5c126ff8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:49.687557 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bfab95-6176-4254-a1ab-cc2d1b7dd8e7 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:49.763792 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-67bfab95-6176-4254-a1ab-cc2d1b7dd8e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a77c8f4e49854e4c90b27fea5c126ff8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:49.766550 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-67bfab95-6176-4254-a1ab-cc2d1b7dd8e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a77c8f4e49854e4c90b27fea5c126ff8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:49.773920 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1c851-317a-4432-98e4-e6ea752b1cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:49.775093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1c851-317a-4432-98e4-e6ea752b1cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:49.775629 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1c851-317a-4432-98e4-e6ea752b1cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:49.776124 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d1c851-317a-4432-98e4-e6ea752b1cfd admin admin] PATH_INFO: `/v3/users/b9786fb83c4c4396a86bc632b252ecfd` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:49.778247 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1c851-317a-4432-98e4-e6ea752b1cfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9786fb83c4c4396a86bc632b252ecfd)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:49.780714 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d1c851-317a-4432-98e4-e6ea752b1cfd admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:49.782205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-67bfab95-6176-4254-a1ab-cc2d1b7dd8e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a77c8f4e49854e4c90b27fea5c126ff8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:49.803459 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-67bfab95-6176-4254-a1ab-cc2d1b7dd8e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a77c8f4e49854e4c90b27fea5c126ff8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:49.804237 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-67bfab95-6176-4254-a1ab-cc2d1b7dd8e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a77c8f4e49854e4c90b27fea5c126ff8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:49.830596 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 913/1825] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:49 2022] DELETE /identity/v3/users/a77c8f4e49854e4c90b27fea5c126ff8 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:49:49.833646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfab95-6176-4254-a1ab-cc2d1b7dd8e7 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:49.837958 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-67bfab95-6176-4254-a1ab-cc2d1b7dd8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:49.855665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-75d1c851-317a-4432-98e4-e6ea752b1cfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9786fb83c4c4396a86bc632b252ecfd'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:49.856699 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-75d1c851-317a-4432-98e4-e6ea752b1cfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9786fb83c4c4396a86bc632b252ecfd'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:49.871402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-75d1c851-317a-4432-98e4-e6ea752b1cfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9786fb83c4c4396a86bc632b252ecfd'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:49.880125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-75d1c851-317a-4432-98e4-e6ea752b1cfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9786fb83c4c4396a86bc632b252ecfd'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:49.911290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-75d1c851-317a-4432-98e4-e6ea752b1cfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9786fb83c4c4396a86bc632b252ecfd'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:49.911565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:49.933148 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 913/1826] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:49 2022] DELETE /identity/v3/users/b9786fb83c4c4396a86bc632b252ecfd => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:49.940539 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfab95-6176-4254-a1ab-cc2d1b7dd8e7 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:50.004104 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1c851-317a-4432-98e4-e6ea752b1cfd admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:50.005739 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-75d1c851-317a-4432-98e4-e6ea752b1cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:50.028458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ce586-c4bd-4a43-b818-913b42f93e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:50.029254 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ce586-c4bd-4a43-b818-913b42f93e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:50.029570 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ce586-c4bd-4a43-b818-913b42f93e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:50.029897 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ce586-c4bd-4a43-b818-913b42f93e6c admin admin] PATH_INFO: `/v3/projects/a78ced0a2a584178b0ed34a711954010` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:50.031585 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ce586-c4bd-4a43-b818-913b42f93e6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a78ced0a2a584178b0ed34a711954010)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:50.033890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ce586-c4bd-4a43-b818-913b42f93e6c admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:50.083244 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:50.125695 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d1c851-317a-4432-98e4-e6ea752b1cfd admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:50.128250 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-6b3ce586-c4bd-4a43-b818-913b42f93e6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a78ced0a2a584178b0ed34a711954010', 'request_id': 'req-6b3ce586-c4bd-4a43-b818-913b42f93e6c'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.136763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-6b3ce586-c4bd-4a43-b818-913b42f93e6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a78ced0a2a584178b0ed34a711954010', 'request_id': 'req-6b3ce586-c4bd-4a43-b818-913b42f93e6c'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.144326 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-6b3ce586-c4bd-4a43-b818-913b42f93e6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a78ced0a2a584178b0ed34a711954010', 'request_id': 'req-6b3ce586-c4bd-4a43-b818-913b42f93e6c'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.169241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-6b3ce586-c4bd-4a43-b818-913b42f93e6c admin admin] The token cache is being invalidate because project a78ced0a2a584178b0ed34a711954010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:50.169618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-6b3ce586-c4bd-4a43-b818-913b42f93e6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.171053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-6b3ce586-c4bd-4a43-b818-913b42f93e6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.175208 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 914/1827] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:49 2022] DELETE /identity/v3/projects/a78ced0a2a584178b0ed34a711954010 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:50.178971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ce586-c4bd-4a43-b818-913b42f93e6c admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:50.181275 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-6b3ce586-c4bd-4a43-b818-913b42f93e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:50.251756 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfdfbd-3390-43ae-bac0-fc074d339772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:50.252597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfdfbd-3390-43ae-bac0-fc074d339772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:50.253105 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfdfbd-3390-43ae-bac0-fc074d339772 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:50.253324 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfdfbd-3390-43ae-bac0-fc074d339772 admin admin] PATH_INFO: `/v3/projects/afb0c26610374ca19d4bbfabaff7dbb2` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:50.255162 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cfdfbd-3390-43ae-bac0-fc074d339772 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afb0c26610374ca19d4bbfabaff7dbb2)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:50.257327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cfdfbd-3390-43ae-bac0-fc074d339772 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:50.277659 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ce586-c4bd-4a43-b818-913b42f93e6c admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:50.283944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23989633-1fcb-45bb-a9e8-5350ebeb5aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:50.284654 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23989633-1fcb-45bb-a9e8-5350ebeb5aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:50.285521 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23989633-1fcb-45bb-a9e8-5350ebeb5aff admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:50.285975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23989633-1fcb-45bb-a9e8-5350ebeb5aff admin admin] PATH_INFO: `/v3/users/71511047b380415ca7dba9baf4f19754` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:50.287989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23989633-1fcb-45bb-a9e8-5350ebeb5aff admin admin] RBAC: Authorizing `identity:delete_user(user_id=71511047b380415ca7dba9baf4f19754)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:50.291020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23989633-1fcb-45bb-a9e8-5350ebeb5aff admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:50.313360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-21cfdfbd-3390-43ae-bac0-fc074d339772 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afb0c26610374ca19d4bbfabaff7dbb2', 'request_id': 'req-21cfdfbd-3390-43ae-bac0-fc074d339772'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.320476 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-21cfdfbd-3390-43ae-bac0-fc074d339772 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afb0c26610374ca19d4bbfabaff7dbb2', 'request_id': 'req-21cfdfbd-3390-43ae-bac0-fc074d339772'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.322552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:50.333243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-21cfdfbd-3390-43ae-bac0-fc074d339772 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afb0c26610374ca19d4bbfabaff7dbb2', 'request_id': 'req-21cfdfbd-3390-43ae-bac0-fc074d339772'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.350925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-21cfdfbd-3390-43ae-bac0-fc074d339772 admin admin] The token cache is being invalidate because project afb0c26610374ca19d4bbfabaff7dbb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:50.352267 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-21cfdfbd-3390-43ae-bac0-fc074d339772 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.353202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-21cfdfbd-3390-43ae-bac0-fc074d339772 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.355038 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 914/1828] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:50 2022] DELETE /identity/v3/projects/afb0c26610374ca19d4bbfabaff7dbb2 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:49:50.356059 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfdfbd-3390-43ae-bac0-fc074d339772 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:50.358185 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-21cfdfbd-3390-43ae-bac0-fc074d339772 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:50.361146 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-23989633-1fcb-45bb-a9e8-5350ebeb5aff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71511047b380415ca7dba9baf4f19754'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.362212 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-23989633-1fcb-45bb-a9e8-5350ebeb5aff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71511047b380415ca7dba9baf4f19754'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.374552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-23989633-1fcb-45bb-a9e8-5350ebeb5aff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71511047b380415ca7dba9baf4f19754'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.395987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-23989633-1fcb-45bb-a9e8-5350ebeb5aff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71511047b380415ca7dba9baf4f19754'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.396738 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-23989633-1fcb-45bb-a9e8-5350ebeb5aff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71511047b380415ca7dba9baf4f19754'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.416155 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 915/1829] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:50 2022] DELETE /identity/v3/users/71511047b380415ca7dba9baf4f19754 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:50.416155 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23989633-1fcb-45bb-a9e8-5350ebeb5aff admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:50.416155 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-23989633-1fcb-45bb-a9e8-5350ebeb5aff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:50.435777 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfdfbd-3390-43ae-bac0-fc074d339772 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:50.472273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:50.519094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23989633-1fcb-45bb-a9e8-5350ebeb5aff admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:50.522424 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17c131-580d-4e52-b3bb-f32ac31fa413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:50.523101 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17c131-580d-4e52-b3bb-f32ac31fa413 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:50.523429 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17c131-580d-4e52-b3bb-f32ac31fa413 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:50.524373 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17c131-580d-4e52-b3bb-f32ac31fa413 admin admin] PATH_INFO: `/v3/projects/d7befb16800d458c95c057390bb9d76c` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:50.524860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefa415-1a8b-41ec-9dfa-58928436d2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:50.525717 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefa415-1a8b-41ec-9dfa-58928436d2e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:50.526122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefa415-1a8b-41ec-9dfa-58928436d2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:50.526440 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefa415-1a8b-41ec-9dfa-58928436d2e9 admin admin] PATH_INFO: `/v3/projects/ee8b18a72cde4a4f9691db679966e179` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:50.526732 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17c131-580d-4e52-b3bb-f32ac31fa413 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7befb16800d458c95c057390bb9d76c)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:50.527865 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefa415-1a8b-41ec-9dfa-58928436d2e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8b18a72cde4a4f9691db679966e179)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:50.529987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefa415-1a8b-41ec-9dfa-58928436d2e9 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:50.531512 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17c131-580d-4e52-b3bb-f32ac31fa413 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:50.602979 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-0cefa415-1a8b-41ec-9dfa-58928436d2e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8b18a72cde4a4f9691db679966e179', 'request_id': 'req-0cefa415-1a8b-41ec-9dfa-58928436d2e9'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.611499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-0cefa415-1a8b-41ec-9dfa-58928436d2e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8b18a72cde4a4f9691db679966e179', 'request_id': 'req-0cefa415-1a8b-41ec-9dfa-58928436d2e9'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.620834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-0cefa415-1a8b-41ec-9dfa-58928436d2e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8b18a72cde4a4f9691db679966e179', 'request_id': 'req-0cefa415-1a8b-41ec-9dfa-58928436d2e9'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.628885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-6d17c131-580d-4e52-b3bb-f32ac31fa413 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7befb16800d458c95c057390bb9d76c', 'request_id': 'req-6d17c131-580d-4e52-b3bb-f32ac31fa413'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.637852 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-6d17c131-580d-4e52-b3bb-f32ac31fa413 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7befb16800d458c95c057390bb9d76c', 'request_id': 'req-6d17c131-580d-4e52-b3bb-f32ac31fa413'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.638492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-0cefa415-1a8b-41ec-9dfa-58928436d2e9 admin admin] The token cache is being invalidate because project ee8b18a72cde4a4f9691db679966e179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:50.638953 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-0cefa415-1a8b-41ec-9dfa-58928436d2e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.639791 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-0cefa415-1a8b-41ec-9dfa-58928436d2e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.642694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 916/1830] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:50 2022] DELETE /identity/v3/projects/ee8b18a72cde4a4f9691db679966e179 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:50.644765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bcdd0-474a-48b6-b5c7-a269c7dbb2e5 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:50.645077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bcdd0-474a-48b6-b5c7-a269c7dbb2e5 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:50.645327 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bcdd0-474a-48b6-b5c7-a269c7dbb2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:50.651181 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-6d17c131-580d-4e52-b3bb-f32ac31fa413 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7befb16800d458c95c057390bb9d76c', 'request_id': 'req-6d17c131-580d-4e52-b3bb-f32ac31fa413'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.667280 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-6d17c131-580d-4e52-b3bb-f32ac31fa413 admin admin] The token cache is being invalidate because project d7befb16800d458c95c057390bb9d76c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:50.667596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-6d17c131-580d-4e52-b3bb-f32ac31fa413 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.671204 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-6d17c131-580d-4e52-b3bb-f32ac31fa413 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:50.677555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 915/1831] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:50 2022] DELETE /identity/v3/projects/d7befb16800d458c95c057390bb9d76c => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:50.677555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146a21f-5d97-4a84-ad79-e683477cddd4 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:50.677555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146a21f-5d97-4a84-ad79-e683477cddd4 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:50.677555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f146a21f-5d97-4a84-ad79-e683477cddd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:50.683728 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-a40bcdd0-474a-48b6-b5c7-a269c7dbb2e5 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:50.685198 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a40bcdd0-474a-48b6-b5c7-a269c7dbb2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:50.703463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-f146a21f-5d97-4a84-ad79-e683477cddd4 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:50.705495 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-f146a21f-5d97-4a84-ad79-e683477cddd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:50.725088 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:50.774213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 917/1832] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:50.774213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75227a9a-6e40-43fe-b411-d8bcf1a72e46 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:50.774213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75227a9a-6e40-43fe-b411-d8bcf1a72e46 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:50.774213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75227a9a-6e40-43fe-b411-d8bcf1a72e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:50.792301 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 916/1833] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:50.793179 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8559ff2-91a9-4c88-b616-d0f4288d584b None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:50.793596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8559ff2-91a9-4c88-b616-d0f4288d584b None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:50.793870 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8559ff2-91a9-4c88-b616-d0f4288d584b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:50.810634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-75227a9a-6e40-43fe-b411-d8bcf1a72e46 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:50.813969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-75227a9a-6e40-43fe-b411-d8bcf1a72e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:50.829292 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 918/1834] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:50.831212 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c9327-7e7f-46ae-afc6-15f69354c698 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:50.831615 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c9327-7e7f-46ae-afc6-15f69354c698 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:50.832287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0c9327-7e7f-46ae-afc6-15f69354c698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:50.840442 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-d8559ff2-91a9-4c88-b616-d0f4288d584b None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:50.844487 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d8559ff2-91a9-4c88-b616-d0f4288d584b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:50.864604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 917/1835] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:50.864604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074901ab-a7d4-44f1-964c-cad80eed0fac None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:50.864604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074901ab-a7d4-44f1-964c-cad80eed0fac None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:50.864604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074901ab-a7d4-44f1-964c-cad80eed0fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:50.866627 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-8b0c9327-7e7f-46ae-afc6-15f69354c698 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:50.867891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8b0c9327-7e7f-46ae-afc6-15f69354c698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:50.879500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 919/1836] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:50.880119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c9327-7e7f-46ae-afc6-15f69354c698 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:50.890848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0c9327-7e7f-46ae-afc6-15f69354c698 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:50.891977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-074901ab-a7d4-44f1-964c-cad80eed0fac None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:50.893328 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-074901ab-a7d4-44f1-964c-cad80eed0fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:50.896436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bd043-0a84-4865-a454-865e485ce4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:50.897139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bd043-0a84-4865-a454-865e485ce4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:50.897488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bd043-0a84-4865-a454-865e485ce4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:50.897777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bd043-0a84-4865-a454-865e485ce4a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:50.899106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bd043-0a84-4865-a454-865e485ce4a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:50.899420 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bd043-0a84-4865-a454-865e485ce4a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:50.901050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bd043-0a84-4865-a454-865e485ce4a6 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:50.905506 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 918/1837] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:50.906570 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074901ab-a7d4-44f1-964c-cad80eed0fac None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:50.915055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 920/1838] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:49:50.915250 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bd043-0a84-4865-a454-865e485ce4a6 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:50.925923 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074901ab-a7d4-44f1-964c-cad80eed0fac None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:50.927327 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bd043-0a84-4865-a454-865e485ce4a6 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:50.933251 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe07c98-d52f-4a2c-bf30-c1df7a17215d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:50.933737 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe07c98-d52f-4a2c-bf30-c1df7a17215d admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:50.933991 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe07c98-d52f-4a2c-bf30-c1df7a17215d admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:50.934870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe07c98-d52f-4a2c-bf30-c1df7a17215d admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:50.938618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe07c98-d52f-4a2c-bf30-c1df7a17215d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:50.938618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe07c98-d52f-4a2c-bf30-c1df7a17215d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:50.939431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe07c98-d52f-4a2c-bf30-c1df7a17215d admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:50.945834 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951c534-1fc5-45cf-8014-2648e9fcb585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:50.946892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951c534-1fc5-45cf-8014-2648e9fcb585 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:50.947905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951c534-1fc5-45cf-8014-2648e9fcb585 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:50.947905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951c534-1fc5-45cf-8014-2648e9fcb585 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:50.950834 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951c534-1fc5-45cf-8014-2648e9fcb585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:50.952995 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951c534-1fc5-45cf-8014-2648e9fcb585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:50.955142 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8951c534-1fc5-45cf-8014-2648e9fcb585 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:50.958054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 921/1839] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:49:50.959839 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe07c98-d52f-4a2c-bf30-c1df7a17215d admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:50.984325 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe07c98-d52f-4a2c-bf30-c1df7a17215d admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:50.985163 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 919/1840] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:49:50.988584 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951c534-1fc5-45cf-8014-2648e9fcb585 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:50.994315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f85079-b313-4527-835a-cfeb682089ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:50.995087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f85079-b313-4527-835a-cfeb682089ff admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:50.995433 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f85079-b313-4527-835a-cfeb682089ff admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:50.995779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f85079-b313-4527-835a-cfeb682089ff admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:50.996569 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f85079-b313-4527-835a-cfeb682089ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:50.998786 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f85079-b313-4527-835a-cfeb682089ff admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:51.005165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951c534-1fc5-45cf-8014-2648e9fcb585 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:51.011512 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ee979-e74a-4162-b0a8-de90e4de3e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:51.012416 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ee979-e74a-4162-b0a8-de90e4de3e53 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:51.012939 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ee979-e74a-4162-b0a8-de90e4de3e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:51.013391 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ee979-e74a-4162-b0a8-de90e4de3e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:51.014311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ee979-e74a-4162-b0a8-de90e4de3e53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:51.019506 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ee979-e74a-4162-b0a8-de90e4de3e53 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:51.033757 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 922/1841] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:50 2022] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:51.037362 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f85079-b313-4527-835a-cfeb682089ff admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:51.066186 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 920/1842] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:50 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:51.067402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ee979-e74a-4162-b0a8-de90e4de3e53 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:51.069300 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-f38ee979-e74a-4162-b0a8-de90e4de3e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:51.125914 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:51.150941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f85079-b313-4527-835a-cfeb682089ff admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:51.239073 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ee979-e74a-4162-b0a8-de90e4de3e53 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:51.240547 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35872f5b-2be4-48f1-ac67-690172d1a555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:51.241373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35872f5b-2be4-48f1-ac67-690172d1a555 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:51.242020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35872f5b-2be4-48f1-ac67-690172d1a555 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:51.243114 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35872f5b-2be4-48f1-ac67-690172d1a555 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:51.243893 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35872f5b-2be4-48f1-ac67-690172d1a555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:51.246858 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35872f5b-2be4-48f1-ac67-690172d1a555 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:51.247966 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203e4cc-7944-456d-8e92-a95454cb3291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:51.248840 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203e4cc-7944-456d-8e92-a95454cb3291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:51.249427 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203e4cc-7944-456d-8e92-a95454cb3291 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:51.249890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203e4cc-7944-456d-8e92-a95454cb3291 admin admin] PATH_INFO: `/v3/projects/633a9ac8fe5249d0a4679148a62a001d` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:51.251899 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203e4cc-7944-456d-8e92-a95454cb3291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=633a9ac8fe5249d0a4679148a62a001d)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:51.255428 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203e4cc-7944-456d-8e92-a95454cb3291 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:51.284867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 923/1843] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:51 2022] POST /identity/v3/projects => generated 363 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:51.285851 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35872f5b-2be4-48f1-ac67-690172d1a555 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:51.290418 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:51.333758 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8203e4cc-7944-456d-8e92-a95454cb3291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633a9ac8fe5249d0a4679148a62a001d', 'request_id': 'req-8203e4cc-7944-456d-8e92-a95454cb3291'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:51.341580 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8203e4cc-7944-456d-8e92-a95454cb3291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633a9ac8fe5249d0a4679148a62a001d', 'request_id': 'req-8203e4cc-7944-456d-8e92-a95454cb3291'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:51.350806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8203e4cc-7944-456d-8e92-a95454cb3291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633a9ac8fe5249d0a4679148a62a001d', 'request_id': 'req-8203e4cc-7944-456d-8e92-a95454cb3291'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:51.364209 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8203e4cc-7944-456d-8e92-a95454cb3291 admin admin] The token cache is being invalidate because project 633a9ac8fe5249d0a4679148a62a001d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:51.364566 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8203e4cc-7944-456d-8e92-a95454cb3291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:51.365147 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8203e4cc-7944-456d-8e92-a95454cb3291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:51.366896 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 921/1844] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:51 2022] DELETE /identity/v3/projects/633a9ac8fe5249d0a4679148a62a001d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:51.367923 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203e4cc-7944-456d-8e92-a95454cb3291 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:51.369233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8203e4cc-7944-456d-8e92-a95454cb3291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:51.371977 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35872f5b-2be4-48f1-ac67-690172d1a555 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:51.437852 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba465c1-8924-4985-8b37-261adf459f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:51.438882 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba465c1-8924-4985-8b37-261adf459f1f admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:51.439362 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba465c1-8924-4985-8b37-261adf459f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:51.439824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba465c1-8924-4985-8b37-261adf459f1f admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:51.440664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba465c1-8924-4985-8b37-261adf459f1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:51.442952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba465c1-8924-4985-8b37-261adf459f1f admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:51.465162 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203e4cc-7944-456d-8e92-a95454cb3291 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:51.470440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8fca8-f113-4228-a41e-58e2aea4e9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:51.470603 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 924/1845] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:51 2022] POST /identity/v3/users => generated 290 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:51.471111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8fca8-f113-4228-a41e-58e2aea4e9c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:51.471237 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba465c1-8924-4985-8b37-261adf459f1f admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:51.471507 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8fca8-f113-4228-a41e-58e2aea4e9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:51.471873 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee8fca8-f113-4228-a41e-58e2aea4e9c1 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:51.472608 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8fca8-f113-4228-a41e-58e2aea4e9c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:51.474501 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-aba465c1-8924-4985-8b37-261adf459f1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:51.475611 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee8fca8-f113-4228-a41e-58e2aea4e9c1 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:51.487683 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba465c1-8924-4985-8b37-261adf459f1f admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:51.493492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102b88f-75b5-4bd7-8e5a-242422a99037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:51.494177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102b88f-75b5-4bd7-8e5a-242422a99037 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:51.494563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102b88f-75b5-4bd7-8e5a-242422a99037 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:51.494842 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102b88f-75b5-4bd7-8e5a-242422a99037 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:51.495637 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102b88f-75b5-4bd7-8e5a-242422a99037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:51.497681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102b88f-75b5-4bd7-8e5a-242422a99037 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:51.503748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 922/1846] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:51 2022] POST /identity/v3/users => generated 285 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:51.503748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8fca8-f113-4228-a41e-58e2aea4e9c1 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:51.505633 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-2ee8fca8-f113-4228-a41e-58e2aea4e9c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:51.525203 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee8fca8-f113-4228-a41e-58e2aea4e9c1 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:51.531379 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 925/1847] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:51 2022] POST /identity/v3/users => generated 282 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:51.531887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35b5e1-cea7-48d2-a3bc-bffed27e6108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:51.532224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102b88f-75b5-4bd7-8e5a-242422a99037 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:51.533045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35b5e1-cea7-48d2-a3bc-bffed27e6108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:51.533505 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35b5e1-cea7-48d2-a3bc-bffed27e6108 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:51.533803 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b35b5e1-cea7-48d2-a3bc-bffed27e6108 admin admin] PATH_INFO: `/v3/users/f7b959435f42465a8dccb29b2596708b` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:51.535443 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d102b88f-75b5-4bd7-8e5a-242422a99037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:51.535865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35b5e1-cea7-48d2-a3bc-bffed27e6108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7b959435f42465a8dccb29b2596708b)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:51.537804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b35b5e1-cea7-48d2-a3bc-bffed27e6108 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:51.547395 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102b88f-75b5-4bd7-8e5a-242422a99037 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:51.552390 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e723eb-1d2c-451f-8687-c9047edb8bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:51.552957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e723eb-1d2c-451f-8687-c9047edb8bed admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:51.553248 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e723eb-1d2c-451f-8687-c9047edb8bed admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:51.553532 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e723eb-1d2c-451f-8687-c9047edb8bed admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:51.554236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e723eb-1d2c-451f-8687-c9047edb8bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:51.556400 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e723eb-1d2c-451f-8687-c9047edb8bed admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:51.568358 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 926/1848] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:51.569730 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e723eb-1d2c-451f-8687-c9047edb8bed admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:51.579151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:51.591523 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e723eb-1d2c-451f-8687-c9047edb8bed admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:51.597245 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef20205-b5b7-4472-ab62-abc1d7eecdd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:51.601489 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef20205-b5b7-4472-ab62-abc1d7eecdd3 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:51.601489 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef20205-b5b7-4472-ab62-abc1d7eecdd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:51.601489 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef20205-b5b7-4472-ab62-abc1d7eecdd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:51.601489 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef20205-b5b7-4472-ab62-abc1d7eecdd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:51.601489 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef20205-b5b7-4472-ab62-abc1d7eecdd3 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:51.612991 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-9b35b5e1-cea7-48d2-a3bc-bffed27e6108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7b959435f42465a8dccb29b2596708b'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:51.613671 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-9b35b5e1-cea7-48d2-a3bc-bffed27e6108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7b959435f42465a8dccb29b2596708b'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:51.621312 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 927/1849] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:51.622434 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef20205-b5b7-4472-ab62-abc1d7eecdd3 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:51.629282 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-9b35b5e1-cea7-48d2-a3bc-bffed27e6108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7b959435f42465a8dccb29b2596708b'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:51.638662 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef20205-b5b7-4472-ab62-abc1d7eecdd3 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:51.640362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-9b35b5e1-cea7-48d2-a3bc-bffed27e6108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7b959435f42465a8dccb29b2596708b'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:51.646318 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc7402-eee0-4ad7-a040-611dabee0e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:51.647056 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc7402-eee0-4ad7-a040-611dabee0e7e admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:51.647970 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc7402-eee0-4ad7-a040-611dabee0e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:51.647970 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc7402-eee0-4ad7-a040-611dabee0e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:51.649734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc7402-eee0-4ad7-a040-611dabee0e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:51.651795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc7402-eee0-4ad7-a040-611dabee0e7e admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:51.653040 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-9b35b5e1-cea7-48d2-a3bc-bffed27e6108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7b959435f42465a8dccb29b2596708b'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:51.661358 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 923/1850] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:51 2022] DELETE /identity/v3/users/f7b959435f42465a8dccb29b2596708b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:51.662752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35b5e1-cea7-48d2-a3bc-bffed27e6108 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:51.664536 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-9b35b5e1-cea7-48d2-a3bc-bffed27e6108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:51.670383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 928/1851] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:51.673674 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc7402-eee0-4ad7-a040-611dabee0e7e admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:51.676899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-dfcc7402-eee0-4ad7-a040-611dabee0e7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:51.700286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc7402-eee0-4ad7-a040-611dabee0e7e admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:51.747528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b35b5e1-cea7-48d2-a3bc-bffed27e6108 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:51.753204 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88dbcb-212d-4929-b680-72630c6420a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:51.754085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88dbcb-212d-4929-b680-72630c6420a3 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:51.754562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88dbcb-212d-4929-b680-72630c6420a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:51.755036 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af88dbcb-212d-4929-b680-72630c6420a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:51.756154 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88dbcb-212d-4929-b680-72630c6420a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:51.759064 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af88dbcb-212d-4929-b680-72630c6420a3 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:51.774968 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 924/1852] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:51.775844 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88dbcb-212d-4929-b680-72630c6420a3 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:51.778897 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:51.782890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-af88dbcb-212d-4929-b680-72630c6420a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:51.803059 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af88dbcb-212d-4929-b680-72630c6420a3 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:51.807110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd0691-ac6b-4240-8633-cdba67edec69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:51.807963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd0691-ac6b-4240-8633-cdba67edec69 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:51.808489 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd0691-ac6b-4240-8633-cdba67edec69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:51.808852 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f17d3-ec05-4881-a196-0ccbe48f8b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:51.809092 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd0691-ac6b-4240-8633-cdba67edec69 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:51.809496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f17d3-ec05-4881-a196-0ccbe48f8b49 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:51.809999 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f17d3-ec05-4881-a196-0ccbe48f8b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:51.810296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f17d3-ec05-4881-a196-0ccbe48f8b49 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:51.810570 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd0691-ac6b-4240-8633-cdba67edec69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:51.811308 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f17d3-ec05-4881-a196-0ccbe48f8b49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:51.812522 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd0691-ac6b-4240-8633-cdba67edec69 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:51.813539 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f17d3-ec05-4881-a196-0ccbe48f8b49 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:51.832385 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 925/1853] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:51.832385 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f17d3-ec05-4881-a196-0ccbe48f8b49 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:51.840454 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 929/1854] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:51.841636 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd0691-ac6b-4240-8633-cdba67edec69 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:51.843325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f17d3-ec05-4881-a196-0ccbe48f8b49 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:51.851810 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f84be-7571-4efa-853e-900ae0959747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:51.854108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f84be-7571-4efa-853e-900ae0959747 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:51.854636 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f84be-7571-4efa-853e-900ae0959747 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:51.854929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1f84be-7571-4efa-853e-900ae0959747 admin admin] PATH_INFO: `/v3/projects/be9e1893fcf249cda3b50f55f46fba17/users/4b9e47a8e67446dabb6ab12642e57730/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:51.858147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd0691-ac6b-4240-8633-cdba67edec69 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:51.863975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6daace-e27f-4f68-b47d-a6db38171256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:51.865027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6daace-e27f-4f68-b47d-a6db38171256 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:51.865507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6daace-e27f-4f68-b47d-a6db38171256 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:51.866019 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6daace-e27f-4f68-b47d-a6db38171256 admin admin] PATH_INFO: `/v3/projects/cefb26bb94b142a59f4ce7ba20d2b119/users/be005be989584c399b3a9765b61ec130/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:51.877001 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f84be-7571-4efa-853e-900ae0959747 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be9e1893fcf249cda3b50f55f46fba17, user_id=4b9e47a8e67446dabb6ab12642e57730, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:51.880577 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1f84be-7571-4efa-853e-900ae0959747 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:51.883458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6daace-e27f-4f68-b47d-a6db38171256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cefb26bb94b142a59f4ce7ba20d2b119, user_id=be005be989584c399b3a9765b61ec130, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:51.886613 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6daace-e27f-4f68-b47d-a6db38171256 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:51.900232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 926/1855] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:51 2022] PUT /identity/v3/projects/be9e1893fcf249cda3b50f55f46fba17/users/4b9e47a8e67446dabb6ab12642e57730/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:51.902173 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f84be-7571-4efa-853e-900ae0959747 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:51.920413 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 930/1856] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:51 2022] PUT /identity/v3/projects/cefb26bb94b142a59f4ce7ba20d2b119/users/be005be989584c399b3a9765b61ec130/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:51.921948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0a5ef-65ed-4a07-94cd-50e3a78584bf None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:51.922222 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0a5ef-65ed-4a07-94cd-50e3a78584bf None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:51.922909 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0a5ef-65ed-4a07-94cd-50e3a78584bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:51.960580 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-8cc0a5ef-65ed-4a07-94cd-50e3a78584bf None None] MFA Rules not processed for user `4b9e47a8e67446dabb6ab12642e57730`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:51.961879 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8cc0a5ef-65ed-4a07-94cd-50e3a78584bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:52.019723 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1f84be-7571-4efa-853e-900ae0959747 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:52.055152 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:52.143168 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0456a9a-6951-4bf3-8b04-1e8f3213a9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:52.144630 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0456a9a-6951-4bf3-8b04-1e8f3213a9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:52.145064 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0456a9a-6951-4bf3-8b04-1e8f3213a9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:52.145557 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0456a9a-6951-4bf3-8b04-1e8f3213a9c4 admin admin] PATH_INFO: `/v3/projects/ad14d440e13442f98f4ea5b0cdd79de4/users/a5f9c72ff608449bad6f8331a39e6a75/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:52.150636 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 931/1857] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:52.152340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a15d6-a22f-4825-99a5-78e7e2ef56db None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:52.152781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a15d6-a22f-4825-99a5-78e7e2ef56db None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:52.153284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a15d6-a22f-4825-99a5-78e7e2ef56db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:52.174737 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0456a9a-6951-4bf3-8b04-1e8f3213a9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad14d440e13442f98f4ea5b0cdd79de4, user_id=a5f9c72ff608449bad6f8331a39e6a75, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:52.179638 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0456a9a-6951-4bf3-8b04-1e8f3213a9c4 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:52.188249 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-6b7a15d6-a22f-4825-99a5-78e7e2ef56db None None] MFA Rules not processed for user `be005be989584c399b3a9765b61ec130`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:52.195859 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-6b7a15d6-a22f-4825-99a5-78e7e2ef56db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:52.198470 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 927/1858] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:51 2022] PUT /identity/v3/projects/ad14d440e13442f98f4ea5b0cdd79de4/users/a5f9c72ff608449bad6f8331a39e6a75/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:52.199431 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0456a9a-6951-4bf3-8b04-1e8f3213a9c4 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:52.304109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0456a9a-6951-4bf3-8b04-1e8f3213a9c4 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:52.310317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1f8fd-5d68-4783-a000-56c05dc262f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:52.310943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1f8fd-5d68-4783-a000-56c05dc262f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:52.311220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1f8fd-5d68-4783-a000-56c05dc262f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:52.311513 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1f8fd-5d68-4783-a000-56c05dc262f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:52.312169 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1f8fd-5d68-4783-a000-56c05dc262f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:52.314647 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1f8fd-5d68-4783-a000-56c05dc262f3 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:52.362410 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 932/1859] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:52 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:52.363934 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d688d-470c-4b06-9baf-58805359b5aa None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:52.364014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 928/1860] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:52 2022] POST /identity/v3/projects => generated 379 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:52.364215 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d688d-470c-4b06-9baf-58805359b5aa None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:52.364417 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554d688d-470c-4b06-9baf-58805359b5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:52.364871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1f8fd-5d68-4783-a000-56c05dc262f3 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:52.436520 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-554d688d-470c-4b06-9baf-58805359b5aa None None] MFA Rules not processed for user `a5f9c72ff608449bad6f8331a39e6a75`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:52.438278 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-554d688d-470c-4b06-9baf-58805359b5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:52.470307 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1f8fd-5d68-4783-a000-56c05dc262f3 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:52.478904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbab99a-54be-419b-8a3a-0a8705228b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:52.481907 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbab99a-54be-419b-8a3a-0a8705228b04 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:52.482374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbab99a-54be-419b-8a3a-0a8705228b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:52.482674 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbab99a-54be-419b-8a3a-0a8705228b04 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:52.484078 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbab99a-54be-419b-8a3a-0a8705228b04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:52.486742 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbab99a-54be-419b-8a3a-0a8705228b04 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:52.509816 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:52.562990 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 929/1861] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:52 2022] POST /identity/v3/projects => generated 363 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:52.564167 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbab99a-54be-419b-8a3a-0a8705228b04 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:52.577314 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 933/1862] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:52.577314 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d688d-470c-4b06-9baf-58805359b5aa None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:52.578772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-554d688d-470c-4b06-9baf-58805359b5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:52.585086 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:52.600428 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554d688d-470c-4b06-9baf-58805359b5aa None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:52.683220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60200a21-e3be-4e4d-bb0c-56537f16b136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:52.684625 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60200a21-e3be-4e4d-bb0c-56537f16b136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:52.684754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60200a21-e3be-4e4d-bb0c-56537f16b136 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:52.685041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60200a21-e3be-4e4d-bb0c-56537f16b136 admin admin] PATH_INFO: `/v3/projects/2410b4dc91d646908f9215dc76e23647` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:52.686602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60200a21-e3be-4e4d-bb0c-56537f16b136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2410b4dc91d646908f9215dc76e23647)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:52.687747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbab99a-54be-419b-8a3a-0a8705228b04 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:52.688526 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60200a21-e3be-4e4d-bb0c-56537f16b136 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:52.692967 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7f37a-f4aa-4454-93d3-750a9efca49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:52.693568 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7f37a-f4aa-4454-93d3-750a9efca49d admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:52.693796 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7f37a-f4aa-4454-93d3-750a9efca49d admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:52.694126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7f37a-f4aa-4454-93d3-750a9efca49d admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:52.694891 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7f37a-f4aa-4454-93d3-750a9efca49d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:52.698000 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7f37a-f4aa-4454-93d3-750a9efca49d admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:52.720946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 930/1863] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:52 2022] POST /identity/v3/users => generated 296 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:52.722035 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7f37a-f4aa-4454-93d3-750a9efca49d admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:52.732476 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7f37a-f4aa-4454-93d3-750a9efca49d admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:52.744427 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-60200a21-e3be-4e4d-bb0c-56537f16b136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2410b4dc91d646908f9215dc76e23647', 'request_id': 'req-60200a21-e3be-4e4d-bb0c-56537f16b136'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:52.750566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-60200a21-e3be-4e4d-bb0c-56537f16b136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2410b4dc91d646908f9215dc76e23647', 'request_id': 'req-60200a21-e3be-4e4d-bb0c-56537f16b136'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:52.756550 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-60200a21-e3be-4e4d-bb0c-56537f16b136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2410b4dc91d646908f9215dc76e23647', 'request_id': 'req-60200a21-e3be-4e4d-bb0c-56537f16b136'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:52.769244 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-60200a21-e3be-4e4d-bb0c-56537f16b136 admin admin] The token cache is being invalidate because project 2410b4dc91d646908f9215dc76e23647 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:52.769533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-60200a21-e3be-4e4d-bb0c-56537f16b136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:52.770227 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-60200a21-e3be-4e4d-bb0c-56537f16b136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:52.772069 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 934/1864] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:52 2022] DELETE /identity/v3/projects/2410b4dc91d646908f9215dc76e23647 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:52.772642 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60200a21-e3be-4e4d-bb0c-56537f16b136 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:52.774637 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-60200a21-e3be-4e4d-bb0c-56537f16b136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:52.791263 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db33960-63a8-41dc-a6f1-6ab4cc7330b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:52.792228 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db33960-63a8-41dc-a6f1-6ab4cc7330b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:52.792228 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db33960-63a8-41dc-a6f1-6ab4cc7330b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:52.792422 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db33960-63a8-41dc-a6f1-6ab4cc7330b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:52.793061 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db33960-63a8-41dc-a6f1-6ab4cc7330b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:52.794996 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db33960-63a8-41dc-a6f1-6ab4cc7330b0 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:52.819876 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 931/1865] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:52 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:52.819876 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db33960-63a8-41dc-a6f1-6ab4cc7330b0 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:52.819876 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-0db33960-63a8-41dc-a6f1-6ab4cc7330b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:52.831647 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db33960-63a8-41dc-a6f1-6ab4cc7330b0 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:52.837181 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff1df17-a74f-4078-a692-0c1337232fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:52.837795 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1df17-a74f-4078-a692-0c1337232fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:52.838084 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1df17-a74f-4078-a692-0c1337232fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:52.838393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff1df17-a74f-4078-a692-0c1337232fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:52.839091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1df17-a74f-4078-a692-0c1337232fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:52.840686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff1df17-a74f-4078-a692-0c1337232fb7 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:52.843158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60200a21-e3be-4e4d-bb0c-56537f16b136 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:52.847880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466ae1d-cf6b-47f7-9bf0-34f3bdb443c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:52.848491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466ae1d-cf6b-47f7-9bf0-34f3bdb443c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:52.848775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466ae1d-cf6b-47f7-9bf0-34f3bdb443c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:52.849052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466ae1d-cf6b-47f7-9bf0-34f3bdb443c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:52.849730 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466ae1d-cf6b-47f7-9bf0-34f3bdb443c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:52.851645 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466ae1d-cf6b-47f7-9bf0-34f3bdb443c2 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:52.852686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 932/1866] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:52.854236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9e7d2-ac37-4cbb-b38b-990e4e080b5a None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:52.854768 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9e7d2-ac37-4cbb-b38b-990e4e080b5a None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:52.855183 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9e7d2-ac37-4cbb-b38b-990e4e080b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:52.856498 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:52.874863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-56a9e7d2-ac37-4cbb-b38b-990e4e080b5a None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:52.876100 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-56a9e7d2-ac37-4cbb-b38b-990e4e080b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:52.881419 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 935/1867] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:52 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:52.882481 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466ae1d-cf6b-47f7-9bf0-34f3bdb443c2 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:52.884567 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8466ae1d-cf6b-47f7-9bf0-34f3bdb443c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:52.886665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 933/1868] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:52.887444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9e7d2-ac37-4cbb-b38b-990e4e080b5a None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:52.896996 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9e7d2-ac37-4cbb-b38b-990e4e080b5a None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:52.962565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466ae1d-cf6b-47f7-9bf0-34f3bdb443c2 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:52.964247 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c25e7-319e-4a97-922d-773d22779582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:52.964930 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c25e7-319e-4a97-922d-773d22779582 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:52.965229 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c25e7-319e-4a97-922d-773d22779582 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:52.965577 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c25e7-319e-4a97-922d-773d22779582 admin admin] PATH_INFO: `/v3/projects/e953070dcc264237af7b472a2dbe9f90/users/c164de7cc76c4201956a1b5e269eac07/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:52.969798 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd9326-20fd-4781-a376-1e961d3c49c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:52.969798 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd9326-20fd-4781-a376-1e961d3c49c2 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:52.970218 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd9326-20fd-4781-a376-1e961d3c49c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:52.970548 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd9326-20fd-4781-a376-1e961d3c49c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:52.971351 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd9326-20fd-4781-a376-1e961d3c49c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:52.973071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd9326-20fd-4781-a376-1e961d3c49c2 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:52.977751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:52.982086 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c25e7-319e-4a97-922d-773d22779582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e953070dcc264237af7b472a2dbe9f90, user_id=c164de7cc76c4201956a1b5e269eac07, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:52.983434 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 936/1869] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:52.984321 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd9326-20fd-4781-a376-1e961d3c49c2 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:52.985437 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c25e7-319e-4a97-922d-773d22779582 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:52.998023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd9326-20fd-4781-a376-1e961d3c49c2 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:53.001307 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 934/1870] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:52 2022] PUT /identity/v3/projects/e953070dcc264237af7b472a2dbe9f90/users/c164de7cc76c4201956a1b5e269eac07/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:53.002839 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ccb7f-aa7c-4c6e-a2b9-35714cca26d3 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:53.003133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ccb7f-aa7c-4c6e-a2b9-35714cca26d3 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:53.003413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ccb7f-aa7c-4c6e-a2b9-35714cca26d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:53.022751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-e41ccb7f-aa7c-4c6e-a2b9-35714cca26d3 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:53.023985 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e41ccb7f-aa7c-4c6e-a2b9-35714cca26d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:53.055484 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad0b6c-9027-4c17-a4a1-a3a09ce52d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:53.056378 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad0b6c-9027-4c17-a4a1-a3a09ce52d2d admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:53.056688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad0b6c-9027-4c17-a4a1-a3a09ce52d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:53.056975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad0b6c-9027-4c17-a4a1-a3a09ce52d2d admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:53.057640 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad0b6c-9027-4c17-a4a1-a3a09ce52d2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:53.059705 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad0b6c-9027-4c17-a4a1-a3a09ce52d2d admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:53.084014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 937/1871] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:52 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:53.084737 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad0b6c-9027-4c17-a4a1-a3a09ce52d2d admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:53.091400 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 935/1872] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:53.092426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ccb7f-aa7c-4c6e-a2b9-35714cca26d3 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:53.102214 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ccb7f-aa7c-4c6e-a2b9-35714cca26d3 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:53.104196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad0b6c-9027-4c17-a4a1-a3a09ce52d2d admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:53.107587 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14276e58-aa6c-4141-b0e5-53ceb7d1a202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:53.108206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14276e58-aa6c-4141-b0e5-53ceb7d1a202 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:53.108498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14276e58-aa6c-4141-b0e5-53ceb7d1a202 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:53.108782 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14276e58-aa6c-4141-b0e5-53ceb7d1a202 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:53.109733 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a128a5-174d-4c79-8629-3d540f6d9436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:53.109837 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14276e58-aa6c-4141-b0e5-53ceb7d1a202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:53.109919 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a128a5-174d-4c79-8629-3d540f6d9436 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:53.110459 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a128a5-174d-4c79-8629-3d540f6d9436 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:53.110579 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a128a5-174d-4c79-8629-3d540f6d9436 admin admin] PATH_INFO: `/v3/projects/d5ecb83e9fb04d70a3e9ab6fdbbdf9e5/users/c767d9770fcd42d2b5281ccbc0c06d93/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:53.111288 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14276e58-aa6c-4141-b0e5-53ceb7d1a202 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:53.122528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 936/1873] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:53.123376 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14276e58-aa6c-4141-b0e5-53ceb7d1a202 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:53.129921 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a128a5-174d-4c79-8629-3d540f6d9436 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ecb83e9fb04d70a3e9ab6fdbbdf9e5, user_id=c767d9770fcd42d2b5281ccbc0c06d93, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:53.133892 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a128a5-174d-4c79-8629-3d540f6d9436 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:53.136933 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14276e58-aa6c-4141-b0e5-53ceb7d1a202 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:53.143690 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da7a9d-fea6-4558-9c05-b68acf8502b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:53.144310 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da7a9d-fea6-4558-9c05-b68acf8502b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:53.144640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da7a9d-fea6-4558-9c05-b68acf8502b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:53.144927 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da7a9d-fea6-4558-9c05-b68acf8502b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:53.145620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da7a9d-fea6-4558-9c05-b68acf8502b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:53.147261 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da7a9d-fea6-4558-9c05-b68acf8502b1 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:53.150422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 938/1874] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:53 2022] PUT /identity/v3/projects/d5ecb83e9fb04d70a3e9ab6fdbbdf9e5/users/c767d9770fcd42d2b5281ccbc0c06d93/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:53.152536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a128a5-174d-4c79-8629-3d540f6d9436 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:53.159106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 937/1875] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:53.159857 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da7a9d-fea6-4558-9c05-b68acf8502b1 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:53.170959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da7a9d-fea6-4558-9c05-b68acf8502b1 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:53.202469 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:53.220077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a128a5-174d-4c79-8629-3d540f6d9436 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:53.226287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8834f-639b-400d-85bb-73677a390d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:53.227028 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8834f-639b-400d-85bb-73677a390d55 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:53.227379 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8834f-639b-400d-85bb-73677a390d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:53.227721 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf8834f-639b-400d-85bb-73677a390d55 admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:53.228916 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8834f-639b-400d-85bb-73677a390d55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:53.229302 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8834f-639b-400d-85bb-73677a390d55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:53.231008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf8834f-639b-400d-85bb-73677a390d55 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:53.231978 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b52d7-c738-41dc-a231-7cf7fcca6323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:53.232577 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b52d7-c738-41dc-a231-7cf7fcca6323 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:53.232865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b52d7-c738-41dc-a231-7cf7fcca6323 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:53.233153 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b52d7-c738-41dc-a231-7cf7fcca6323 admin admin] PATH_INFO: `/v3/projects/e953070dcc264237af7b472a2dbe9f90/users/c164de7cc76c4201956a1b5e269eac07/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:53.235277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b52d7-c738-41dc-a231-7cf7fcca6323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e953070dcc264237af7b472a2dbe9f90, user_id=c164de7cc76c4201956a1b5e269eac07, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:53.237934 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b52d7-c738-41dc-a231-7cf7fcca6323 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:53.248113 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 939/1876] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:49:53.249189 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8834f-639b-400d-85bb-73677a390d55 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:53.258425 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 938/1877] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:53 2022] PUT /identity/v3/projects/e953070dcc264237af7b472a2dbe9f90/users/c164de7cc76c4201956a1b5e269eac07/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:53.259582 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b52d7-c738-41dc-a231-7cf7fcca6323 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:53.262203 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf8834f-639b-400d-85bb-73677a390d55 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:53.340064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc990f6-b507-4b41-b51e-85538433b09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:53.340835 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc990f6-b507-4b41-b51e-85538433b09a admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:53.341119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc990f6-b507-4b41-b51e-85538433b09a admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:53.341398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc990f6-b507-4b41-b51e-85538433b09a admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:53.342388 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc990f6-b507-4b41-b51e-85538433b09a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:53.343952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc990f6-b507-4b41-b51e-85538433b09a admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:53.349093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b52d7-c738-41dc-a231-7cf7fcca6323 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:53.355686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e911ed1-0dcb-4d80-a246-0e825dc98a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:53.357393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e911ed1-0dcb-4d80-a246-0e825dc98a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:53.360648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e911ed1-0dcb-4d80-a246-0e825dc98a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:53.360793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 940/1878] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:53.360907 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e911ed1-0dcb-4d80-a246-0e825dc98a4e admin admin] PATH_INFO: `/v3/projects/d757aa6aa9844037bd82a6045bd54e41/users/1e8e002be32a402e8ef03fabae72eaaa/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:53.360997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc990f6-b507-4b41-b51e-85538433b09a admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:53.363363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:53.373269 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc990f6-b507-4b41-b51e-85538433b09a admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:53.382373 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e911ed1-0dcb-4d80-a246-0e825dc98a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d757aa6aa9844037bd82a6045bd54e41, user_id=1e8e002be32a402e8ef03fabae72eaaa, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:53.382567 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e431cb-5688-46eb-ba28-6ae628c73557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:53.383078 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e431cb-5688-46eb-ba28-6ae628c73557 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:53.383367 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e431cb-5688-46eb-ba28-6ae628c73557 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:53.383645 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e431cb-5688-46eb-ba28-6ae628c73557 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:53.384320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e431cb-5688-46eb-ba28-6ae628c73557 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:53.385998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e911ed1-0dcb-4d80-a246-0e825dc98a4e admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:53.386506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e431cb-5688-46eb-ba28-6ae628c73557 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:53.407593 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 939/1879] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:53 2022] PUT /identity/v3/projects/d757aa6aa9844037bd82a6045bd54e41/users/1e8e002be32a402e8ef03fabae72eaaa/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:53.408401 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb73a9-8f01-4ea2-81cd-d86a83cb2146 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:53.408729 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb73a9-8f01-4ea2-81cd-d86a83cb2146 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:53.409172 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb73a9-8f01-4ea2-81cd-d86a83cb2146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:53.431055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 941/1880] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:53 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:53.435285 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e431cb-5688-46eb-ba28-6ae628c73557 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:53.453723 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-b1cb73a9-8f01-4ea2-81cd-d86a83cb2146 None None] MFA Rules not processed for user `c164de7cc76c4201956a1b5e269eac07`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:53.455125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-b1cb73a9-8f01-4ea2-81cd-d86a83cb2146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:53.516155 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e431cb-5688-46eb-ba28-6ae628c73557 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:53.521583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b896f-0218-4674-a0a2-c49a10d13150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:53.523011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b896f-0218-4674-a0a2-c49a10d13150 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:53.523440 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b896f-0218-4674-a0a2-c49a10d13150 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:53.523954 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b896f-0218-4674-a0a2-c49a10d13150 admin admin] PATH_INFO: `/v3/projects/d5ecb83e9fb04d70a3e9ab6fdbbdf9e5/users/c767d9770fcd42d2b5281ccbc0c06d93/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:53.526067 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b896f-0218-4674-a0a2-c49a10d13150 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5ecb83e9fb04d70a3e9ab6fdbbdf9e5, user_id=c767d9770fcd42d2b5281ccbc0c06d93, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:53.528841 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b896f-0218-4674-a0a2-c49a10d13150 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:53.540141 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 942/1881] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:53 2022] PUT /identity/v3/projects/d5ecb83e9fb04d70a3e9ab6fdbbdf9e5/users/c767d9770fcd42d2b5281ccbc0c06d93/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:53.541004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b896f-0218-4674-a0a2-c49a10d13150 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:53.553032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 940/1882] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:53.553934 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb73a9-8f01-4ea2-81cd-d86a83cb2146 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:53.565379 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cb73a9-8f01-4ea2-81cd-d86a83cb2146 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:53.604603 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:53.620329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b896f-0218-4674-a0a2-c49a10d13150 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:53.625391 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255a2da3-13ac-4eb7-b5d8-fc40d43ad005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:53.626019 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a2da3-13ac-4eb7-b5d8-fc40d43ad005 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:53.626452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a2da3-13ac-4eb7-b5d8-fc40d43ad005 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:53.626736 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255a2da3-13ac-4eb7-b5d8-fc40d43ad005 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:53.627470 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a2da3-13ac-4eb7-b5d8-fc40d43ad005 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:53.628767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714711f7-9712-4e7a-b943-a877060be151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:53.629212 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255a2da3-13ac-4eb7-b5d8-fc40d43ad005 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:53.629396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714711f7-9712-4e7a-b943-a877060be151 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:53.629684 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714711f7-9712-4e7a-b943-a877060be151 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:53.629964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714711f7-9712-4e7a-b943-a877060be151 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:53.630666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714711f7-9712-4e7a-b943-a877060be151 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:53.632641 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714711f7-9712-4e7a-b943-a877060be151 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:53.645823 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 943/1883] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:53.647304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8b572-0a10-4b6a-891c-2f35d4e91409 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:53.647600 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8b572-0a10-4b6a-891c-2f35d4e91409 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:53.647913 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8b572-0a10-4b6a-891c-2f35d4e91409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:53.654604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 941/1884] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:53 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:53.655428 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714711f7-9712-4e7a-b943-a877060be151 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:53.658524 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-714711f7-9712-4e7a-b943-a877060be151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:53.677408 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-dff8b572-0a10-4b6a-891c-2f35d4e91409 None None] MFA Rules not processed for user `c767d9770fcd42d2b5281ccbc0c06d93`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:53.678706 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-dff8b572-0a10-4b6a-891c-2f35d4e91409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:53.727240 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714711f7-9712-4e7a-b943-a877060be151 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:53.731010 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a495862-0e35-45e7-a998-0d1c35986945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:53.731637 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a495862-0e35-45e7-a998-0d1c35986945 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:53.734333 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a495862-0e35-45e7-a998-0d1c35986945 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:53.734333 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a495862-0e35-45e7-a998-0d1c35986945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:53.747517 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:53.757408 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 944/1885] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:53 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:53.758289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8b572-0a10-4b6a-891c-2f35d4e91409 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:53.769913 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8b572-0a10-4b6a-891c-2f35d4e91409 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:53.775969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f3f9a-fe34-42da-9607-977906bea1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:53.776729 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f3f9a-fe34-42da-9607-977906bea1eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:53.777089 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f3f9a-fe34-42da-9607-977906bea1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:53.777435 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f3f9a-fe34-42da-9607-977906bea1eb admin admin] PATH_INFO: `/v3/projects/d757aa6aa9844037bd82a6045bd54e41/users/1e8e002be32a402e8ef03fabae72eaaa/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:53.779564 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f3f9a-fe34-42da-9607-977906bea1eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d757aa6aa9844037bd82a6045bd54e41, user_id=1e8e002be32a402e8ef03fabae72eaaa, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:53.782274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f3f9a-fe34-42da-9607-977906bea1eb admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:53.794564 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 945/1886] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:53 2022] PUT /identity/v3/projects/d757aa6aa9844037bd82a6045bd54e41/users/1e8e002be32a402e8ef03fabae72eaaa/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:53.796069 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f3f9a-fe34-42da-9607-977906bea1eb admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:53.827989 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a495862-0e35-45e7-a998-0d1c35986945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:53.829531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a495862-0e35-45e7-a998-0d1c35986945 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:53.840773 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 942/1887] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:53.841776 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a495862-0e35-45e7-a998-0d1c35986945 service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:53.843323 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-2a495862-0e35-45e7-a998-0d1c35986945 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:53.869486 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a495862-0e35-45e7-a998-0d1c35986945 service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:53.888949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f3f9a-fe34-42da-9607-977906bea1eb admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:53.894091 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20473d9a-36c6-4578-87a6-8b341960f2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:53.894892 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20473d9a-36c6-4578-87a6-8b341960f2fd admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:53.895248 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20473d9a-36c6-4578-87a6-8b341960f2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:53.895597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20473d9a-36c6-4578-87a6-8b341960f2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:53.896396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20473d9a-36c6-4578-87a6-8b341960f2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:53.898059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20473d9a-36c6-4578-87a6-8b341960f2fd admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:53.910129 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 946/1888] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:53 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:53.914951 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc7380-bf51-4dc3-93e3-1da29baf5686 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:53.915299 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc7380-bf51-4dc3-93e3-1da29baf5686 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:53.915587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc7380-bf51-4dc3-93e3-1da29baf5686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:53.926581 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4a4d2-d52c-4ad0-89c4-de05d6209422 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:53.927215 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4a4d2-d52c-4ad0-89c4-de05d6209422 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:53.927504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4a4d2-d52c-4ad0-89c4-de05d6209422 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:53.927781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4a4d2-d52c-4ad0-89c4-de05d6209422 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:53.967811 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-5bcc7380-bf51-4dc3-93e3-1da29baf5686 None None] MFA Rules not processed for user `1e8e002be32a402e8ef03fabae72eaaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:53.969570 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5bcc7380-bf51-4dc3-93e3-1da29baf5686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:54.007376 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4a4d2-d52c-4ad0-89c4-de05d6209422 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:54.009359 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4a4d2-d52c-4ad0-89c4-de05d6209422 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:54.020747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 943/1889] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:53 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:54.021807 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4a4d2-d52c-4ad0-89c4-de05d6209422 service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:54.033567 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4a4d2-d52c-4ad0-89c4-de05d6209422 service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:54.038281 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aaa7ca-4a3f-44d7-8d9b-b71a0db9aae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:54.041487 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaa7ca-4a3f-44d7-8d9b-b71a0db9aae1 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:54.041962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaa7ca-4a3f-44d7-8d9b-b71a0db9aae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:54.042252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aaa7ca-4a3f-44d7-8d9b-b71a0db9aae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:54.043087 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aaa7ca-4a3f-44d7-8d9b-b71a0db9aae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:54.044950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aaa7ca-4a3f-44d7-8d9b-b71a0db9aae1 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:54.045539 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:54.062397 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 944/1890] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:54.068378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aaa7ca-4a3f-44d7-8d9b-b71a0db9aae1 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:54.084255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aaa7ca-4a3f-44d7-8d9b-b71a0db9aae1 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:54.093933 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde03f85-4837-418d-a0d7-2b6ee50873eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:54.095118 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde03f85-4837-418d-a0d7-2b6ee50873eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:54.095864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde03f85-4837-418d-a0d7-2b6ee50873eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:54.096290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde03f85-4837-418d-a0d7-2b6ee50873eb admin admin] PATH_INFO: `/v3/projects/0cfc5785c9bc491caa6cb1eac2ade8c6/users/2a675d568c0541fa8ae7a49af5ba14c3/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:54.099253 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 947/1891] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:53 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:54.119462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde03f85-4837-418d-a0d7-2b6ee50873eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cfc5785c9bc491caa6cb1eac2ade8c6, user_id=2a675d568c0541fa8ae7a49af5ba14c3, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:54.124087 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde03f85-4837-418d-a0d7-2b6ee50873eb admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:54.140870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc7380-bf51-4dc3-93e3-1da29baf5686 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:54.150392 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 945/1892] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:54 2022] PUT /identity/v3/projects/0cfc5785c9bc491caa6cb1eac2ade8c6/users/2a675d568c0541fa8ae7a49af5ba14c3/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:54.153248 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc7380-bf51-4dc3-93e3-1da29baf5686 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:54.161290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d246b77-9f89-430a-b702-ac8ec49c8695 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:54.161582 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d246b77-9f89-430a-b702-ac8ec49c8695 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:54.161863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d246b77-9f89-430a-b702-ac8ec49c8695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:54.193936 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-0d246b77-9f89-430a-b702-ac8ec49c8695 None None] MFA Rules not processed for user `2a675d568c0541fa8ae7a49af5ba14c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:54.195839 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-0d246b77-9f89-430a-b702-ac8ec49c8695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:54.209081 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:54.216718 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b6646-53d8-4aad-a7e9-223928279d27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:54.217449 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b6646-53d8-4aad-a7e9-223928279d27 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:54.217768 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b6646-53d8-4aad-a7e9-223928279d27 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:54.218045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b6646-53d8-4aad-a7e9-223928279d27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:54.273920 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 946/1893] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:49:54.274819 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d246b77-9f89-430a-b702-ac8ec49c8695 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:54.286734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b6646-53d8-4aad-a7e9-223928279d27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:54.287384 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d246b77-9f89-430a-b702-ac8ec49c8695 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:54.288416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b6646-53d8-4aad-a7e9-223928279d27 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:54.291134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49d71e-71a4-441e-a2ef-b5d4339239d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:54.291783 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49d71e-71a4-441e-a2ef-b5d4339239d0 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:54.292068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49d71e-71a4-441e-a2ef-b5d4339239d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:54.292346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49d71e-71a4-441e-a2ef-b5d4339239d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:54.294777 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ac49d71e-71a4-441e-a2ef-b5d4339239d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:54.298558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 948/1894] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:54 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:54.299351 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b6646-53d8-4aad-a7e9-223928279d27 service cinder] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:54.378944 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49d71e-71a4-441e-a2ef-b5d4339239d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:54.380647 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49d71e-71a4-441e-a2ef-b5d4339239d0 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:54.388205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b6646-53d8-4aad-a7e9-223928279d27 service cinder] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:54.392097 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 947/1895] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:54 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:54.402680 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a61b9-bc3f-4479-a1ad-98f2535e9c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:54.403400 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a61b9-bc3f-4479-a1ad-98f2535e9c96 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:54.403946 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a61b9-bc3f-4479-a1ad-98f2535e9c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:54.404233 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a61b9-bc3f-4479-a1ad-98f2535e9c96 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:54.404735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a61b9-bc3f-4479-a1ad-98f2535e9c96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:54.406281 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49d71e-71a4-441e-a2ef-b5d4339239d0 service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:54.406919 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a61b9-bc3f-4479-a1ad-98f2535e9c96 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:54.452602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 949/1896] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:54 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:54.454860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a61b9-bc3f-4479-a1ad-98f2535e9c96 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:54.478722 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:54.503909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49d71e-71a4-441e-a2ef-b5d4339239d0 service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:54.547599 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a61b9-bc3f-4479-a1ad-98f2535e9c96 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:54.551769 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8c0ac-3176-420d-b087-3cee85417406 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:54.552573 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8c0ac-3176-420d-b087-3cee85417406 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:54.552940 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8c0ac-3176-420d-b087-3cee85417406 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:54.553290 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8c0ac-3176-420d-b087-3cee85417406 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:54.555806 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d7d8c0ac-3176-420d-b087-3cee85417406 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:54.589656 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7592a3-6db1-43e7-94e0-f38c9b43c4ad tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c164de7cc76c4201956a1b5e269eac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e953070dcc264237af7b472a2dbe9f90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:54.590396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7592a3-6db1-43e7-94e0-f38c9b43c4ad tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:54.590826 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7592a3-6db1-43e7-94e0-f38c9b43c4ad tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:54.591235 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7592a3-6db1-43e7-94e0-f38c9b43c4ad tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:54.592372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7592a3-6db1-43e7-94e0-f38c9b43c4ad tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:54.592762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7592a3-6db1-43e7-94e0-f38c9b43c4ad tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:54.595067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7592a3-6db1-43e7-94e0-f38c9b43c4ad tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:54.597151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:54.616555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 948/1897] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:49:54.618388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7592a3-6db1-43e7-94e0-f38c9b43c4ad tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:54.670124 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8c0ac-3176-420d-b087-3cee85417406 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:54.671720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8c0ac-3176-420d-b087-3cee85417406 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:54.684082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 950/1898] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:54.684925 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8c0ac-3176-420d-b087-3cee85417406 service cinder] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:54.701195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8c0ac-3176-420d-b087-3cee85417406 service cinder] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:54.710605 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33515ad-db60-4ebd-98f3-8e91278aeec6 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c164de7cc76c4201956a1b5e269eac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e953070dcc264237af7b472a2dbe9f90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:54.711584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33515ad-db60-4ebd-98f3-8e91278aeec6 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:54.712024 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33515ad-db60-4ebd-98f3-8e91278aeec6 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:54.712465 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33515ad-db60-4ebd-98f3-8e91278aeec6 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:54.713522 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33515ad-db60-4ebd-98f3-8e91278aeec6 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:54.715949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33515ad-db60-4ebd-98f3-8e91278aeec6 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:54.732898 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7592a3-6db1-43e7-94e0-f38c9b43c4ad tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:54.739130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12835fdb-5336-40cf-9dce-45c364b9ca3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:54.739761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12835fdb-5336-40cf-9dce-45c364b9ca3b admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:54.740046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12835fdb-5336-40cf-9dce-45c364b9ca3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:54.740326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12835fdb-5336-40cf-9dce-45c364b9ca3b admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:54.741391 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12835fdb-5336-40cf-9dce-45c364b9ca3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:54.744258 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12835fdb-5336-40cf-9dce-45c364b9ca3b admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:54.758906 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 951/1899] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:54 2022] POST /identity/v3/projects => generated 354 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:54.760029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33515ad-db60-4ebd-98f3-8e91278aeec6 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:54.778846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 949/1900] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:54 2022] POST /identity/v3/users => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:54.782100 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12835fdb-5336-40cf-9dce-45c364b9ca3b admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:54.797072 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12835fdb-5336-40cf-9dce-45c364b9ca3b admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:54.835705 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33515ad-db60-4ebd-98f3-8e91278aeec6 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:54.840752 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca30622-6e12-4498-98c5-b8536164669c tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c164de7cc76c4201956a1b5e269eac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e953070dcc264237af7b472a2dbe9f90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:54.841380 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca30622-6e12-4498-98c5-b8536164669c tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:54.841671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca30622-6e12-4498-98c5-b8536164669c tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:54.841954 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca30622-6e12-4498-98c5-b8536164669c tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:54.842701 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca30622-6e12-4498-98c5-b8536164669c tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:54.843018 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca30622-6e12-4498-98c5-b8536164669c tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:54.844633 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca30622-6e12-4498-98c5-b8536164669c tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:54.857812 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 952/1901] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:49:54.865804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75756d4-3a40-49e8-a6c9-391df32dd476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:54.866521 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75756d4-3a40-49e8-a6c9-391df32dd476 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:54.866837 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75756d4-3a40-49e8-a6c9-391df32dd476 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:54.867664 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75756d4-3a40-49e8-a6c9-391df32dd476 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:54.868369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75756d4-3a40-49e8-a6c9-391df32dd476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:54.870061 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75756d4-3a40-49e8-a6c9-391df32dd476 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:54.881036 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 950/1902] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:54.885477 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca30622-6e12-4498-98c5-b8536164669c tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:54.899812 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca30622-6e12-4498-98c5-b8536164669c tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:54.905881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9b889-1eb1-406a-95b6-6df22001bfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:54.906825 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9b889-1eb1-406a-95b6-6df22001bfb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:54.907113 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9b889-1eb1-406a-95b6-6df22001bfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:54.907395 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9b889-1eb1-406a-95b6-6df22001bfb9 admin admin] PATH_INFO: `/v3/projects/fbb5643ee26e4d07b106f7d2285cacbd/users/c1c0feac78c74734a687639fff3f2009/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:54.922740 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75756d4-3a40-49e8-a6c9-391df32dd476 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:54.937486 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75756d4-3a40-49e8-a6c9-391df32dd476 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:54.943376 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e5da0-d179-4ff4-ada3-c82d26c368b0 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c164de7cc76c4201956a1b5e269eac07', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e953070dcc264237af7b472a2dbe9f90', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:54.944101 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e5da0-d179-4ff4-ada3-c82d26c368b0 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:54.944397 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e5da0-d179-4ff4-ada3-c82d26c368b0 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:54.944684 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e5da0-d179-4ff4-ada3-c82d26c368b0 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] PATH_INFO: `/v3/projects/76d56e1af5d1412ba58fc2afdc3b72a1` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:54.945436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9b889-1eb1-406a-95b6-6df22001bfb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb5643ee26e4d07b106f7d2285cacbd, user_id=c1c0feac78c74734a687639fff3f2009, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:54.945878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e5da0-d179-4ff4-ada3-c82d26c368b0 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] RBAC: Authorizing `identity:delete_project(project_id=76d56e1af5d1412ba58fc2afdc3b72a1)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:54.947880 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e5da0-d179-4ff4-ada3-c82d26c368b0 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:54.948285 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9b889-1eb1-406a-95b6-6df22001bfb9 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:54.973739 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 953/1903] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:54 2022] PUT /identity/v3/projects/fbb5643ee26e4d07b106f7d2285cacbd/users/c1c0feac78c74734a687639fff3f2009/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:54.978777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9b889-1eb1-406a-95b6-6df22001bfb9 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:55.011199 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:55.028142 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ed6e5da0-d179-4ff4-ada3-c82d26c368b0 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d56e1af5d1412ba58fc2afdc3b72a1', 'request_id': 'req-ed6e5da0-d179-4ff4-ada3-c82d26c368b0'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:55.040299 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ed6e5da0-d179-4ff4-ada3-c82d26c368b0 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d56e1af5d1412ba58fc2afdc3b72a1', 'request_id': 'req-ed6e5da0-d179-4ff4-ada3-c82d26c368b0'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:55.056307 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ed6e5da0-d179-4ff4-ada3-c82d26c368b0 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d56e1af5d1412ba58fc2afdc3b72a1', 'request_id': 'req-ed6e5da0-d179-4ff4-ada3-c82d26c368b0'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:55.074951 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ed6e5da0-d179-4ff4-ada3-c82d26c368b0 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] The token cache is being invalidate because project 76d56e1af5d1412ba58fc2afdc3b72a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:55.075610 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ed6e5da0-d179-4ff4-ada3-c82d26c368b0 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:55.077161 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ed6e5da0-d179-4ff4-ada3-c82d26c368b0 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:55.077746 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9b889-1eb1-406a-95b6-6df22001bfb9 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:55.080805 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 951/1904] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:54 2022] DELETE /identity/v3/projects/76d56e1af5d1412ba58fc2afdc3b72a1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:49:55.145451 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870d9d32-9b04-4524-a201-0dddbfaa14a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:55.146075 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d9d32-9b04-4524-a201-0dddbfaa14a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:55.146375 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d9d32-9b04-4524-a201-0dddbfaa14a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:55.146655 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870d9d32-9b04-4524-a201-0dddbfaa14a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:55.147348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d9d32-9b04-4524-a201-0dddbfaa14a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:55.149454 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870d9d32-9b04-4524-a201-0dddbfaa14a6 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:55.160041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 954/1905] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:55.165672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e5da0-d179-4ff4-ada3-c82d26c368b0 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:55.167468 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ed6e5da0-d179-4ff4-ada3-c82d26c368b0 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:55.176503 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:55.182538 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e5da0-d179-4ff4-ada3-c82d26c368b0 tempest-VolumeQuotaClassesTest-147955959 tempest-VolumeQuotaClassesTest-147955959-project-admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:55.188268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a3454-f914-4d3c-b43d-23fec61a2da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:55.189051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a3454-f914-4d3c-b43d-23fec61a2da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:55.189711 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a3454-f914-4d3c-b43d-23fec61a2da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:55.190112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a3454-f914-4d3c-b43d-23fec61a2da5 admin admin] PATH_INFO: `/v3/projects/fbb5643ee26e4d07b106f7d2285cacbd/users/c1c0feac78c74734a687639fff3f2009/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:55.193041 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a3454-f914-4d3c-b43d-23fec61a2da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbb5643ee26e4d07b106f7d2285cacbd, user_id=c1c0feac78c74734a687639fff3f2009, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:55.195935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a3454-f914-4d3c-b43d-23fec61a2da5 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:55.207290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 952/1906] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:55 2022] PUT /identity/v3/projects/fbb5643ee26e4d07b106f7d2285cacbd/users/c1c0feac78c74734a687639fff3f2009/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:55.219155 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a65cd-0469-4127-ada6-ef2bdd3546d7 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:55.219451 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a65cd-0469-4127-ada6-ef2bdd3546d7 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:55.219878 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29a65cd-0469-4127-ada6-ef2bdd3546d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:55.249424 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-e29a65cd-0469-4127-ada6-ef2bdd3546d7 None None] MFA Rules not processed for user `c1c0feac78c74734a687639fff3f2009`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:55.250872 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e29a65cd-0469-4127-ada6-ef2bdd3546d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:55.296398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a3454-f914-4d3c-b43d-23fec61a2da5 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:55.298074 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ee7a3454-f914-4d3c-b43d-23fec61a2da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:55.321218 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 955/1907] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:49:55.334946 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a65cd-0469-4127-ada6-ef2bdd3546d7 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:55.338081 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e29a65cd-0469-4127-ada6-ef2bdd3546d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:55.364909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a3454-f914-4d3c-b43d-23fec61a2da5 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:55.369854 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458410cf-5062-4995-89f4-dbdc47c92c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:55.370528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458410cf-5062-4995-89f4-dbdc47c92c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:55.370814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458410cf-5062-4995-89f4-dbdc47c92c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:55.371093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458410cf-5062-4995-89f4-dbdc47c92c29 admin admin] PATH_INFO: `/v3/users/4b9e47a8e67446dabb6ab12642e57730` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:55.372270 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458410cf-5062-4995-89f4-dbdc47c92c29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b9e47a8e67446dabb6ab12642e57730)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:55.374220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458410cf-5062-4995-89f4-dbdc47c92c29 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:55.384152 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:55.397302 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29a65cd-0469-4127-ada6-ef2bdd3546d7 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:55.401682 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cd49d-eda6-4f6b-89a1-231c7c21b15d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:55.402419 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cd49d-eda6-4f6b-89a1-231c7c21b15d service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:55.402733 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cd49d-eda6-4f6b-89a1-231c7c21b15d service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:55.403010 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cd49d-eda6-4f6b-89a1-231c7c21b15d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:55.413743 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cd49d-eda6-4f6b-89a1-231c7c21b15d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:55.415682 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cd49d-eda6-4f6b-89a1-231c7c21b15d service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:55.425396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 956/1908] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:55.425875 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-458410cf-5062-4995-89f4-dbdc47c92c29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b9e47a8e67446dabb6ab12642e57730'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:55.426584 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-458410cf-5062-4995-89f4-dbdc47c92c29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b9e47a8e67446dabb6ab12642e57730'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:55.439198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-458410cf-5062-4995-89f4-dbdc47c92c29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b9e47a8e67446dabb6ab12642e57730'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:55.446141 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-458410cf-5062-4995-89f4-dbdc47c92c29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b9e47a8e67446dabb6ab12642e57730'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:55.454852 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-458410cf-5062-4995-89f4-dbdc47c92c29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b9e47a8e67446dabb6ab12642e57730'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:55.462525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 953/1909] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:55 2022] DELETE /identity/v3/users/4b9e47a8e67446dabb6ab12642e57730 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:49:55.466221 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b01eb9-2810-443f-8616-3d76f7792f71 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:55.466549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b01eb9-2810-443f-8616-3d76f7792f71 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:55.466835 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b01eb9-2810-443f-8616-3d76f7792f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:55.487571 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-73b01eb9-2810-443f-8616-3d76f7792f71 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:55.488793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-73b01eb9-2810-443f-8616-3d76f7792f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:55.522208 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458410cf-5062-4995-89f4-dbdc47c92c29 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:55.525891 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-458410cf-5062-4995-89f4-dbdc47c92c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:55.559210 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 957/1910] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:55.569761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b01eb9-2810-443f-8616-3d76f7792f71 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:55.571807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-73b01eb9-2810-443f-8616-3d76f7792f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:55.593413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458410cf-5062-4995-89f4-dbdc47c92c29 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:55.597778 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eff867-f003-4c66-ac95-984f1cdb68e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:55.598111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eff867-f003-4c66-ac95-984f1cdb68e7 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:55.598501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eff867-f003-4c66-ac95-984f1cdb68e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:55.598849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eff867-f003-4c66-ac95-984f1cdb68e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:55.600710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-02eff867-f003-4c66-ac95-984f1cdb68e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:55.625671 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:55.641655 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b01eb9-2810-443f-8616-3d76f7792f71 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:55.645899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a9175-d946-4f6a-b254-71d84851281d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:55.646816 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a9175-d946-4f6a-b254-71d84851281d service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:55.647102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a9175-d946-4f6a-b254-71d84851281d service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:55.647380 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0a9175-d946-4f6a-b254-71d84851281d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:55.662700 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a9175-d946-4f6a-b254-71d84851281d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:55.662700 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0a9175-d946-4f6a-b254-71d84851281d service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:55.671396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eff867-f003-4c66-ac95-984f1cdb68e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:55.671526 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 958/1911] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:55.673023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eff867-f003-4c66-ac95-984f1cdb68e7 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:55.686841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 954/1912] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:49:56.082298 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a9175-d946-4f6a-b254-71d84851281d service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:56.083728 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-eb0a9175-d946-4f6a-b254-71d84851281d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:56.099320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0a9175-d946-4f6a-b254-71d84851281d service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:56.106319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d07083-f8f5-4cb7-8795-d5c35eb3faa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:56.109358 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d07083-f8f5-4cb7-8795-d5c35eb3faa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:56.109358 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d07083-f8f5-4cb7-8795-d5c35eb3faa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:56.109358 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d07083-f8f5-4cb7-8795-d5c35eb3faa1 admin admin] PATH_INFO: `/v3/users/2a675d568c0541fa8ae7a49af5ba14c3` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:56.111196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eff867-f003-4c66-ac95-984f1cdb68e7 service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:56.112758 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-02eff867-f003-4c66-ac95-984f1cdb68e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:56.115175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d07083-f8f5-4cb7-8795-d5c35eb3faa1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a675d568c0541fa8ae7a49af5ba14c3)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:56.119551 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d07083-f8f5-4cb7-8795-d5c35eb3faa1 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:56.151013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eff867-f003-4c66-ac95-984f1cdb68e7 service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:56.190262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ee42d-94a0-49c3-8071-b9a51da1a471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:56.194474 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ee42d-94a0-49c3-8071-b9a51da1a471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:56.197032 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ee42d-94a0-49c3-8071-b9a51da1a471 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:56.197512 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1ee42d-94a0-49c3-8071-b9a51da1a471 admin admin] PATH_INFO: `/v3/projects/be9e1893fcf249cda3b50f55f46fba17` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:56.203342 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ee42d-94a0-49c3-8071-b9a51da1a471 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be9e1893fcf249cda3b50f55f46fba17)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:56.209417 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1ee42d-94a0-49c3-8071-b9a51da1a471 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:56.238482 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b7d07083-f8f5-4cb7-8795-d5c35eb3faa1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a675d568c0541fa8ae7a49af5ba14c3'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:56.239383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b7d07083-f8f5-4cb7-8795-d5c35eb3faa1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a675d568c0541fa8ae7a49af5ba14c3'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:56.254516 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b7d07083-f8f5-4cb7-8795-d5c35eb3faa1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a675d568c0541fa8ae7a49af5ba14c3'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:56.271260 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b7d07083-f8f5-4cb7-8795-d5c35eb3faa1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a675d568c0541fa8ae7a49af5ba14c3'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:56.272358 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b7d07083-f8f5-4cb7-8795-d5c35eb3faa1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a675d568c0541fa8ae7a49af5ba14c3'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:56.329117 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 959/1913] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:56 2022] DELETE /identity/v3/users/2a675d568c0541fa8ae7a49af5ba14c3 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:56.334239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a55e8b-c2d8-42ce-a70a-5386cfb32143 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:56.334720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a55e8b-c2d8-42ce-a70a-5386cfb32143 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:56.335101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a55e8b-c2d8-42ce-a70a-5386cfb32143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:56.349462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:56.354086 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1e1ee42d-94a0-49c3-8071-b9a51da1a471 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be9e1893fcf249cda3b50f55f46fba17', 'request_id': 'req-1e1ee42d-94a0-49c3-8071-b9a51da1a471'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:56.372219 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1e1ee42d-94a0-49c3-8071-b9a51da1a471 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be9e1893fcf249cda3b50f55f46fba17', 'request_id': 'req-1e1ee42d-94a0-49c3-8071-b9a51da1a471'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:56.390771 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1e1ee42d-94a0-49c3-8071-b9a51da1a471 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be9e1893fcf249cda3b50f55f46fba17', 'request_id': 'req-1e1ee42d-94a0-49c3-8071-b9a51da1a471'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:56.392423 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-c7a55e8b-c2d8-42ce-a70a-5386cfb32143 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:56.396844 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c7a55e8b-c2d8-42ce-a70a-5386cfb32143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:56.410094 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1e1ee42d-94a0-49c3-8071-b9a51da1a471 admin admin] The token cache is being invalidate because project be9e1893fcf249cda3b50f55f46fba17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:56.410416 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1e1ee42d-94a0-49c3-8071-b9a51da1a471 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:56.415124 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1e1ee42d-94a0-49c3-8071-b9a51da1a471 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:56.418824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 955/1914] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:56 2022] DELETE /identity/v3/projects/be9e1893fcf249cda3b50f55f46fba17 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:56.422485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ee42d-94a0-49c3-8071-b9a51da1a471 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:56.424331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-1e1ee42d-94a0-49c3-8071-b9a51da1a471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:56.573271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 960/1915] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:49:56.590055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1ee42d-94a0-49c3-8071-b9a51da1a471 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:56.614763 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8860b5e-bfc8-4575-852c-be54c37e279f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:56.615445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8860b5e-bfc8-4575-852c-be54c37e279f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:56.615727 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8860b5e-bfc8-4575-852c-be54c37e279f admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:56.616004 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8860b5e-bfc8-4575-852c-be54c37e279f admin admin] PATH_INFO: `/v3/users/c164de7cc76c4201956a1b5e269eac07` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:56.619011 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8860b5e-bfc8-4575-852c-be54c37e279f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c164de7cc76c4201956a1b5e269eac07)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:56.621027 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8860b5e-bfc8-4575-852c-be54c37e279f admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:56.653081 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a55e8b-c2d8-42ce-a70a-5386cfb32143 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:56.654932 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c7a55e8b-c2d8-42ce-a70a-5386cfb32143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:56.735814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e8860b5e-bfc8-4575-852c-be54c37e279f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c164de7cc76c4201956a1b5e269eac07'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:56.738677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e8860b5e-bfc8-4575-852c-be54c37e279f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c164de7cc76c4201956a1b5e269eac07'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:56.740447 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:56.770537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e8860b5e-bfc8-4575-852c-be54c37e279f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c164de7cc76c4201956a1b5e269eac07'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:56.787553 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e8860b5e-bfc8-4575-852c-be54c37e279f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c164de7cc76c4201956a1b5e269eac07'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:56.809641 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e8860b5e-bfc8-4575-852c-be54c37e279f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c164de7cc76c4201956a1b5e269eac07'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:56.819738 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 956/1916] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:56 2022] DELETE /identity/v3/users/c164de7cc76c4201956a1b5e269eac07 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:56.832891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a55e8b-c2d8-42ce-a70a-5386cfb32143 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:56.896178 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f73eb8-29e6-4dcc-ab2f-f625ce71a7ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:56.897007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f73eb8-29e6-4dcc-ab2f-f625ce71a7ae service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:56.897364 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f73eb8-29e6-4dcc-ab2f-f625ce71a7ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:56.897757 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f73eb8-29e6-4dcc-ab2f-f625ce71a7ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:56.900149 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-74f73eb8-29e6-4dcc-ab2f-f625ce71a7ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:57.016420 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f73eb8-29e6-4dcc-ab2f-f625ce71a7ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:57.017872 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f73eb8-29e6-4dcc-ab2f-f625ce71a7ae service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:57.031192 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 961/1917] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:57.475098 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8860b5e-bfc8-4575-852c-be54c37e279f admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:57.478041 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e8860b5e-bfc8-4575-852c-be54c37e279f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:57.492451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8860b5e-bfc8-4575-852c-be54c37e279f admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:57.498483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45100ae-4f6c-4f48-b5fb-75c78edac7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:57.499905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45100ae-4f6c-4f48-b5fb-75c78edac7da admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:57.500306 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45100ae-4f6c-4f48-b5fb-75c78edac7da admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:57.500687 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45100ae-4f6c-4f48-b5fb-75c78edac7da admin admin] PATH_INFO: `/v3/projects/e953070dcc264237af7b472a2dbe9f90` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:57.502559 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45100ae-4f6c-4f48-b5fb-75c78edac7da admin admin] RBAC: Authorizing `identity:delete_project(project_id=e953070dcc264237af7b472a2dbe9f90)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:57.504582 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45100ae-4f6c-4f48-b5fb-75c78edac7da admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:57.567910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f45100ae-4f6c-4f48-b5fb-75c78edac7da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e953070dcc264237af7b472a2dbe9f90', 'request_id': 'req-f45100ae-4f6c-4f48-b5fb-75c78edac7da'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:57.574898 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f73eb8-29e6-4dcc-ab2f-f625ce71a7ae service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:57.578852 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-74f73eb8-29e6-4dcc-ab2f-f625ce71a7ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:57.605310 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f45100ae-4f6c-4f48-b5fb-75c78edac7da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e953070dcc264237af7b472a2dbe9f90', 'request_id': 'req-f45100ae-4f6c-4f48-b5fb-75c78edac7da'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:57.616236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f73eb8-29e6-4dcc-ab2f-f625ce71a7ae service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:57.622413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f45100ae-4f6c-4f48-b5fb-75c78edac7da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e953070dcc264237af7b472a2dbe9f90', 'request_id': 'req-f45100ae-4f6c-4f48-b5fb-75c78edac7da'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:57.625697 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:57.648731 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f45100ae-4f6c-4f48-b5fb-75c78edac7da admin admin] The token cache is being invalidate because project e953070dcc264237af7b472a2dbe9f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:57.649329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f45100ae-4f6c-4f48-b5fb-75c78edac7da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:57.650091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f45100ae-4f6c-4f48-b5fb-75c78edac7da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:57.657221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 957/1918] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:57 2022] DELETE /identity/v3/projects/e953070dcc264237af7b472a2dbe9f90 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:57.658942 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524fdf-9185-4010-9073-f055b04a8f26 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:57.659230 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524fdf-9185-4010-9073-f055b04a8f26 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:57.659513 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6524fdf-9185-4010-9073-f055b04a8f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:57.689783 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-a6524fdf-9185-4010-9073-f055b04a8f26 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:57.691759 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a6524fdf-9185-4010-9073-f055b04a8f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:57.725027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562aa0c2-c249-4736-82f7-db6cb6173428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:57.725027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aa0c2-c249-4736-82f7-db6cb6173428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:57.725027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aa0c2-c249-4736-82f7-db6cb6173428 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:57.725027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562aa0c2-c249-4736-82f7-db6cb6173428 admin admin] PATH_INFO: `/v3/projects/0cfc5785c9bc491caa6cb1eac2ade8c6` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:57.726965 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562aa0c2-c249-4736-82f7-db6cb6173428 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cfc5785c9bc491caa6cb1eac2ade8c6)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:57.728884 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562aa0c2-c249-4736-82f7-db6cb6173428 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:57.787442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-562aa0c2-c249-4736-82f7-db6cb6173428 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cfc5785c9bc491caa6cb1eac2ade8c6', 'request_id': 'req-562aa0c2-c249-4736-82f7-db6cb6173428'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:57.794863 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-562aa0c2-c249-4736-82f7-db6cb6173428 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cfc5785c9bc491caa6cb1eac2ade8c6', 'request_id': 'req-562aa0c2-c249-4736-82f7-db6cb6173428'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:57.797913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 958/1919] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:57.799103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6524fdf-9185-4010-9073-f055b04a8f26 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:57.800421 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a6524fdf-9185-4010-9073-f055b04a8f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:57.805663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-562aa0c2-c249-4736-82f7-db6cb6173428 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cfc5785c9bc491caa6cb1eac2ade8c6', 'request_id': 'req-562aa0c2-c249-4736-82f7-db6cb6173428'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:57.813358 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6524fdf-9185-4010-9073-f055b04a8f26 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:57.821819 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-562aa0c2-c249-4736-82f7-db6cb6173428 admin admin] The token cache is being invalidate because project 0cfc5785c9bc491caa6cb1eac2ade8c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:57.822113 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-562aa0c2-c249-4736-82f7-db6cb6173428 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:57.822783 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-562aa0c2-c249-4736-82f7-db6cb6173428 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:57.825212 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 962/1920] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:57 2022] DELETE /identity/v3/projects/0cfc5785c9bc491caa6cb1eac2ade8c6 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:49:57.825938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbafc8e-b9b9-4e01-b6f1-0b126b17cd71 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:57.826227 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbafc8e-b9b9-4e01-b6f1-0b126b17cd71 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:57.826619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbafc8e-b9b9-4e01-b6f1-0b126b17cd71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:57.854726 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-6dbafc8e-b9b9-4e01-b6f1-0b126b17cd71 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:57.856672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-6dbafc8e-b9b9-4e01-b6f1-0b126b17cd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:57.873561 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:57.899509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7f382-4937-4873-afac-af2fe1778f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:57.900350 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7f382-4937-4873-afac-af2fe1778f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:57.900713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7f382-4937-4873-afac-af2fe1778f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:57.901055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7f382-4937-4873-afac-af2fe1778f49 admin admin] PATH_INFO: `/v3/users/be005be989584c399b3a9765b61ec130` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:57.902370 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7f382-4937-4873-afac-af2fe1778f49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be005be989584c399b3a9765b61ec130)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:57.904377 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7f382-4937-4873-afac-af2fe1778f49 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:57.942672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 963/1921] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:57.958306 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbafc8e-b9b9-4e01-b6f1-0b126b17cd71 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:57.961210 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-6dbafc8e-b9b9-4e01-b6f1-0b126b17cd71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:57.965506 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-d5c7f382-4937-4873-afac-af2fe1778f49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be005be989584c399b3a9765b61ec130'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:57.966249 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-d5c7f382-4937-4873-afac-af2fe1778f49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be005be989584c399b3a9765b61ec130'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:57.976111 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbafc8e-b9b9-4e01-b6f1-0b126b17cd71 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:57.983193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b8546-68db-47da-8615-62bec96cc076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:57.983582 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b8546-68db-47da-8615-62bec96cc076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:57.983877 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b8546-68db-47da-8615-62bec96cc076 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:57.984156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b8546-68db-47da-8615-62bec96cc076 admin admin] PATH_INFO: `/v3/users/c1c0feac78c74734a687639fff3f2009` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:57.985592 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b8546-68db-47da-8615-62bec96cc076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c0feac78c74734a687639fff3f2009)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:57.986092 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-d5c7f382-4937-4873-afac-af2fe1778f49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be005be989584c399b3a9765b61ec130'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:57.988206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b8546-68db-47da-8615-62bec96cc076 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:57.998751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-d5c7f382-4937-4873-afac-af2fe1778f49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be005be989584c399b3a9765b61ec130'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:58.011386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-d5c7f382-4937-4873-afac-af2fe1778f49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be005be989584c399b3a9765b61ec130'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:58.025424 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 959/1922] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:57 2022] DELETE /identity/v3/users/be005be989584c399b3a9765b61ec130 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:58.026390 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7f382-4937-4873-afac-af2fe1778f49 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:58.027715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d5c7f382-4937-4873-afac-af2fe1778f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:58.067016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:58.084291 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-a87b8546-68db-47da-8615-62bec96cc076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c0feac78c74734a687639fff3f2009'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:58.086208 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-a87b8546-68db-47da-8615-62bec96cc076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c0feac78c74734a687639fff3f2009'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:58.096770 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-a87b8546-68db-47da-8615-62bec96cc076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c0feac78c74734a687639fff3f2009'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:58.115165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-a87b8546-68db-47da-8615-62bec96cc076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c0feac78c74734a687639fff3f2009'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:58.115878 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-a87b8546-68db-47da-8615-62bec96cc076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c0feac78c74734a687639fff3f2009'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:58.116335 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7f382-4937-4873-afac-af2fe1778f49 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:58.121668 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47382d09-fb88-4013-9500-12c5b0d44e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:58.122171 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47382d09-fb88-4013-9500-12c5b0d44e90 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:58.122503 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47382d09-fb88-4013-9500-12c5b0d44e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:58.122774 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47382d09-fb88-4013-9500-12c5b0d44e90 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:58.123493 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47382d09-fb88-4013-9500-12c5b0d44e90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:58.123863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47382d09-fb88-4013-9500-12c5b0d44e90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:58.125432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47382d09-fb88-4013-9500-12c5b0d44e90 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:58.130313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 964/1923] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:57 2022] DELETE /identity/v3/users/c1c0feac78c74734a687639fff3f2009 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:58.131601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf68c4-10ba-4eb4-bf32-3c8ffc9e3808 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:58.131895 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf68c4-10ba-4eb4-bf32-3c8ffc9e3808 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:58.132181 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf68c4-10ba-4eb4-bf32-3c8ffc9e3808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:58.147024 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 960/1924] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:49:58.151640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47382d09-fb88-4013-9500-12c5b0d44e90 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:58.153578 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-47382d09-fb88-4013-9500-12c5b0d44e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:58.167607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47382d09-fb88-4013-9500-12c5b0d44e90 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:58.170036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-d2bf68c4-10ba-4eb4-bf32-3c8ffc9e3808 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:58.171839 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d2bf68c4-10ba-4eb4-bf32-3c8ffc9e3808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:58.240463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e3976-2fc7-4631-a68c-5923a9c73a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:58.241397 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e3976-2fc7-4631-a68c-5923a9c73a83 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:58.245217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e3976-2fc7-4631-a68c-5923a9c73a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:58.245445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e3976-2fc7-4631-a68c-5923a9c73a83 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:58.246230 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e3976-2fc7-4631-a68c-5923a9c73a83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:58.248462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e3976-2fc7-4631-a68c-5923a9c73a83 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:58.260970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:58.263419 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 965/1925] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:58.273854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf68c4-10ba-4eb4-bf32-3c8ffc9e3808 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:58.276050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d2bf68c4-10ba-4eb4-bf32-3c8ffc9e3808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:58.321910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 961/1926] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:58 2022] POST /identity/v3/projects => generated 369 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:58.322097 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e3976-2fc7-4631-a68c-5923a9c73a83 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:58.401110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e3976-2fc7-4631-a68c-5923a9c73a83 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:58.407418 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebc68a-6183-4bcc-a750-d307afac9fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:58.409010 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebc68a-6183-4bcc-a750-d307afac9fb9 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:58.409307 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebc68a-6183-4bcc-a750-d307afac9fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:58.409589 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feebc68a-6183-4bcc-a750-d307afac9fb9 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:58.410277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebc68a-6183-4bcc-a750-d307afac9fb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:58.413270 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feebc68a-6183-4bcc-a750-d307afac9fb9 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:58.439751 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf68c4-10ba-4eb4-bf32-3c8ffc9e3808 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:58.447200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 962/1927] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:58 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:58.448264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebc68a-6183-4bcc-a750-d307afac9fb9 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:58.460907 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feebc68a-6183-4bcc-a750-d307afac9fb9 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:58.466816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef07be3-0e30-47c7-8215-fdbdc3eea348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:58.467762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef07be3-0e30-47c7-8215-fdbdc3eea348 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:58.468069 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef07be3-0e30-47c7-8215-fdbdc3eea348 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:58.468449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef07be3-0e30-47c7-8215-fdbdc3eea348 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:58.469582 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef07be3-0e30-47c7-8215-fdbdc3eea348 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:58.471434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef07be3-0e30-47c7-8215-fdbdc3eea348 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:58.489312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 963/1928] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:58.490756 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef07be3-0e30-47c7-8215-fdbdc3eea348 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:58.498913 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8f3b9-af1e-4e38-9b05-10ab5910a304 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:58.499614 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8f3b9-af1e-4e38-9b05-10ab5910a304 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:58.500075 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8f3b9-af1e-4e38-9b05-10ab5910a304 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:58.500447 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb8f3b9-af1e-4e38-9b05-10ab5910a304 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:58.505103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef07be3-0e30-47c7-8215-fdbdc3eea348 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:58.512067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb860fd-fa66-4a66-831e-9ad80afcab4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:58.512980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb860fd-fa66-4a66-831e-9ad80afcab4d admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:58.513565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb860fd-fa66-4a66-831e-9ad80afcab4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:58.513789 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8f3b9-af1e-4e38-9b05-10ab5910a304 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:58.514619 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb860fd-fa66-4a66-831e-9ad80afcab4d admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:58.515283 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb8f3b9-af1e-4e38-9b05-10ab5910a304 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:58.515747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb860fd-fa66-4a66-831e-9ad80afcab4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:58.517483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb860fd-fa66-4a66-831e-9ad80afcab4d admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:58.527730 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 966/1929] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:58.536978 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 964/1930] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:49:58.539794 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8f3b9-af1e-4e38-9b05-10ab5910a304 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:58.563301 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb8f3b9-af1e-4e38-9b05-10ab5910a304 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:58.579080 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d7919-10b3-4c68-a2ce-50477768d64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:58.580586 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d7919-10b3-4c68-a2ce-50477768d64c admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:58.582384 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d7919-10b3-4c68-a2ce-50477768d64c admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:58.583173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d7919-10b3-4c68-a2ce-50477768d64c admin admin] PATH_INFO: `/v3/projects/2f1a7f6453434379b459138112f5a61b/users/3bfd5a1e8a8b470ebf1d69e943737846/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:58.623048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:58.646268 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d7919-10b3-4c68-a2ce-50477768d64c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f1a7f6453434379b459138112f5a61b, user_id=3bfd5a1e8a8b470ebf1d69e943737846, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:58.649063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3d7919-10b3-4c68-a2ce-50477768d64c admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:58.672312 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 967/1931] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:49:58 2022] PUT /identity/v3/projects/2f1a7f6453434379b459138112f5a61b/users/3bfd5a1e8a8b470ebf1d69e943737846/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:58.684719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf440ef-45cd-49a2-a16f-9219ebe40b81 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:58.685015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf440ef-45cd-49a2-a16f-9219ebe40b81 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:58.686380 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf440ef-45cd-49a2-a16f-9219ebe40b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:58.725256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d7919-10b3-4c68-a2ce-50477768d64c admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:58.727735 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-3cf440ef-45cd-49a2-a16f-9219ebe40b81 None None] MFA Rules not processed for user `3bfd5a1e8a8b470ebf1d69e943737846`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:58.727879 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-1e3d7919-10b3-4c68-a2ce-50477768d64c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:58.729002 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-3cf440ef-45cd-49a2-a16f-9219ebe40b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:58.862377 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 965/1932] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:58.879714 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf440ef-45cd-49a2-a16f-9219ebe40b81 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:58.886840 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-3cf440ef-45cd-49a2-a16f-9219ebe40b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:58.911303 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d7919-10b3-4c68-a2ce-50477768d64c admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:58.917867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61808207-2e52-4d95-9906-0dc9e9e15770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:58.918714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61808207-2e52-4d95-9906-0dc9e9e15770 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:58.919072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61808207-2e52-4d95-9906-0dc9e9e15770 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:58.919430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61808207-2e52-4d95-9906-0dc9e9e15770 admin admin] PATH_INFO: `/v3/projects/fbb5643ee26e4d07b106f7d2285cacbd` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:58.921268 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61808207-2e52-4d95-9906-0dc9e9e15770 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbb5643ee26e4d07b106f7d2285cacbd)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:58.923799 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61808207-2e52-4d95-9906-0dc9e9e15770 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:58.969647 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:58.996586 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-61808207-2e52-4d95-9906-0dc9e9e15770 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbb5643ee26e4d07b106f7d2285cacbd', 'request_id': 'req-61808207-2e52-4d95-9906-0dc9e9e15770'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:59.014670 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf440ef-45cd-49a2-a16f-9219ebe40b81 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:59.021126 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-61808207-2e52-4d95-9906-0dc9e9e15770 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbb5643ee26e4d07b106f7d2285cacbd', 'request_id': 'req-61808207-2e52-4d95-9906-0dc9e9e15770'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:59.040617 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-61808207-2e52-4d95-9906-0dc9e9e15770 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbb5643ee26e4d07b106f7d2285cacbd', 'request_id': 'req-61808207-2e52-4d95-9906-0dc9e9e15770'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:59.060253 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-61808207-2e52-4d95-9906-0dc9e9e15770 admin admin] The token cache is being invalidate because project fbb5643ee26e4d07b106f7d2285cacbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:49:59.060546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-61808207-2e52-4d95-9906-0dc9e9e15770 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:59.061382 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-61808207-2e52-4d95-9906-0dc9e9e15770 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:59.066848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 968/1933] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:58 2022] DELETE /identity/v3/projects/fbb5643ee26e4d07b106f7d2285cacbd => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:59.067956 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61808207-2e52-4d95-9906-0dc9e9e15770 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:59.070965 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-61808207-2e52-4d95-9906-0dc9e9e15770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:59.081332 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0aeeb-5c70-48ef-88bf-5c6e86beba7b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b26c60d08b9f47aca8404e4173290908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:59.083022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0aeeb-5c70-48ef-88bf-5c6e86beba7b service glance] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:59.083392 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0aeeb-5c70-48ef-88bf-5c6e86beba7b service glance] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:59.083800 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0aeeb-5c70-48ef-88bf-5c6e86beba7b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:59.086802 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6ec0aeeb-5c70-48ef-88bf-5c6e86beba7b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:59.187506 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0aeeb-5c70-48ef-88bf-5c6e86beba7b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:59.189591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0aeeb-5c70-48ef-88bf-5c6e86beba7b service glance] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:59.202599 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 966/1934] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:49:59.203505 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61808207-2e52-4d95-9906-0dc9e9e15770 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:59.203890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbca9a-95ba-460f-9d23-487ffc63b2c2 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:59.204235 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbca9a-95ba-460f-9d23-487ffc63b2c2 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:59.204461 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbca9a-95ba-460f-9d23-487ffc63b2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:59.209401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834a3b1-8f07-4794-9617-dabf45e1b8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:59.210120 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834a3b1-8f07-4794-9617-dabf45e1b8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:59.210981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834a3b1-8f07-4794-9617-dabf45e1b8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:59.211274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b834a3b1-8f07-4794-9617-dabf45e1b8ce admin admin] PATH_INFO: `/v3/users/a5f9c72ff608449bad6f8331a39e6a75` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:59.212491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834a3b1-8f07-4794-9617-dabf45e1b8ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f9c72ff608449bad6f8331a39e6a75)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:59.215166 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b834a3b1-8f07-4794-9617-dabf45e1b8ce admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:59.231569 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-d8cbca9a-95ba-460f-9d23-487ffc63b2c2 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:59.233998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d8cbca9a-95ba-460f-9d23-487ffc63b2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:59.250767 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:59.258762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 967/1935] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:59.260182 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d2c85-42ca-41ca-b5a9-79c979ad4bb8 None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:59.260709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d2c85-42ca-41ca-b5a9-79c979ad4bb8 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:59.260819 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d2c85-42ca-41ca-b5a9-79c979ad4bb8 None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:59.262571 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 968/1936] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 22:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:49:59.266879 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbaea8-7b96-4b3a-96e3-6aeb7ed5ede1 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:59.267162 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbaea8-7b96-4b3a-96e3-6aeb7ed5ede1 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:59.267635 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbaea8-7b96-4b3a-96e3-6aeb7ed5ede1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:59.319375 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b834a3b1-8f07-4794-9617-dabf45e1b8ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f9c72ff608449bad6f8331a39e6a75'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:59.320795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b834a3b1-8f07-4794-9617-dabf45e1b8ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f9c72ff608449bad6f8331a39e6a75'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:59.329662 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-0ebbaea8-7b96-4b3a-96e3-6aeb7ed5ede1 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:59.331219 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-0ebbaea8-7b96-4b3a-96e3-6aeb7ed5ede1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:59.334634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b834a3b1-8f07-4794-9617-dabf45e1b8ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f9c72ff608449bad6f8331a39e6a75'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:59.354597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b834a3b1-8f07-4794-9617-dabf45e1b8ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f9c72ff608449bad6f8331a39e6a75'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:59.355987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b834a3b1-8f07-4794-9617-dabf45e1b8ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f9c72ff608449bad6f8331a39e6a75'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:49:59.359465 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 969/1937] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:59.359465 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4711ae-367c-480d-bc7d-366267a9ca0f None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:59.359465 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4711ae-367c-480d-bc7d-366267a9ca0f None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:59.359465 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4711ae-367c-480d-bc7d-366267a9ca0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:59.377584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 969/1938] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:49:59 2022] DELETE /identity/v3/users/a5f9c72ff608449bad6f8331a39e6a75 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:49:59.378854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834a3b1-8f07-4794-9617-dabf45e1b8ce admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:59.381360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-b834a3b1-8f07-4794-9617-dabf45e1b8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:59.410149 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-fd4711ae-367c-480d-bc7d-366267a9ca0f None None] MFA Rules not processed for user `c621601261e44ca8a7938862d6578639`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:59.411484 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-fd4711ae-367c-480d-bc7d-366267a9ca0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:59.486419 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b834a3b1-8f07-4794-9617-dabf45e1b8ce admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:59.492466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc7be7-d26b-44cc-a125-96441bbb6c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:59.493244 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc7be7-d26b-44cc-a125-96441bbb6c4d admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:59.493885 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc7be7-d26b-44cc-a125-96441bbb6c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:59.494354 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc7be7-d26b-44cc-a125-96441bbb6c4d admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:59.495348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc7be7-d26b-44cc-a125-96441bbb6c4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:49:59.495732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc7be7-d26b-44cc-a125-96441bbb6c4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:59.497998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc7be7-d26b-44cc-a125-96441bbb6c4d admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:59.514322 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 970/1939] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:49:59.519688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ffd82-dd2d-40e7-879d-bdad442ff69d None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:59.520089 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ffd82-dd2d-40e7-879d-bdad442ff69d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:59.521109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ffd82-dd2d-40e7-879d-bdad442ff69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:59.549191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-033ffd82-dd2d-40e7-879d-bdad442ff69d None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:49:59.551439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-033ffd82-dd2d-40e7-879d-bdad442ff69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:59.560417 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 970/1940] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 22:49:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:59.561386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4711ae-367c-480d-bc7d-366267a9ca0f None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:59.577247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 971/1941] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:49:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:49:59.580629 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4711ae-367c-480d-bc7d-366267a9ca0f None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:59.588048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0af1f8-61fc-4184-88ba-5a96edb6e8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:59.588797 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0af1f8-61fc-4184-88ba-5a96edb6e8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:59.589162 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0af1f8-61fc-4184-88ba-5a96edb6e8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:59.589506 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0af1f8-61fc-4184-88ba-5a96edb6e8b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:59.590812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0af1f8-61fc-4184-88ba-5a96edb6e8b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:59.592857 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0af1f8-61fc-4184-88ba-5a96edb6e8b7 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:59.607052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ffd82-dd2d-40e7-879d-bdad442ff69d None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:59.609524 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-033ffd82-dd2d-40e7-879d-bdad442ff69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:59.622195 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:59.655710 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ffd82-dd2d-40e7-879d-bdad442ff69d None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:59.669313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46b2ab-a611-4de8-809c-ca33b9587a7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:59.669960 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46b2ab-a611-4de8-809c-ca33b9587a7b service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:59.670839 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 971/1942] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:49:59 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:59.671926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0af1f8-61fc-4184-88ba-5a96edb6e8b7 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:59.672039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46b2ab-a611-4de8-809c-ca33b9587a7b service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:59.674427 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f46b2ab-a611-4de8-809c-ca33b9587a7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:59.680196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-be0af1f8-61fc-4184-88ba-5a96edb6e8b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:59.697668 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46b2ab-a611-4de8-809c-ca33b9587a7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:59.703114 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f46b2ab-a611-4de8-809c-ca33b9587a7b service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:59.732324 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 972/1943] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:49:59.735591 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46b2ab-a611-4de8-809c-ca33b9587a7b service nova] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:59.763939 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f46b2ab-a611-4de8-809c-ca33b9587a7b service nova] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:59.900786 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c23780-eac0-4fea-8e36-0f29881a76ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:59.901444 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23780-eac0-4fea-8e36-0f29881a76ac admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:59.901899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23780-eac0-4fea-8e36-0f29881a76ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:59.902257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23780-eac0-4fea-8e36-0f29881a76ac admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:59.902702 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0af1f8-61fc-4184-88ba-5a96edb6e8b7 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:49:59.904489 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c23780-eac0-4fea-8e36-0f29881a76ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:59.906756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c23780-eac0-4fea-8e36-0f29881a76ac admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:49:59.934950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a881b3-3529-4de4-be28-0fce8a85dafd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:49:59.935611 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a881b3-3529-4de4-be28-0fce8a85dafd service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:49:59.936262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a881b3-3529-4de4-be28-0fce8a85dafd service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:49:59.936913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a881b3-3529-4de4-be28-0fce8a85dafd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:49:59.949714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:49:59.958271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 973/1944] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:49:59 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:49:59.961473 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c23780-eac0-4fea-8e36-0f29881a76ac admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:49:59.968536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d6c23780-eac0-4fea-8e36-0f29881a76ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:49:59.977244 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a881b3-3529-4de4-be28-0fce8a85dafd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:49:59.982947 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a881b3-3529-4de4-be28-0fce8a85dafd service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:00.015000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c23780-eac0-4fea-8e36-0f29881a76ac admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:00.026404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 972/1945] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:49:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:00.027990 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5e86b-0fc0-4463-a5b3-9f16691ac2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:00.028517 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a881b3-3529-4de4-be28-0fce8a85dafd service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:00.029591 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5e86b-0fc0-4463-a5b3-9f16691ac2d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:00.029943 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5e86b-0fc0-4463-a5b3-9f16691ac2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:00.031746 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5e86b-0fc0-4463-a5b3-9f16691ac2d9 admin admin] PATH_INFO: `/v3/projects/cefb26bb94b142a59f4ce7ba20d2b119` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:00.035111 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5e86b-0fc0-4463-a5b3-9f16691ac2d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cefb26bb94b142a59f4ce7ba20d2b119)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:00.040383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5e86b-0fc0-4463-a5b3-9f16691ac2d9 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:00.054056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a881b3-3529-4de4-be28-0fce8a85dafd service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:00.082219 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15401390-259a-463f-be97-e04241064097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:00.083155 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15401390-259a-463f-be97-e04241064097 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:00.083340 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15401390-259a-463f-be97-e04241064097 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:00.083653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15401390-259a-463f-be97-e04241064097 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:00.084367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15401390-259a-463f-be97-e04241064097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:00.086385 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15401390-259a-463f-be97-e04241064097 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:00.116717 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 973/1946] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:00.118762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15401390-259a-463f-be97-e04241064097 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:00.133947 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15401390-259a-463f-be97-e04241064097 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:00.153825 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-21c5e86b-0fc0-4463-a5b3-9f16691ac2d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cefb26bb94b142a59f4ce7ba20d2b119', 'request_id': 'req-21c5e86b-0fc0-4463-a5b3-9f16691ac2d9'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:00.189198 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-21c5e86b-0fc0-4463-a5b3-9f16691ac2d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cefb26bb94b142a59f4ce7ba20d2b119', 'request_id': 'req-21c5e86b-0fc0-4463-a5b3-9f16691ac2d9'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:00.205750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-21c5e86b-0fc0-4463-a5b3-9f16691ac2d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cefb26bb94b142a59f4ce7ba20d2b119', 'request_id': 'req-21c5e86b-0fc0-4463-a5b3-9f16691ac2d9'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:00.236177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-21c5e86b-0fc0-4463-a5b3-9f16691ac2d9 admin admin] The token cache is being invalidate because project cefb26bb94b142a59f4ce7ba20d2b119 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:00.236935 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-21c5e86b-0fc0-4463-a5b3-9f16691ac2d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:00.237827 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-21c5e86b-0fc0-4463-a5b3-9f16691ac2d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:00.244497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 974/1947] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:49:59 2022] DELETE /identity/v3/projects/cefb26bb94b142a59f4ce7ba20d2b119 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:00.246142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5e86b-0fc0-4463-a5b3-9f16691ac2d9 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:00.248934 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-21c5e86b-0fc0-4463-a5b3-9f16691ac2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:00.299880 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada16210-4624-4e88-ad70-e90dc4c252a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:00.300658 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada16210-4624-4e88-ad70-e90dc4c252a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:00.300960 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada16210-4624-4e88-ad70-e90dc4c252a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:00.301234 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada16210-4624-4e88-ad70-e90dc4c252a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:00.302310 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada16210-4624-4e88-ad70-e90dc4c252a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:00.306952 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada16210-4624-4e88-ad70-e90dc4c252a9 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:00.352995 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 974/1948] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:00 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:00.357026 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada16210-4624-4e88-ad70-e90dc4c252a9 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:00.359247 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ada16210-4624-4e88-ad70-e90dc4c252a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:00.359523 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5e86b-0fc0-4463-a5b3-9f16691ac2d9 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:00.375026 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6552153-52c7-4485-ba95-af6698f03c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:00.376658 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6552153-52c7-4485-ba95-af6698f03c5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:00.376845 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada16210-4624-4e88-ad70-e90dc4c252a9 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:00.377329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6552153-52c7-4485-ba95-af6698f03c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:00.377831 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6552153-52c7-4485-ba95-af6698f03c5e admin admin] PATH_INFO: `/v3/users/c767d9770fcd42d2b5281ccbc0c06d93` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:00.380426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6552153-52c7-4485-ba95-af6698f03c5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c767d9770fcd42d2b5281ccbc0c06d93)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:00.382945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6552153-52c7-4485-ba95-af6698f03c5e admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:00.383718 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eba52-d6d5-4cd2-89b7-78fe57cf7352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:00.386247 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eba52-d6d5-4cd2-89b7-78fe57cf7352 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:00.386594 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eba52-d6d5-4cd2-89b7-78fe57cf7352 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:00.386917 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eba52-d6d5-4cd2-89b7-78fe57cf7352 admin admin] PATH_INFO: `/v3/projects/d850376da2ff494aa4a404b10be2ac92/users/43352e8e420947c4ad79e142dd439015/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:00.412880 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6eba52-d6d5-4cd2-89b7-78fe57cf7352 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d850376da2ff494aa4a404b10be2ac92, user_id=43352e8e420947c4ad79e142dd439015, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:00.416536 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6eba52-d6d5-4cd2-89b7-78fe57cf7352 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:00.442498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 975/1949] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:00 2022] PUT /identity/v3/projects/d850376da2ff494aa4a404b10be2ac92/users/43352e8e420947c4ad79e142dd439015/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:00.444245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11e0d5-85dd-449d-8006-cab060632aa0 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:00.444532 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11e0d5-85dd-449d-8006-cab060632aa0 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:00.444837 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee11e0d5-85dd-449d-8006-cab060632aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:00.449972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d6552153-52c7-4485-ba95-af6698f03c5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c767d9770fcd42d2b5281ccbc0c06d93'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:00.450952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d6552153-52c7-4485-ba95-af6698f03c5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c767d9770fcd42d2b5281ccbc0c06d93'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:00.467295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d6552153-52c7-4485-ba95-af6698f03c5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c767d9770fcd42d2b5281ccbc0c06d93'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:00.480242 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-ee11e0d5-85dd-449d-8006-cab060632aa0 None None] MFA Rules not processed for user `43352e8e420947c4ad79e142dd439015`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:00.481465 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ee11e0d5-85dd-449d-8006-cab060632aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:00.489849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d6552153-52c7-4485-ba95-af6698f03c5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c767d9770fcd42d2b5281ccbc0c06d93'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:00.490652 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d6552153-52c7-4485-ba95-af6698f03c5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c767d9770fcd42d2b5281ccbc0c06d93'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:00.508318 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 975/1950] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:00 2022] DELETE /identity/v3/users/c767d9770fcd42d2b5281ccbc0c06d93 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:00.542068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:00.581451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 976/1951] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:00.594675 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6552153-52c7-4485-ba95-af6698f03c5e admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:00.596628 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d6552153-52c7-4485-ba95-af6698f03c5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:00.610301 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:00.708600 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6552153-52c7-4485-ba95-af6698f03c5e admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:00.717101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9bd76-fb5c-453f-802a-627ae600f1a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:00.717746 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9bd76-fb5c-453f-802a-627ae600f1a8 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:00.718036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9bd76-fb5c-453f-802a-627ae600f1a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:00.718317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9bd76-fb5c-453f-802a-627ae600f1a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:00.829518 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9bd76-fb5c-453f-802a-627ae600f1a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:00.831052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9bd76-fb5c-453f-802a-627ae600f1a8 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:00.842359 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 976/1952] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:00.982317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11e0d5-85dd-449d-8006-cab060632aa0 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:00.983956 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ee11e0d5-85dd-449d-8006-cab060632aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:01.115156 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee11e0d5-85dd-449d-8006-cab060632aa0 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:01.149009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9bd76-fb5c-453f-802a-627ae600f1a8 service cinder] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:01.150641 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-59c9bd76-fb5c-453f-802a-627ae600f1a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:01.209423 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67241d-eb56-4d23-aab6-80f38febba77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:01.210070 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67241d-eb56-4d23-aab6-80f38febba77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:01.211341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67241d-eb56-4d23-aab6-80f38febba77 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:01.211617 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67241d-eb56-4d23-aab6-80f38febba77 admin admin] PATH_INFO: `/v3/projects/d5ecb83e9fb04d70a3e9ab6fdbbdf9e5` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:01.212850 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67241d-eb56-4d23-aab6-80f38febba77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5ecb83e9fb04d70a3e9ab6fdbbdf9e5)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:01.215568 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67241d-eb56-4d23-aab6-80f38febba77 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:01.310186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9bd76-fb5c-453f-802a-627ae600f1a8 service cinder] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:01.331344 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0f67241d-eb56-4d23-aab6-80f38febba77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5ecb83e9fb04d70a3e9ab6fdbbdf9e5', 'request_id': 'req-0f67241d-eb56-4d23-aab6-80f38febba77'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:01.339515 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0f67241d-eb56-4d23-aab6-80f38febba77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5ecb83e9fb04d70a3e9ab6fdbbdf9e5', 'request_id': 'req-0f67241d-eb56-4d23-aab6-80f38febba77'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:01.350146 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0f67241d-eb56-4d23-aab6-80f38febba77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5ecb83e9fb04d70a3e9ab6fdbbdf9e5', 'request_id': 'req-0f67241d-eb56-4d23-aab6-80f38febba77'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:01.366496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0f67241d-eb56-4d23-aab6-80f38febba77 admin admin] The token cache is being invalidate because project d5ecb83e9fb04d70a3e9ab6fdbbdf9e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:01.366600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0f67241d-eb56-4d23-aab6-80f38febba77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:01.367651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0f67241d-eb56-4d23-aab6-80f38febba77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:01.369966 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 977/1953] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:00 2022] DELETE /identity/v3/projects/d5ecb83e9fb04d70a3e9ab6fdbbdf9e5 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:01.387788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca5924-fe0a-4a04-b54a-68587057d432 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:01.389250 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca5924-fe0a-4a04-b54a-68587057d432 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:01.389550 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca5924-fe0a-4a04-b54a-68587057d432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:01.443671 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-70ca5924-fe0a-4a04-b54a-68587057d432 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:01.444190 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b51cc-cf16-4110-af53-59e18dc9b860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:01.445256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b51cc-cf16-4110-af53-59e18dc9b860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:01.445691 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b51cc-cf16-4110-af53-59e18dc9b860 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:01.446145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b51cc-cf16-4110-af53-59e18dc9b860 admin admin] PATH_INFO: `/v3/projects/ad14d440e13442f98f4ea5b0cdd79de4` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:01.446506 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-70ca5924-fe0a-4a04-b54a-68587057d432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:01.447769 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b51cc-cf16-4110-af53-59e18dc9b860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad14d440e13442f98f4ea5b0cdd79de4)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:01.449828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b51cc-cf16-4110-af53-59e18dc9b860 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:01.459767 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:01.471179 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 978/1954] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:01.481079 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570290-374a-4c9c-ac0a-f5875a084259 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:01.481535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570290-374a-4c9c-ac0a-f5875a084259 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:01.482669 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc570290-374a-4c9c-ac0a-f5875a084259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:01.527311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-cc570290-374a-4c9c-ac0a-f5875a084259 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:01.528668 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-cc570290-374a-4c9c-ac0a-f5875a084259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:01.555855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 979/1955] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:01.559568 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc570290-374a-4c9c-ac0a-f5875a084259 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:01.568414 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1e9b51cc-cf16-4110-af53-59e18dc9b860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad14d440e13442f98f4ea5b0cdd79de4', 'request_id': 'req-1e9b51cc-cf16-4110-af53-59e18dc9b860'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:01.572065 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc570290-374a-4c9c-ac0a-f5875a084259 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:01.576718 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1e9b51cc-cf16-4110-af53-59e18dc9b860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad14d440e13442f98f4ea5b0cdd79de4', 'request_id': 'req-1e9b51cc-cf16-4110-af53-59e18dc9b860'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:01.584755 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:01.586701 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1e9b51cc-cf16-4110-af53-59e18dc9b860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad14d440e13442f98f4ea5b0cdd79de4', 'request_id': 'req-1e9b51cc-cf16-4110-af53-59e18dc9b860'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:01.608020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1e9b51cc-cf16-4110-af53-59e18dc9b860 admin admin] The token cache is being invalidate because project ad14d440e13442f98f4ea5b0cdd79de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:01.608459 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1e9b51cc-cf16-4110-af53-59e18dc9b860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:01.609176 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1e9b51cc-cf16-4110-af53-59e18dc9b860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:01.612201 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 977/1956] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:01 2022] DELETE /identity/v3/projects/ad14d440e13442f98f4ea5b0cdd79de4 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:01.615859 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b51cc-cf16-4110-af53-59e18dc9b860 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:01.617811 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-1e9b51cc-cf16-4110-af53-59e18dc9b860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:01.656859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f0683-a4dc-4dbb-a40c-80c3ebd921b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:01.657682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f0683-a4dc-4dbb-a40c-80c3ebd921b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:01.657966 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f0683-a4dc-4dbb-a40c-80c3ebd921b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:01.658265 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f0683-a4dc-4dbb-a40c-80c3ebd921b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:01.659000 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f0683-a4dc-4dbb-a40c-80c3ebd921b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:50:01.659430 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f0683-a4dc-4dbb-a40c-80c3ebd921b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:01.661842 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f0683-a4dc-4dbb-a40c-80c3ebd921b0 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:01.677585 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 980/1957] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:50:01.678637 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f0683-a4dc-4dbb-a40c-80c3ebd921b0 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:01.680719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-529f0683-a4dc-4dbb-a40c-80c3ebd921b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:01.691210 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b51cc-cf16-4110-af53-59e18dc9b860 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:01.693100 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f0683-a4dc-4dbb-a40c-80c3ebd921b0 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:01.696398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7a7ec-ab81-4577-8264-09f86a72d1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:01.697052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7a7ec-ab81-4577-8264-09f86a72d1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:01.697339 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7a7ec-ab81-4577-8264-09f86a72d1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:01.697663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7a7ec-ab81-4577-8264-09f86a72d1c3 admin admin] PATH_INFO: `/v3/users/1e8e002be32a402e8ef03fabae72eaaa` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:01.698189 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3385c7e-4361-4383-9ca5-4ede059e2663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:01.698750 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3385c7e-4361-4383-9ca5-4ede059e2663 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:01.698862 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7a7ec-ab81-4577-8264-09f86a72d1c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e8e002be32a402e8ef03fabae72eaaa)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:01.699034 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3385c7e-4361-4383-9ca5-4ede059e2663 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:01.699308 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3385c7e-4361-4383-9ca5-4ede059e2663 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:01.699960 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3385c7e-4361-4383-9ca5-4ede059e2663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:01.700749 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a7a7ec-ab81-4577-8264-09f86a72d1c3 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:01.701804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3385c7e-4361-4383-9ca5-4ede059e2663 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:01.731332 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 981/1958] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:01 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:01.735591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3385c7e-4361-4383-9ca5-4ede059e2663 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:01.755688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-31a7a7ec-ab81-4577-8264-09f86a72d1c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e8e002be32a402e8ef03fabae72eaaa'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:01.756617 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-31a7a7ec-ab81-4577-8264-09f86a72d1c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e8e002be32a402e8ef03fabae72eaaa'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:01.766947 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-31a7a7ec-ab81-4577-8264-09f86a72d1c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e8e002be32a402e8ef03fabae72eaaa'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:01.797898 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-31a7a7ec-ab81-4577-8264-09f86a72d1c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e8e002be32a402e8ef03fabae72eaaa'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:01.798711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-31a7a7ec-ab81-4577-8264-09f86a72d1c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e8e002be32a402e8ef03fabae72eaaa'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:01.809738 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3385c7e-4361-4383-9ca5-4ede059e2663 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:01.812020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 978/1959] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:01 2022] DELETE /identity/v3/users/1e8e002be32a402e8ef03fabae72eaaa => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:01.814960 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522fd5f-ff8a-4e9e-982e-e339cb520ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:01.816022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522fd5f-ff8a-4e9e-982e-e339cb520ec6 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:01.816022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522fd5f-ff8a-4e9e-982e-e339cb520ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:01.816300 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522fd5f-ff8a-4e9e-982e-e339cb520ec6 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:01.816937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522fd5f-ff8a-4e9e-982e-e339cb520ec6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:01.819066 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522fd5f-ff8a-4e9e-982e-e339cb520ec6 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:01.865347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 982/1960] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:01 2022] POST /identity/v3/users => generated 296 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:01.866380 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7a7ec-ab81-4577-8264-09f86a72d1c3 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:01.868409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-31a7a7ec-ab81-4577-8264-09f86a72d1c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:01.893396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:01.967247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7a7ec-ab81-4577-8264-09f86a72d1c3 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:01.971952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c364c-a4b4-4fec-9774-b3e0955113a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:01.972579 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c364c-a4b4-4fec-9774-b3e0955113a6 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:01.972881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c364c-a4b4-4fec-9774-b3e0955113a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:01.973175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5c364c-a4b4-4fec-9774-b3e0955113a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:01.973886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c364c-a4b4-4fec-9774-b3e0955113a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:01.975524 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5c364c-a4b4-4fec-9774-b3e0955113a6 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:01.991107 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 979/1961] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:01.992596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522fd5f-ff8a-4e9e-982e-e339cb520ec6 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:02.003021 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522fd5f-ff8a-4e9e-982e-e339cb520ec6 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:02.008977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9570c81f-fffc-45f3-b151-1c882072b863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:02.011011 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570c81f-fffc-45f3-b151-1c882072b863 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:02.011303 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570c81f-fffc-45f3-b151-1c882072b863 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:02.011583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9570c81f-fffc-45f3-b151-1c882072b863 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:02.012296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570c81f-fffc-45f3-b151-1c882072b863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:02.013944 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9570c81f-fffc-45f3-b151-1c882072b863 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:02.031863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 983/1962] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:02.035383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c364c-a4b4-4fec-9774-b3e0955113a6 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:02.047963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5c364c-a4b4-4fec-9774-b3e0955113a6 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:02.055916 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251637b1-140a-427a-901e-c6c79367ce2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:02.056617 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251637b1-140a-427a-901e-c6c79367ce2e admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:02.056917 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251637b1-140a-427a-901e-c6c79367ce2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:02.057191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251637b1-140a-427a-901e-c6c79367ce2e admin admin] PATH_INFO: `/v3/projects/efa525dda1674053aa7d927543f18c44/users/5e70c6c0b87347dd97e137ad8f206922/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:02.075718 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251637b1-140a-427a-901e-c6c79367ce2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=efa525dda1674053aa7d927543f18c44, user_id=5e70c6c0b87347dd97e137ad8f206922, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:02.078544 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251637b1-140a-427a-901e-c6c79367ce2e admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:02.094500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 980/1963] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:02 2022] PUT /identity/v3/projects/efa525dda1674053aa7d927543f18c44/users/5e70c6c0b87347dd97e137ad8f206922/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:02.105981 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5c07c-94d6-4479-a68a-1a039e50cca8 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:02.106277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5c07c-94d6-4479-a68a-1a039e50cca8 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:02.106630 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5c07c-94d6-4479-a68a-1a039e50cca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:02.155997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251637b1-140a-427a-901e-c6c79367ce2e admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:02.157557 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-251637b1-140a-427a-901e-c6c79367ce2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:02.169202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-3ae5c07c-94d6-4479-a68a-1a039e50cca8 None None] MFA Rules not processed for user `5e70c6c0b87347dd97e137ad8f206922`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:02.173748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-3ae5c07c-94d6-4479-a68a-1a039e50cca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:02.240379 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:02.260655 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251637b1-140a-427a-901e-c6c79367ce2e admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:02.263090 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 984/1964] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:02.267371 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5c07c-94d6-4479-a68a-1a039e50cca8 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:02.269163 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761eeef-56b7-4dbb-a19c-2e7b2cdda9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:02.269815 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761eeef-56b7-4dbb-a19c-2e7b2cdda9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:02.270094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761eeef-56b7-4dbb-a19c-2e7b2cdda9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:02.270392 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761eeef-56b7-4dbb-a19c-2e7b2cdda9c5 admin admin] PATH_INFO: `/v3/projects/d757aa6aa9844037bd82a6045bd54e41` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:02.271544 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761eeef-56b7-4dbb-a19c-2e7b2cdda9c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d757aa6aa9844037bd82a6045bd54e41)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:02.273527 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761eeef-56b7-4dbb-a19c-2e7b2cdda9c5 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:02.278069 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5c07c-94d6-4479-a68a-1a039e50cca8 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:02.284179 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08169dcd-d11e-4220-9056-b8c6500e9917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:02.284887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08169dcd-d11e-4220-9056-b8c6500e9917 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:02.285293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08169dcd-d11e-4220-9056-b8c6500e9917 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:02.285572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08169dcd-d11e-4220-9056-b8c6500e9917 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:02.286640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08169dcd-d11e-4220-9056-b8c6500e9917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:02.289222 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08169dcd-d11e-4220-9056-b8c6500e9917 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:02.320260 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 985/1965] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:02 2022] POST /identity/v3/projects => generated 393 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:02.324201 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08169dcd-d11e-4220-9056-b8c6500e9917 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:02.330009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1761eeef-56b7-4dbb-a19c-2e7b2cdda9c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd757aa6aa9844037bd82a6045bd54e41', 'request_id': 'req-1761eeef-56b7-4dbb-a19c-2e7b2cdda9c5'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:02.338318 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1761eeef-56b7-4dbb-a19c-2e7b2cdda9c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd757aa6aa9844037bd82a6045bd54e41', 'request_id': 'req-1761eeef-56b7-4dbb-a19c-2e7b2cdda9c5'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:02.345994 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1761eeef-56b7-4dbb-a19c-2e7b2cdda9c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd757aa6aa9844037bd82a6045bd54e41', 'request_id': 'req-1761eeef-56b7-4dbb-a19c-2e7b2cdda9c5'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:02.360948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1761eeef-56b7-4dbb-a19c-2e7b2cdda9c5 admin admin] The token cache is being invalidate because project d757aa6aa9844037bd82a6045bd54e41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:02.361505 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1761eeef-56b7-4dbb-a19c-2e7b2cdda9c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:02.362670 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1761eeef-56b7-4dbb-a19c-2e7b2cdda9c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:02.369017 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 981/1966] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:02 2022] DELETE /identity/v3/projects/d757aa6aa9844037bd82a6045bd54e41 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:02.370589 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3299e4f-0522-4762-897a-76962847d7ac None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:02.370879 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3299e4f-0522-4762-897a-76962847d7ac None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:02.371162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3299e4f-0522-4762-897a-76962847d7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:02.398128 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-d3299e4f-0522-4762-897a-76962847d7ac None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:02.399370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d3299e4f-0522-4762-897a-76962847d7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:02.410076 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:02.416242 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08169dcd-d11e-4220-9056-b8c6500e9917 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:02.422684 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67790f-5a91-4f3f-aa40-a9deaa9d279f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:02.424964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67790f-5a91-4f3f-aa40-a9deaa9d279f admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:02.425359 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67790f-5a91-4f3f-aa40-a9deaa9d279f admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:02.426187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67790f-5a91-4f3f-aa40-a9deaa9d279f admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:02.426599 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67790f-5a91-4f3f-aa40-a9deaa9d279f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:02.429048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67790f-5a91-4f3f-aa40-a9deaa9d279f admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:02.470212 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 986/1967] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:02 2022] POST /identity/v3/users => generated 303 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:02.472755 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67790f-5a91-4f3f-aa40-a9deaa9d279f admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:02.474901 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-cb67790f-5a91-4f3f-aa40-a9deaa9d279f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:02.486498 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 982/1968] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:02.493784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb20a23-e212-4704-ae86-c32c8f6b4452 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:02.493784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb20a23-e212-4704-ae86-c32c8f6b4452 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:02.494386 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb20a23-e212-4704-ae86-c32c8f6b4452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:02.499038 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67790f-5a91-4f3f-aa40-a9deaa9d279f admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:02.503785 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac464bb-67b1-4c1f-9401-413aa246c904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:02.504649 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac464bb-67b1-4c1f-9401-413aa246c904 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:02.505039 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac464bb-67b1-4c1f-9401-413aa246c904 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:02.505655 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac464bb-67b1-4c1f-9401-413aa246c904 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:02.506697 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac464bb-67b1-4c1f-9401-413aa246c904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:02.508519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac464bb-67b1-4c1f-9401-413aa246c904 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:02.518782 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-cfb20a23-e212-4704-ae86-c32c8f6b4452 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:02.519988 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-cfb20a23-e212-4704-ae86-c32c8f6b4452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:02.527023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 987/1969] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:02.528250 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac464bb-67b1-4c1f-9401-413aa246c904 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:02.537755 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 983/1970] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:02.539193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb20a23-e212-4704-ae86-c32c8f6b4452 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:02.546734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac464bb-67b1-4c1f-9401-413aa246c904 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:02.550572 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb20a23-e212-4704-ae86-c32c8f6b4452 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:02.556285 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fbed1-9569-4eb2-9070-c344886c3c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:02.556986 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fbed1-9569-4eb2-9070-c344886c3c3c admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:02.557220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995ccaf-c5dd-4938-a9e5-61ef74e3feea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:02.557374 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fbed1-9569-4eb2-9070-c344886c3c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:02.557600 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150fbed1-9569-4eb2-9070-c344886c3c3c admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:02.558298 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fbed1-9569-4eb2-9070-c344886c3c3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:50:02.558639 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fbed1-9569-4eb2-9070-c344886c3c3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:02.558805 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995ccaf-c5dd-4938-a9e5-61ef74e3feea admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:02.559093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995ccaf-c5dd-4938-a9e5-61ef74e3feea admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:02.559377 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995ccaf-c5dd-4938-a9e5-61ef74e3feea admin admin] PATH_INFO: `/v3/projects/d1c031e1dd33493d81ab9547ec21c583/users/e77d203688234dd3b2d0c2dcd606ec28/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:02.560217 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150fbed1-9569-4eb2-9070-c344886c3c3c admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:02.572237 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 984/1971] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:50:02.576695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fbed1-9569-4eb2-9070-c344886c3c3c admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:02.585644 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995ccaf-c5dd-4938-a9e5-61ef74e3feea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c031e1dd33493d81ab9547ec21c583, user_id=e77d203688234dd3b2d0c2dcd606ec28, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:02.587129 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150fbed1-9569-4eb2-9070-c344886c3c3c admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:02.590329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995ccaf-c5dd-4938-a9e5-61ef74e3feea admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:02.592026 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fede2-8987-4cd6-abbe-18867914308d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:02.592754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fede2-8987-4cd6-abbe-18867914308d admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:02.593036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fede2-8987-4cd6-abbe-18867914308d admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:02.593321 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fede2-8987-4cd6-abbe-18867914308d admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:02.594002 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fede2-8987-4cd6-abbe-18867914308d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:02.596012 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fede2-8987-4cd6-abbe-18867914308d admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:02.625085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 988/1972] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:02 2022] PUT /identity/v3/projects/d1c031e1dd33493d81ab9547ec21c583/users/e77d203688234dd3b2d0c2dcd606ec28/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:02.629452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995ccaf-c5dd-4938-a9e5-61ef74e3feea admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:02.630380 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 985/1973] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:02 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:02.634333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fede2-8987-4cd6-abbe-18867914308d admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:02.697719 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fede2-8987-4cd6-abbe-18867914308d admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:02.708782 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c3e4f-e60c-4a14-b3a9-22d8716ddd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:02.708986 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995ccaf-c5dd-4938-a9e5-61ef74e3feea admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:02.710001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c3e4f-e60c-4a14-b3a9-22d8716ddd20 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:02.710989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c3e4f-e60c-4a14-b3a9-22d8716ddd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:02.711567 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c3e4f-e60c-4a14-b3a9-22d8716ddd20 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:02.712573 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c3e4f-e60c-4a14-b3a9-22d8716ddd20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:02.715026 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c3e4f-e60c-4a14-b3a9-22d8716ddd20 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:02.718448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f860f0-f348-408d-9294-3fcfe56f0174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:02.719284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f860f0-f348-408d-9294-3fcfe56f0174 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:02.719712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f860f0-f348-408d-9294-3fcfe56f0174 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:02.720161 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f860f0-f348-408d-9294-3fcfe56f0174 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:02.721040 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f860f0-f348-408d-9294-3fcfe56f0174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:02.723245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f860f0-f348-408d-9294-3fcfe56f0174 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:02.742648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 989/1974] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:02.752583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 986/1975] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:02 2022] POST /identity/v3/users => generated 290 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:02.753898 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f860f0-f348-408d-9294-3fcfe56f0174 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:02.756671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c3e4f-e60c-4a14-b3a9-22d8716ddd20 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:02.767334 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f860f0-f348-408d-9294-3fcfe56f0174 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:02.769079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c3e4f-e60c-4a14-b3a9-22d8716ddd20 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:02.773759 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac1022-03e1-4491-a532-fff7549bf6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:02.774766 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac1022-03e1-4491-a532-fff7549bf6c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:02.775051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac1022-03e1-4491-a532-fff7549bf6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:02.775333 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac1022-03e1-4491-a532-fff7549bf6c4 admin admin] PATH_INFO: `/v3/projects/d1c031e1dd33493d81ab9547ec21c583/users/e77d203688234dd3b2d0c2dcd606ec28/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:02.775515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5afbdf-b299-40ee-bc8b-811b59d84ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:02.776631 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5afbdf-b299-40ee-bc8b-811b59d84ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:02.776844 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5afbdf-b299-40ee-bc8b-811b59d84ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:02.777220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5afbdf-b299-40ee-bc8b-811b59d84ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:02.777308 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac1022-03e1-4491-a532-fff7549bf6c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1c031e1dd33493d81ab9547ec21c583, user_id=e77d203688234dd3b2d0c2dcd606ec28, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:02.778211 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5afbdf-b299-40ee-bc8b-811b59d84ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:02.779979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac1022-03e1-4491-a532-fff7549bf6c4 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:02.781301 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5afbdf-b299-40ee-bc8b-811b59d84ed4 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:02.795830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 990/1976] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:02 2022] PUT /identity/v3/projects/d1c031e1dd33493d81ab9547ec21c583/users/e77d203688234dd3b2d0c2dcd606ec28/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:02.800045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 987/1977] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:02.803936 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac1022-03e1-4491-a532-fff7549bf6c4 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:02.806214 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2dc77-95d8-45ab-a98b-aa278d558e3a None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:02.806602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2dc77-95d8-45ab-a98b-aa278d558e3a None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:02.808192 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2dc77-95d8-45ab-a98b-aa278d558e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:02.812846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:02.839531 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-56b2dc77-95d8-45ab-a98b-aa278d558e3a None None] MFA Rules not processed for user `e77d203688234dd3b2d0c2dcd606ec28`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:02.840673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-56b2dc77-95d8-45ab-a98b-aa278d558e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:02.872940 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac1022-03e1-4491-a532-fff7549bf6c4 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:02.878405 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0440ef5-4f85-4618-81ea-46d78735c6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:02.879037 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0440ef5-4f85-4618-81ea-46d78735c6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:02.879326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0440ef5-4f85-4618-81ea-46d78735c6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:02.879610 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0440ef5-4f85-4618-81ea-46d78735c6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:02.880312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0440ef5-4f85-4618-81ea-46d78735c6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:02.881919 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0440ef5-4f85-4618-81ea-46d78735c6b9 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:02.890116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:02.900086 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 991/1978] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:02.904191 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0440ef5-4f85-4618-81ea-46d78735c6b9 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:02.914238 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0440ef5-4f85-4618-81ea-46d78735c6b9 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:02.918843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa21825-5ea9-4bba-9a67-93833228b3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:02.919482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa21825-5ea9-4bba-9a67-93833228b3b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:02.919764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa21825-5ea9-4bba-9a67-93833228b3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:02.920033 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa21825-5ea9-4bba-9a67-93833228b3b7 admin admin] PATH_INFO: `/v3/projects/68b903010f4844b28739f1a084604b10/users/2fece376fb6b414b91906ff90c531d38/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:02.923539 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 988/1979] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:02.934603 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2dc77-95d8-45ab-a98b-aa278d558e3a None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:02.934953 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa21825-5ea9-4bba-9a67-93833228b3b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68b903010f4844b28739f1a084604b10, user_id=2fece376fb6b414b91906ff90c531d38, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:02.935995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-56b2dc77-95d8-45ab-a98b-aa278d558e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:02.940098 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa21825-5ea9-4bba-9a67-93833228b3b7 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:02.956637 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 992/1980] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:02 2022] PUT /identity/v3/projects/68b903010f4844b28739f1a084604b10/users/2fece376fb6b414b91906ff90c531d38/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:02.967773 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f1c5-c2c6-4b10-b7f3-56492e1e2ec7 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:02.968067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f1c5-c2c6-4b10-b7f3-56492e1e2ec7 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:02.968354 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6f1c5-c2c6-4b10-b7f3-56492e1e2ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:02.999193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-c9d6f1c5-c2c6-4b10-b7f3-56492e1e2ec7 None None] MFA Rules not processed for user `2fece376fb6b414b91906ff90c531d38`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:03.000587 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-c9d6f1c5-c2c6-4b10-b7f3-56492e1e2ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:03.028974 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2dc77-95d8-45ab-a98b-aa278d558e3a None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:03.105597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfbc1f-855f-4ef5-bc79-7c6be548bdc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:03.106464 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfbc1f-855f-4ef5-bc79-7c6be548bdc6 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:03.106763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfbc1f-855f-4ef5-bc79-7c6be548bdc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:03.107048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfbc1f-855f-4ef5-bc79-7c6be548bdc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:03.156715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 993/1981] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:03.161404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6f1c5-c2c6-4b10-b7f3-56492e1e2ec7 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:03.262424 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfbc1f-855f-4ef5-bc79-7c6be548bdc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:03.266470 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfbc1f-855f-4ef5-bc79-7c6be548bdc6 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:03.283941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 989/1982] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:50:03.306546 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6f1c5-c2c6-4b10-b7f3-56492e1e2ec7 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:03.312308 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266f3ef-9483-4cd4-bfda-11ce264177d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:03.313074 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266f3ef-9483-4cd4-bfda-11ce264177d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:03.313429 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266f3ef-9483-4cd4-bfda-11ce264177d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:03.313776 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266f3ef-9483-4cd4-bfda-11ce264177d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:03.315076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266f3ef-9483-4cd4-bfda-11ce264177d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:03.316853 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266f3ef-9483-4cd4-bfda-11ce264177d0 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:03.330041 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:03.364969 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 994/1983] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:03 2022] POST /identity/v3/projects => generated 379 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:03.366186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfbc1f-855f-4ef5-bc79-7c6be548bdc6 service cinder] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:03.382913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266f3ef-9483-4cd4-bfda-11ce264177d0 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:03.383723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfbc1f-855f-4ef5-bc79-7c6be548bdc6 service cinder] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:03.467839 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:03.494176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266f3ef-9483-4cd4-bfda-11ce264177d0 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:03.499011 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf7d77-270d-479b-b483-6eb2b37cfa28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:03.499737 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf7d77-270d-479b-b483-6eb2b37cfa28 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:03.500151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf7d77-270d-479b-b483-6eb2b37cfa28 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:03.500527 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf7d77-270d-479b-b483-6eb2b37cfa28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:03.502908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-facf7d77-270d-479b-b483-6eb2b37cfa28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:03.517812 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a7c05-8ad4-4fe8-b6a3-33a33148ef76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:03.518847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a7c05-8ad4-4fe8-b6a3-33a33148ef76 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:03.519199 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a7c05-8ad4-4fe8-b6a3-33a33148ef76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:03.519545 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a7c05-8ad4-4fe8-b6a3-33a33148ef76 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:03.520280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a7c05-8ad4-4fe8-b6a3-33a33148ef76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:03.525479 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a7c05-8ad4-4fe8-b6a3-33a33148ef76 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:03.574408 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf7d77-270d-479b-b483-6eb2b37cfa28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:03.576297 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf7d77-270d-479b-b483-6eb2b37cfa28 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:03.591315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 995/1984] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:03.596949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 990/1985] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:03 2022] POST /identity/v3/users => generated 296 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:03.607069 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf7d77-270d-479b-b483-6eb2b37cfa28 service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:03.625935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf7d77-270d-479b-b483-6eb2b37cfa28 service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:03.638008 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fbd27-c703-460c-9902-c9b6c6bb2b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:03.638726 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fbd27-c703-460c-9902-c9b6c6bb2b5e admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:03.639158 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fbd27-c703-460c-9902-c9b6c6bb2b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:03.639444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30fbd27-c703-460c-9902-c9b6c6bb2b5e admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:03.640162 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fbd27-c703-460c-9902-c9b6c6bb2b5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:03.644361 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30fbd27-c703-460c-9902-c9b6c6bb2b5e admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:03.660637 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 996/1986] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:03.664714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a7c05-8ad4-4fe8-b6a3-33a33148ef76 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:03.687154 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a7c05-8ad4-4fe8-b6a3-33a33148ef76 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:03.699507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d738a5-6802-41f4-b867-240e428973c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:03.700343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d738a5-6802-41f4-b867-240e428973c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:03.700639 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d738a5-6802-41f4-b867-240e428973c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:03.700921 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d738a5-6802-41f4-b867-240e428973c2 admin admin] PATH_INFO: `/v3/projects/659f46577e164ceb97667ac44ad073eb/users/4973a2ef4b064729936daa0035f1ac07/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:03.736085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d738a5-6802-41f4-b867-240e428973c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=659f46577e164ceb97667ac44ad073eb, user_id=4973a2ef4b064729936daa0035f1ac07, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:03.743196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d738a5-6802-41f4-b867-240e428973c2 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:03.779216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 991/1987] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:03 2022] PUT /identity/v3/projects/659f46577e164ceb97667ac44ad073eb/users/4973a2ef4b064729936daa0035f1ac07/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:03.780425 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fbd27-c703-460c-9902-c9b6c6bb2b5e admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:03.795014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30fbd27-c703-460c-9902-c9b6c6bb2b5e admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:03.916348 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b9c3b-f6e0-43a0-9718-73e82444f35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:03.917310 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b9c3b-f6e0-43a0-9718-73e82444f35c admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:03.917843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b9c3b-f6e0-43a0-9718-73e82444f35c admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:03.918356 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b9c3b-f6e0-43a0-9718-73e82444f35c admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:03.919357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b9c3b-f6e0-43a0-9718-73e82444f35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:03.921448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b9c3b-f6e0-43a0-9718-73e82444f35c admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:03.938120 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 997/1988] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:03 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:03.942049 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d738a5-6802-41f4-b867-240e428973c2 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:03.956764 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d738a5-6802-41f4-b867-240e428973c2 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:03.962680 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb07fa-f10c-433d-b5d1-528ffb8fe258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:03.964780 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb07fa-f10c-433d-b5d1-528ffb8fe258 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:03.965071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb07fa-f10c-433d-b5d1-528ffb8fe258 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:03.965851 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb07fa-f10c-433d-b5d1-528ffb8fe258 admin admin] PATH_INFO: `/v3/projects/659f46577e164ceb97667ac44ad073eb/users/4973a2ef4b064729936daa0035f1ac07/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:03.967716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb07fa-f10c-433d-b5d1-528ffb8fe258 admin admin] RBAC: Authorizing `identity:create_grant(project_id=659f46577e164ceb97667ac44ad073eb, user_id=4973a2ef4b064729936daa0035f1ac07, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:03.970538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb07fa-f10c-433d-b5d1-528ffb8fe258 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:03.984246 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 992/1989] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:03 2022] PUT /identity/v3/projects/659f46577e164ceb97667ac44ad073eb/users/4973a2ef4b064729936daa0035f1ac07/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:03.996620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a459f-8787-4769-8e55-1662e6c8162a None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:03.997114 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a459f-8787-4769-8e55-1662e6c8162a None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:03.997442 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a459f-8787-4769-8e55-1662e6c8162a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:04.033015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-650a459f-8787-4769-8e55-1662e6c8162a None None] MFA Rules not processed for user `4973a2ef4b064729936daa0035f1ac07`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:04.034443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-650a459f-8787-4769-8e55-1662e6c8162a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:04.089355 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:04.177864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 998/1990] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:04.186713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb07fa-f10c-433d-b5d1-528ffb8fe258 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:04.270063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb07fa-f10c-433d-b5d1-528ffb8fe258 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:04.275271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad109387-e87d-4c57-8944-d7289d50b3a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:04.275903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad109387-e87d-4c57-8944-d7289d50b3a8 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:04.276193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad109387-e87d-4c57-8944-d7289d50b3a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:04.276476 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad109387-e87d-4c57-8944-d7289d50b3a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:04.345983 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad109387-e87d-4c57-8944-d7289d50b3a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:04.347595 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad109387-e87d-4c57-8944-d7289d50b3a8 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:04.361524 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 993/1991] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:06.856977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a459f-8787-4769-8e55-1662e6c8162a None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:06.858592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-650a459f-8787-4769-8e55-1662e6c8162a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:06.859180 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad109387-e87d-4c57-8944-d7289d50b3a8 service cinder] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:06.860772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ad109387-e87d-4c57-8944-d7289d50b3a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:06.876652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a459f-8787-4769-8e55-1662e6c8162a None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:06.880171 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f6858-0f0b-414b-90c2-1df270c6358c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:06.880791 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f6858-0f0b-414b-90c2-1df270c6358c service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:06.881071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f6858-0f0b-414b-90c2-1df270c6358c service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:06.881681 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f6858-0f0b-414b-90c2-1df270c6358c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:06.890669 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f6858-0f0b-414b-90c2-1df270c6358c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:06.892095 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255f6858-0f0b-414b-90c2-1df270c6358c service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:06.902152 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 999/1992] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:06.916043 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:06.931261 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad109387-e87d-4c57-8944-d7289d50b3a8 service cinder] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:06.935818 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e97f15-be4b-49fc-9c4d-0c5613436574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:06.936471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e97f15-be4b-49fc-9c4d-0c5613436574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:06.936756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e97f15-be4b-49fc-9c4d-0c5613436574 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:06.937036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e97f15-be4b-49fc-9c4d-0c5613436574 admin admin] PATH_INFO: `/v3/users/43352e8e420947c4ad79e142dd439015` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:06.938364 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e97f15-be4b-49fc-9c4d-0c5613436574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43352e8e420947c4ad79e142dd439015)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:06.940354 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e97f15-be4b-49fc-9c4d-0c5613436574 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:06.989770 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-09e97f15-be4b-49fc-9c4d-0c5613436574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43352e8e420947c4ad79e142dd439015'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:06.990370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-09e97f15-be4b-49fc-9c4d-0c5613436574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43352e8e420947c4ad79e142dd439015'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:06.999651 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-09e97f15-be4b-49fc-9c4d-0c5613436574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43352e8e420947c4ad79e142dd439015'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:07.013132 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-09e97f15-be4b-49fc-9c4d-0c5613436574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43352e8e420947c4ad79e142dd439015'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:07.013805 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-09e97f15-be4b-49fc-9c4d-0c5613436574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43352e8e420947c4ad79e142dd439015'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:07.027713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 994/1993] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:06 2022] DELETE /identity/v3/users/43352e8e420947c4ad79e142dd439015 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:07.032345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e628727-4e4a-45d1-b872-8dfaca2f427e None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:07.032639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e628727-4e4a-45d1-b872-8dfaca2f427e None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:07.032923 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e628727-4e4a-45d1-b872-8dfaca2f427e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:07.053246 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-6e628727-4e4a-45d1-b872-8dfaca2f427e None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:07.054527 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6e628727-4e4a-45d1-b872-8dfaca2f427e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:07.128121 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1000/1994] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:07.136626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e97f15-be4b-49fc-9c4d-0c5613436574 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:07.138970 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-09e97f15-be4b-49fc-9c4d-0c5613436574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:07.216387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e97f15-be4b-49fc-9c4d-0c5613436574 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:07.221086 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176c057-4030-47eb-a3b6-5e7f8ffe1d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:07.222995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176c057-4030-47eb-a3b6-5e7f8ffe1d78 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:07.223379 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176c057-4030-47eb-a3b6-5e7f8ffe1d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:07.224172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176c057-4030-47eb-a3b6-5e7f8ffe1d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:07.235402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176c057-4030-47eb-a3b6-5e7f8ffe1d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:07.237041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176c057-4030-47eb-a3b6-5e7f8ffe1d78 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:07.249036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 995/1995] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:07.303131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e628727-4e4a-45d1-b872-8dfaca2f427e None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:07.306066 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6e628727-4e4a-45d1-b872-8dfaca2f427e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:07.337964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e628727-4e4a-45d1-b872-8dfaca2f427e None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:07.352794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3f6b9-e3ab-41bb-84f9-6a52f56aa313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:07.353572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3f6b9-e3ab-41bb-84f9-6a52f56aa313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:07.353867 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3f6b9-e3ab-41bb-84f9-6a52f56aa313 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:07.354136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e3f6b9-e3ab-41bb-84f9-6a52f56aa313 admin admin] PATH_INFO: `/v3/users/5e70c6c0b87347dd97e137ad8f206922` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:07.355383 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3f6b9-e3ab-41bb-84f9-6a52f56aa313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e70c6c0b87347dd97e137ad8f206922)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:07.358025 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e3f6b9-e3ab-41bb-84f9-6a52f56aa313 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:07.439865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-b1e3f6b9-e3ab-41bb-84f9-6a52f56aa313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e70c6c0b87347dd97e137ad8f206922'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:07.440565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-b1e3f6b9-e3ab-41bb-84f9-6a52f56aa313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e70c6c0b87347dd97e137ad8f206922'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:07.461221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-b1e3f6b9-e3ab-41bb-84f9-6a52f56aa313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e70c6c0b87347dd97e137ad8f206922'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:07.470388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-b1e3f6b9-e3ab-41bb-84f9-6a52f56aa313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e70c6c0b87347dd97e137ad8f206922'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:07.480401 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-b1e3f6b9-e3ab-41bb-84f9-6a52f56aa313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e70c6c0b87347dd97e137ad8f206922'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:07.489992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1001/1996] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:07 2022] DELETE /identity/v3/users/5e70c6c0b87347dd97e137ad8f206922 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:07.495439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea134401-54d5-48c7-a327-dcc45ae260b9 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:07.495754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea134401-54d5-48c7-a327-dcc45ae260b9 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:07.495953 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea134401-54d5-48c7-a327-dcc45ae260b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:07.537766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-ea134401-54d5-48c7-a327-dcc45ae260b9 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:07.539587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ea134401-54d5-48c7-a327-dcc45ae260b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:07.655459 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 996/1997] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:07.665445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3f6b9-e3ab-41bb-84f9-6a52f56aa313 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:07.667027 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-b1e3f6b9-e3ab-41bb-84f9-6a52f56aa313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:07.682087 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e3f6b9-e3ab-41bb-84f9-6a52f56aa313 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:07.687758 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30639222-2b2b-4d31-921c-9379a786a866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:07.688419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30639222-2b2b-4d31-921c-9379a786a866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:07.688851 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30639222-2b2b-4d31-921c-9379a786a866 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:07.689480 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30639222-2b2b-4d31-921c-9379a786a866 admin admin] PATH_INFO: `/v3/projects/d850376da2ff494aa4a404b10be2ac92` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:07.690312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30639222-2b2b-4d31-921c-9379a786a866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d850376da2ff494aa4a404b10be2ac92)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:07.691810 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea134401-54d5-48c7-a327-dcc45ae260b9 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:07.697550 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ea134401-54d5-48c7-a327-dcc45ae260b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:07.716084 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30639222-2b2b-4d31-921c-9379a786a866 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:07.734225 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:07.739491 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:07.806724 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-30639222-2b2b-4d31-921c-9379a786a866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd850376da2ff494aa4a404b10be2ac92', 'request_id': 'req-30639222-2b2b-4d31-921c-9379a786a866'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:07.813963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-30639222-2b2b-4d31-921c-9379a786a866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd850376da2ff494aa4a404b10be2ac92', 'request_id': 'req-30639222-2b2b-4d31-921c-9379a786a866'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:07.826321 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-30639222-2b2b-4d31-921c-9379a786a866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd850376da2ff494aa4a404b10be2ac92', 'request_id': 'req-30639222-2b2b-4d31-921c-9379a786a866'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:07.844817 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-30639222-2b2b-4d31-921c-9379a786a866 admin admin] The token cache is being invalidate because project d850376da2ff494aa4a404b10be2ac92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:07.845125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-30639222-2b2b-4d31-921c-9379a786a866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:07.846355 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-30639222-2b2b-4d31-921c-9379a786a866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:07.847462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea134401-54d5-48c7-a327-dcc45ae260b9 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:07.848050 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1002/1998] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:07 2022] DELETE /identity/v3/projects/d850376da2ff494aa4a404b10be2ac92 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:07.852971 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f9f5b-4338-4c10-979f-64399b55be69 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:07.853267 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f9f5b-4338-4c10-979f-64399b55be69 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:07.853676 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f9f5b-4338-4c10-979f-64399b55be69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:07.877366 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-ca6f9f5b-4338-4c10-979f-64399b55be69 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:07.878832 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ca6f9f5b-4338-4c10-979f-64399b55be69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:07.932250 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098a903-1ae3-4b27-8f6b-148f83aa89e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:07.932966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098a903-1ae3-4b27-8f6b-148f83aa89e4 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:07.933774 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098a903-1ae3-4b27-8f6b-148f83aa89e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:07.934155 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098a903-1ae3-4b27-8f6b-148f83aa89e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:07.936419 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e098a903-1ae3-4b27-8f6b-148f83aa89e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:07.958439 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1003/1999] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:07.959885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e31187-86a2-415e-a372-28d53e670440 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:07.960219 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e31187-86a2-415e-a372-28d53e670440 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:07.960531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e31187-86a2-415e-a372-28d53e670440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:07.981295 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-c2e31187-86a2-415e-a372-28d53e670440 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:07.982731 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-c2e31187-86a2-415e-a372-28d53e670440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:07.999731 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1004/2000] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:08.000630 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e31187-86a2-415e-a372-28d53e670440 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:08.011179 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e31187-86a2-415e-a372-28d53e670440 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:08.015665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763391b-4ae4-459f-bcfc-5234c7981835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:08.016408 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763391b-4ae4-459f-bcfc-5234c7981835 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:08.016696 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763391b-4ae4-459f-bcfc-5234c7981835 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:08.016976 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7763391b-4ae4-459f-bcfc-5234c7981835 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:08.017676 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7763391b-4ae4-459f-bcfc-5234c7981835 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:50:08.017986 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7763391b-4ae4-459f-bcfc-5234c7981835 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:08.019748 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098a903-1ae3-4b27-8f6b-148f83aa89e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:08.019875 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7763391b-4ae4-459f-bcfc-5234c7981835 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:08.021235 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e098a903-1ae3-4b27-8f6b-148f83aa89e4 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:08.031451 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 997/2001] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:50:08.038623 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1005/2002] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:50:08.039931 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098a903-1ae3-4b27-8f6b-148f83aa89e4 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:08.050103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098a903-1ae3-4b27-8f6b-148f83aa89e4 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:08.058276 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b0fff-59a2-493c-9a4a-1109b0e908fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:08.059349 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b0fff-59a2-493c-9a4a-1109b0e908fb admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:08.059793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b0fff-59a2-493c-9a4a-1109b0e908fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:08.060232 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b0fff-59a2-493c-9a4a-1109b0e908fb admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:08.061353 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b0fff-59a2-493c-9a4a-1109b0e908fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:08.065168 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b0fff-59a2-493c-9a4a-1109b0e908fb admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:08.103997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 998/2003] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:08 2022] POST /identity/v3/projects => generated 377 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:08.108354 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763391b-4ae4-459f-bcfc-5234c7981835 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:08.120036 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7763391b-4ae4-459f-bcfc-5234c7981835 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:08.207902 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ed5cc-254a-49c7-8fc0-812feac43c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:08.208509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ed5cc-254a-49c7-8fc0-812feac43c61 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:08.208866 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ed5cc-254a-49c7-8fc0-812feac43c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:08.209451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ed5cc-254a-49c7-8fc0-812feac43c61 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:08.210983 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ed5cc-254a-49c7-8fc0-812feac43c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:08.215400 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5ed5cc-254a-49c7-8fc0-812feac43c61 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:08.252796 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1006/2004] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:08 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:08.256709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b0fff-59a2-493c-9a4a-1109b0e908fb admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:08.269291 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b0fff-59a2-493c-9a4a-1109b0e908fb admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:08.275508 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795902d-9c20-4a97-85c1-cf9c9e54c558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:08.276137 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795902d-9c20-4a97-85c1-cf9c9e54c558 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:08.276419 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795902d-9c20-4a97-85c1-cf9c9e54c558 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:08.276695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c795902d-9c20-4a97-85c1-cf9c9e54c558 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:08.277405 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795902d-9c20-4a97-85c1-cf9c9e54c558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:08.279274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c795902d-9c20-4a97-85c1-cf9c9e54c558 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:08.291672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 999/2005] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:08.295635 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ed5cc-254a-49c7-8fc0-812feac43c61 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:08.306631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5ed5cc-254a-49c7-8fc0-812feac43c61 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:08.311141 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b94f2-dcc2-427e-846f-50353222baff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:08.311769 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b94f2-dcc2-427e-846f-50353222baff admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:08.312056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b94f2-dcc2-427e-846f-50353222baff admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:08.312333 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b94f2-dcc2-427e-846f-50353222baff admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:08.313031 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b94f2-dcc2-427e-846f-50353222baff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:08.314656 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b94f2-dcc2-427e-846f-50353222baff admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:08.317546 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:08.339611 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1007/2006] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:08.343579 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795902d-9c20-4a97-85c1-cf9c9e54c558 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:08.355168 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c795902d-9c20-4a97-85c1-cf9c9e54c558 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:08.360547 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901fe626-7746-451a-9fc5-d3b45f5fe140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:08.361472 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fe626-7746-451a-9fc5-d3b45f5fe140 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:08.361920 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fe626-7746-451a-9fc5-d3b45f5fe140 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:08.362204 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901fe626-7746-451a-9fc5-d3b45f5fe140 admin admin] PATH_INFO: `/v3/projects/9daa2431297c46c98da78c30922e045f/users/aa00abb19f074a38a0e14644cf616302/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:08.394694 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b94f2-dcc2-427e-846f-50353222baff admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:08.399016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fe626-7746-451a-9fc5-d3b45f5fe140 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9daa2431297c46c98da78c30922e045f, user_id=aa00abb19f074a38a0e14644cf616302, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:08.400624 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-c53b94f2-dcc2-427e-846f-50353222baff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:08.406551 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901fe626-7746-451a-9fc5-d3b45f5fe140 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:08.419021 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b94f2-dcc2-427e-846f-50353222baff admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:08.428575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1000/2007] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:08 2022] PUT /identity/v3/projects/9daa2431297c46c98da78c30922e045f/users/aa00abb19f074a38a0e14644cf616302/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:08.440683 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e3bef-0167-4a8d-bfbb-545313fd41a2 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:08.441207 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e3bef-0167-4a8d-bfbb-545313fd41a2 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:08.441557 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e3bef-0167-4a8d-bfbb-545313fd41a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:08.501951 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-878e3bef-0167-4a8d-bfbb-545313fd41a2 None None] MFA Rules not processed for user `aa00abb19f074a38a0e14644cf616302`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:08.501951 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-878e3bef-0167-4a8d-bfbb-545313fd41a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:08.504788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81c1c4-83d6-4842-b22c-ecba3a788ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:08.505477 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81c1c4-83d6-4842-b22c-ecba3a788ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:08.505891 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81c1c4-83d6-4842-b22c-ecba3a788ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:08.506042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81c1c4-83d6-4842-b22c-ecba3a788ee4 admin admin] PATH_INFO: `/v3/projects/efa525dda1674053aa7d927543f18c44` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:08.508699 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81c1c4-83d6-4842-b22c-ecba3a788ee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efa525dda1674053aa7d927543f18c44)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:08.513956 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be81c1c4-83d6-4842-b22c-ecba3a788ee4 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:08.525488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:08.610509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-be81c1c4-83d6-4842-b22c-ecba3a788ee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efa525dda1674053aa7d927543f18c44', 'request_id': 'req-be81c1c4-83d6-4842-b22c-ecba3a788ee4'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:08.617562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-be81c1c4-83d6-4842-b22c-ecba3a788ee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efa525dda1674053aa7d927543f18c44', 'request_id': 'req-be81c1c4-83d6-4842-b22c-ecba3a788ee4'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:08.637827 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-be81c1c4-83d6-4842-b22c-ecba3a788ee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efa525dda1674053aa7d927543f18c44', 'request_id': 'req-be81c1c4-83d6-4842-b22c-ecba3a788ee4'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:08.662024 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1001/2008] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:08.672848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e3bef-0167-4a8d-bfbb-545313fd41a2 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:08.675285 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-878e3bef-0167-4a8d-bfbb-545313fd41a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:08.682222 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-be81c1c4-83d6-4842-b22c-ecba3a788ee4 admin admin] The token cache is being invalidate because project efa525dda1674053aa7d927543f18c44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:08.683403 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-be81c1c4-83d6-4842-b22c-ecba3a788ee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:08.684488 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-be81c1c4-83d6-4842-b22c-ecba3a788ee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:08.693935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1008/2009] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:08 2022] DELETE /identity/v3/projects/efa525dda1674053aa7d927543f18c44 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:08.695759 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81c1c4-83d6-4842-b22c-ecba3a788ee4 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:08.698076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-be81c1c4-83d6-4842-b22c-ecba3a788ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:08.773181 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e3bef-0167-4a8d-bfbb-545313fd41a2 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:08.800582 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be81c1c4-83d6-4842-b22c-ecba3a788ee4 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:08.826197 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0212a19-9b34-48dc-93eb-519726a61cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:08.827050 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0212a19-9b34-48dc-93eb-519726a61cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:08.827245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0212a19-9b34-48dc-93eb-519726a61cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:08.829245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0212a19-9b34-48dc-93eb-519726a61cb8 admin admin] PATH_INFO: `/v3/users/e77d203688234dd3b2d0c2dcd606ec28` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:08.835785 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0212a19-9b34-48dc-93eb-519726a61cb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e77d203688234dd3b2d0c2dcd606ec28)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:08.843420 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0212a19-9b34-48dc-93eb-519726a61cb8 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:08.847377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f6249-d318-4f8f-b6f7-1e880936b8cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:08.848458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f6249-d318-4f8f-b6f7-1e880936b8cc service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:08.848748 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f6249-d318-4f8f-b6f7-1e880936b8cc service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:08.849023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f6249-d318-4f8f-b6f7-1e880936b8cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:08.851151 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-2d6f6249-d318-4f8f-b6f7-1e880936b8cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:08.899600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:08.917826 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f0212a19-9b34-48dc-93eb-519726a61cb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e77d203688234dd3b2d0c2dcd606ec28'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:08.918604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f0212a19-9b34-48dc-93eb-519726a61cb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e77d203688234dd3b2d0c2dcd606ec28'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:08.927582 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f6249-d318-4f8f-b6f7-1e880936b8cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:08.929569 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f6249-d318-4f8f-b6f7-1e880936b8cc service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:08.933607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f0212a19-9b34-48dc-93eb-519726a61cb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e77d203688234dd3b2d0c2dcd606ec28'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:08.938851 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1002/2010] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:08.941242 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f0212a19-9b34-48dc-93eb-519726a61cb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e77d203688234dd3b2d0c2dcd606ec28'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:08.951525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f0212a19-9b34-48dc-93eb-519726a61cb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e77d203688234dd3b2d0c2dcd606ec28'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:08.959768 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1009/2011] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:08 2022] DELETE /identity/v3/users/e77d203688234dd3b2d0c2dcd606ec28 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:09.316421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f6249-d318-4f8f-b6f7-1e880936b8cc service cinder] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:09.338797 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f6249-d318-4f8f-b6f7-1e880936b8cc service cinder] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:09.363767 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:09.442938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02490a-134f-4d01-9196-02382bb82224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:09.443676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02490a-134f-4d01-9196-02382bb82224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:09.443963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02490a-134f-4d01-9196-02382bb82224 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:09.444292 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02490a-134f-4d01-9196-02382bb82224 admin admin] PATH_INFO: `/v3/projects/d1c031e1dd33493d81ab9547ec21c583` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:09.445534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02490a-134f-4d01-9196-02382bb82224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1c031e1dd33493d81ab9547ec21c583)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:09.447566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02490a-134f-4d01-9196-02382bb82224 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:09.547116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-ca02490a-134f-4d01-9196-02382bb82224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1c031e1dd33493d81ab9547ec21c583', 'request_id': 'req-ca02490a-134f-4d01-9196-02382bb82224'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:09.554571 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-ca02490a-134f-4d01-9196-02382bb82224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1c031e1dd33493d81ab9547ec21c583', 'request_id': 'req-ca02490a-134f-4d01-9196-02382bb82224'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:09.561560 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-ca02490a-134f-4d01-9196-02382bb82224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1c031e1dd33493d81ab9547ec21c583', 'request_id': 'req-ca02490a-134f-4d01-9196-02382bb82224'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:09.589549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-ca02490a-134f-4d01-9196-02382bb82224 admin admin] The token cache is being invalidate because project d1c031e1dd33493d81ab9547ec21c583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:09.589842 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-ca02490a-134f-4d01-9196-02382bb82224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:09.590508 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-ca02490a-134f-4d01-9196-02382bb82224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:09.592054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1003/2012] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:09 2022] DELETE /identity/v3/projects/d1c031e1dd33493d81ab9547ec21c583 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:09.597195 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f591122-6284-4e54-8253-22892753810d None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:09.597723 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f591122-6284-4e54-8253-22892753810d None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:09.598097 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f591122-6284-4e54-8253-22892753810d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:09.622073 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-7f591122-6284-4e54-8253-22892753810d None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:09.623338 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-7f591122-6284-4e54-8253-22892753810d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:09.688276 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1010/2013] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:09.696716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da99e1-81cb-4d61-a424-c741475586e1 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:09.697011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da99e1-81cb-4d61-a424-c741475586e1 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:09.697296 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da99e1-81cb-4d61-a424-c741475586e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:09.722231 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-c4da99e1-81cb-4d61-a424-c741475586e1 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:09.723681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c4da99e1-81cb-4d61-a424-c741475586e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:09.746539 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1004/2014] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:09.746643 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f591122-6284-4e54-8253-22892753810d None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:09.755007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f591122-6284-4e54-8253-22892753810d None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:09.760635 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e522ac-77fe-417b-b963-bb875fe0009e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:09.761375 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e522ac-77fe-417b-b963-bb875fe0009e admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:09.761758 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e522ac-77fe-417b-b963-bb875fe0009e admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:09.762097 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e522ac-77fe-417b-b963-bb875fe0009e admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:09.762939 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e522ac-77fe-417b-b963-bb875fe0009e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:50:09.763314 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e522ac-77fe-417b-b963-bb875fe0009e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:09.765003 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e522ac-77fe-417b-b963-bb875fe0009e admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:09.777832 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1011/2015] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:50:09.782272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da99e1-81cb-4d61-a424-c741475586e1 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:09.792446 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da99e1-81cb-4d61-a424-c741475586e1 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:09.797567 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8665bf-55d3-4835-a8b8-b09bed33e7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:09.798195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8665bf-55d3-4835-a8b8-b09bed33e7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:09.798538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8665bf-55d3-4835-a8b8-b09bed33e7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:09.798822 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8665bf-55d3-4835-a8b8-b09bed33e7b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:09.799506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8665bf-55d3-4835-a8b8-b09bed33e7b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:09.801425 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8665bf-55d3-4835-a8b8-b09bed33e7b0 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:09.838539 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1005/2016] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:09 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:09.840556 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e522ac-77fe-417b-b963-bb875fe0009e admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:09.852158 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e522ac-77fe-417b-b963-bb875fe0009e admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:09.939149 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade20dc6-9ae7-4962-b889-8c428e943b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:09.939822 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade20dc6-9ae7-4962-b889-8c428e943b2a admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:09.940054 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade20dc6-9ae7-4962-b889-8c428e943b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:09.940329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade20dc6-9ae7-4962-b889-8c428e943b2a admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:09.940988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade20dc6-9ae7-4962-b889-8c428e943b2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:09.942959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade20dc6-9ae7-4962-b889-8c428e943b2a admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:09.972525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1012/2017] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:09 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:09.973758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8665bf-55d3-4835-a8b8-b09bed33e7b0 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:09.984467 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8665bf-55d3-4835-a8b8-b09bed33e7b0 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:09.989056 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939351c-dac5-44be-8734-42c4935c4a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:09.989694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939351c-dac5-44be-8734-42c4935c4a19 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:09.989957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939351c-dac5-44be-8734-42c4935c4a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:09.990234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a939351c-dac5-44be-8734-42c4935c4a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:09.990967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939351c-dac5-44be-8734-42c4935c4a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:09.992583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a939351c-dac5-44be-8734-42c4935c4a19 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:10.002600 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1006/2018] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:10.006821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade20dc6-9ae7-4962-b889-8c428e943b2a admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:10.022198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade20dc6-9ae7-4962-b889-8c428e943b2a admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:10.027836 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d0233a-5af0-4c8c-813e-a200caf38360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:10.028482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0233a-5af0-4c8c-813e-a200caf38360 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:10.028765 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0233a-5af0-4c8c-813e-a200caf38360 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:10.029067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d0233a-5af0-4c8c-813e-a200caf38360 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:10.029760 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0233a-5af0-4c8c-813e-a200caf38360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:10.031381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d0233a-5af0-4c8c-813e-a200caf38360 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:10.042753 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1013/2019] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:10.046955 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939351c-dac5-44be-8734-42c4935c4a19 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:10.056926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a939351c-dac5-44be-8734-42c4935c4a19 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:10.061580 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb03a5-58bf-4077-8a3c-c983aed1fc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:10.062241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb03a5-58bf-4077-8a3c-c983aed1fc98 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:10.062566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb03a5-58bf-4077-8a3c-c983aed1fc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:10.062897 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eb03a5-58bf-4077-8a3c-c983aed1fc98 admin admin] PATH_INFO: `/v3/projects/032cc2d3fea44ade860219e360d4397c/users/b3fb7d0ea372494abe19bb7d2710acf8/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:10.078078 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb03a5-58bf-4077-8a3c-c983aed1fc98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=032cc2d3fea44ade860219e360d4397c, user_id=b3fb7d0ea372494abe19bb7d2710acf8, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:10.080929 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eb03a5-58bf-4077-8a3c-c983aed1fc98 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:10.094597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1007/2020] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:10 2022] PUT /identity/v3/projects/032cc2d3fea44ade860219e360d4397c/users/b3fb7d0ea372494abe19bb7d2710acf8/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:10.099628 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51f851-1372-4207-9b73-41e437841456 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:10.099916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51f851-1372-4207-9b73-41e437841456 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:10.100193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac51f851-1372-4207-9b73-41e437841456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:10.118964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-ac51f851-1372-4207-9b73-41e437841456 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:10.120145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ac51f851-1372-4207-9b73-41e437841456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:10.128066 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:10.224169 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1014/2021] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:10.270592 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb03a5-58bf-4077-8a3c-c983aed1fc98 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:10.273251 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-28eb03a5-58bf-4077-8a3c-c983aed1fc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:10.357924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:10.377105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eb03a5-58bf-4077-8a3c-c983aed1fc98 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:10.381172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459b6889-5ce8-4357-9d3f-ccc458a010a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:10.382010 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b6889-5ce8-4357-9d3f-ccc458a010a1 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:10.382875 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b6889-5ce8-4357-9d3f-ccc458a010a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:10.383284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459b6889-5ce8-4357-9d3f-ccc458a010a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:10.393724 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b6889-5ce8-4357-9d3f-ccc458a010a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:10.395291 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459b6889-5ce8-4357-9d3f-ccc458a010a1 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:10.405511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1008/2022] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:10.926481 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51f851-1372-4207-9b73-41e437841456 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:10.928793 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ac51f851-1372-4207-9b73-41e437841456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:10.946660 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac51f851-1372-4207-9b73-41e437841456 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:10.954689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73af69-4f6a-4d83-ab44-886d416e0e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:10.956018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73af69-4f6a-4d83-ab44-886d416e0e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:10.956478 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73af69-4f6a-4d83-ab44-886d416e0e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:10.957791 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73af69-4f6a-4d83-ab44-886d416e0e38 admin admin] PATH_INFO: `/v3/users/2fece376fb6b414b91906ff90c531d38` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:10.960840 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73af69-4f6a-4d83-ab44-886d416e0e38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fece376fb6b414b91906ff90c531d38)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:10.963154 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73af69-4f6a-4d83-ab44-886d416e0e38 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:11.022028 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-fc73af69-4f6a-4d83-ab44-886d416e0e38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fece376fb6b414b91906ff90c531d38'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:11.023252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-fc73af69-4f6a-4d83-ab44-886d416e0e38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fece376fb6b414b91906ff90c531d38'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:11.035773 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-fc73af69-4f6a-4d83-ab44-886d416e0e38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fece376fb6b414b91906ff90c531d38'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:11.051723 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-fc73af69-4f6a-4d83-ab44-886d416e0e38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fece376fb6b414b91906ff90c531d38'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:11.064151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-fc73af69-4f6a-4d83-ab44-886d416e0e38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fece376fb6b414b91906ff90c531d38'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:11.073935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1015/2023] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:10 2022] DELETE /identity/v3/users/2fece376fb6b414b91906ff90c531d38 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:11.076037 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ae526-60e7-4ad1-bdfc-79c1d11951cb None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:11.076510 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ae526-60e7-4ad1-bdfc-79c1d11951cb None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:11.076711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ae526-60e7-4ad1-bdfc-79c1d11951cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:11.099500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-d91ae526-60e7-4ad1-bdfc-79c1d11951cb None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:11.101388 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d91ae526-60e7-4ad1-bdfc-79c1d11951cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:11.176223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1009/2024] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:11.188368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73af69-4f6a-4d83-ab44-886d416e0e38 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:11.189818 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-fc73af69-4f6a-4d83-ab44-886d416e0e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:11.264409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73af69-4f6a-4d83-ab44-886d416e0e38 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:11.268148 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34252fc4-578a-4f8c-ba9f-4aae5364eb93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:11.268963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34252fc4-578a-4f8c-ba9f-4aae5364eb93 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:11.269114 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34252fc4-578a-4f8c-ba9f-4aae5364eb93 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:11.269391 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34252fc4-578a-4f8c-ba9f-4aae5364eb93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:11.280784 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34252fc4-578a-4f8c-ba9f-4aae5364eb93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:11.282788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34252fc4-578a-4f8c-ba9f-4aae5364eb93 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:11.294820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1016/2025] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:50:11.675711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de8e73-c51e-4899-b05f-4804145394b7 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:11.676145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de8e73-c51e-4899-b05f-4804145394b7 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:11.676513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de8e73-c51e-4899-b05f-4804145394b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:11.711169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-72de8e73-c51e-4899-b05f-4804145394b7 None None] MFA Rules not processed for user `b3fb7d0ea372494abe19bb7d2710acf8`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:11.712889 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-72de8e73-c51e-4899-b05f-4804145394b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:11.717226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34252fc4-578a-4f8c-ba9f-4aae5364eb93 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:11.719015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-34252fc4-578a-4f8c-ba9f-4aae5364eb93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:11.776693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34252fc4-578a-4f8c-ba9f-4aae5364eb93 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:11.787999 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09f8d6-b7e8-4c36-9473-c82091a16500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:11.788947 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09f8d6-b7e8-4c36-9473-c82091a16500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:11.790773 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09f8d6-b7e8-4c36-9473-c82091a16500 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:11.791235 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09f8d6-b7e8-4c36-9473-c82091a16500 admin admin] PATH_INFO: `/v3/projects/68b903010f4844b28739f1a084604b10` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:11.792526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09f8d6-b7e8-4c36-9473-c82091a16500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68b903010f4844b28739f1a084604b10)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:11.794984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09f8d6-b7e8-4c36-9473-c82091a16500 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:11.833929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:11.878039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1010/2026] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:11.883366 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de8e73-c51e-4899-b05f-4804145394b7 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:11.884952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-72de8e73-c51e-4899-b05f-4804145394b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:11.893843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-6e09f8d6-b7e8-4c36-9473-c82091a16500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68b903010f4844b28739f1a084604b10', 'request_id': 'req-6e09f8d6-b7e8-4c36-9473-c82091a16500'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:11.900440 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de8e73-c51e-4899-b05f-4804145394b7 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:11.908956 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-6e09f8d6-b7e8-4c36-9473-c82091a16500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68b903010f4844b28739f1a084604b10', 'request_id': 'req-6e09f8d6-b7e8-4c36-9473-c82091a16500'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:11.929575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-6e09f8d6-b7e8-4c36-9473-c82091a16500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68b903010f4844b28739f1a084604b10', 'request_id': 'req-6e09f8d6-b7e8-4c36-9473-c82091a16500'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:11.957693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-6e09f8d6-b7e8-4c36-9473-c82091a16500 admin admin] The token cache is being invalidate because project 68b903010f4844b28739f1a084604b10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:11.959020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-6e09f8d6-b7e8-4c36-9473-c82091a16500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:11.960964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-6e09f8d6-b7e8-4c36-9473-c82091a16500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:11.972285 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1017/2027] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:11 2022] DELETE /identity/v3/projects/68b903010f4844b28739f1a084604b10 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:11.974597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09f8d6-b7e8-4c36-9473-c82091a16500 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:11.980669 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6e09f8d6-b7e8-4c36-9473-c82091a16500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:12.024714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48dba83-90b7-4d55-934a-82dc9366f6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:12.027108 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48dba83-90b7-4d55-934a-82dc9366f6db admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:12.027453 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48dba83-90b7-4d55-934a-82dc9366f6db admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:12.027802 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48dba83-90b7-4d55-934a-82dc9366f6db admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:12.028549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48dba83-90b7-4d55-934a-82dc9366f6db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:12.034465 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48dba83-90b7-4d55-934a-82dc9366f6db admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:12.117233 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1011/2028] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:11 2022] POST /identity/v3/projects => generated 371 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:12.131476 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48dba83-90b7-4d55-934a-82dc9366f6db admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:12.139328 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-b48dba83-90b7-4d55-934a-82dc9366f6db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:12.161731 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:12.169360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09f8d6-b7e8-4c36-9473-c82091a16500 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:12.228797 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48dba83-90b7-4d55-934a-82dc9366f6db admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:12.235217 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0565d-19ee-49a9-9804-1883e35c1626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:12.235900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0565d-19ee-49a9-9804-1883e35c1626 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:12.236184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0565d-19ee-49a9-9804-1883e35c1626 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:12.236461 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0565d-19ee-49a9-9804-1883e35c1626 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:12.237125 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0565d-19ee-49a9-9804-1883e35c1626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:12.239077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f0565d-19ee-49a9-9804-1883e35c1626 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:12.258250 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f14f4-f07d-49b3-843b-754bb7d813f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:12.258956 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f14f4-f07d-49b3-843b-754bb7d813f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:12.259283 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f14f4-f07d-49b3-843b-754bb7d813f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:12.259554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f14f4-f07d-49b3-843b-754bb7d813f9 admin admin] PATH_INFO: `/v3/users/4973a2ef4b064729936daa0035f1ac07` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:12.260933 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f14f4-f07d-49b3-843b-754bb7d813f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4973a2ef4b064729936daa0035f1ac07)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:12.263066 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79f14f4-f07d-49b3-843b-754bb7d813f9 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:12.271451 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1012/2029] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:12 2022] POST /identity/v3/users => generated 292 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:12.275907 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0565d-19ee-49a9-9804-1883e35c1626 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:12.286050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0565d-19ee-49a9-9804-1883e35c1626 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:12.293216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74cf92-1874-4f49-9794-094b813d392b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:12.294550 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74cf92-1874-4f49-9794-094b813d392b admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:12.295066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74cf92-1874-4f49-9794-094b813d392b admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:12.295679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74cf92-1874-4f49-9794-094b813d392b admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:12.296524 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74cf92-1874-4f49-9794-094b813d392b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:12.298369 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a74cf92-1874-4f49-9794-094b813d392b admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:12.312490 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1013/2030] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:12.314150 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-b79f14f4-f07d-49b3-843b-754bb7d813f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4973a2ef4b064729936daa0035f1ac07'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:12.314848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-b79f14f4-f07d-49b3-843b-754bb7d813f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4973a2ef4b064729936daa0035f1ac07'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:12.317683 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74cf92-1874-4f49-9794-094b813d392b admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:12.327337 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:12.328911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a74cf92-1874-4f49-9794-094b813d392b admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:12.329812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-b79f14f4-f07d-49b3-843b-754bb7d813f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4973a2ef4b064729936daa0035f1ac07'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:12.334078 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a55b3b-00f6-40fe-ba48-ad3b490a6a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:12.334821 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a55b3b-00f6-40fe-ba48-ad3b490a6a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:12.335719 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a55b3b-00f6-40fe-ba48-ad3b490a6a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:12.336127 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a55b3b-00f6-40fe-ba48-ad3b490a6a47 admin admin] PATH_INFO: `/v3/projects/db9f2230ed8e428e9a0de71a40f0ebd6/users/ab5ea1fce13d4a11b44e7543b65dc26b/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:12.341983 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-b79f14f4-f07d-49b3-843b-754bb7d813f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4973a2ef4b064729936daa0035f1ac07'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:12.350594 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-b79f14f4-f07d-49b3-843b-754bb7d813f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4973a2ef4b064729936daa0035f1ac07'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:12.353387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a55b3b-00f6-40fe-ba48-ad3b490a6a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9f2230ed8e428e9a0de71a40f0ebd6, user_id=ab5ea1fce13d4a11b44e7543b65dc26b, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:12.356917 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a55b3b-00f6-40fe-ba48-ad3b490a6a47 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:12.358013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1018/2031] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:11 2022] DELETE /identity/v3/users/4973a2ef4b064729936daa0035f1ac07 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:12.373739 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1014/2032] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:12 2022] PUT /identity/v3/projects/db9f2230ed8e428e9a0de71a40f0ebd6/users/ab5ea1fce13d4a11b44e7543b65dc26b/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:12.379584 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f14f4-f07d-49b3-843b-754bb7d813f9 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:12.381372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-b79f14f4-f07d-49b3-843b-754bb7d813f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:12.465588 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f14f4-f07d-49b3-843b-754bb7d813f9 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:12.536155 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8e648-b8ad-4f0e-a2aa-15b457c084ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:12.536915 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8e648-b8ad-4f0e-a2aa-15b457c084ef admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:12.537304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8e648-b8ad-4f0e-a2aa-15b457c084ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:12.537755 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8e648-b8ad-4f0e-a2aa-15b457c084ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:12.538733 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8e648-b8ad-4f0e-a2aa-15b457c084ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:12.540488 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b8e648-b8ad-4f0e-a2aa-15b457c084ef admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:12.554544 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1019/2033] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:12 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:12.556879 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a55b3b-00f6-40fe-ba48-ad3b490a6a47 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:12.568112 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a55b3b-00f6-40fe-ba48-ad3b490a6a47 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:12.573279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b46cbbc-e3e6-4874-9a23-6453f6119fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:12.574587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46cbbc-e3e6-4874-9a23-6453f6119fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:12.574806 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46cbbc-e3e6-4874-9a23-6453f6119fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:12.575088 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b46cbbc-e3e6-4874-9a23-6453f6119fd1 admin admin] PATH_INFO: `/v3/projects/db9f2230ed8e428e9a0de71a40f0ebd6/users/ab5ea1fce13d4a11b44e7543b65dc26b/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:12.581299 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46cbbc-e3e6-4874-9a23-6453f6119fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9f2230ed8e428e9a0de71a40f0ebd6, user_id=ab5ea1fce13d4a11b44e7543b65dc26b, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:12.586563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b46cbbc-e3e6-4874-9a23-6453f6119fd1 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:12.604650 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1015/2034] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:12 2022] PUT /identity/v3/projects/db9f2230ed8e428e9a0de71a40f0ebd6/users/ab5ea1fce13d4a11b44e7543b65dc26b/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:12.840334 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8e648-b8ad-4f0e-a2aa-15b457c084ef admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:12.842710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a3b8e648-b8ad-4f0e-a2aa-15b457c084ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:12.883262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b8e648-b8ad-4f0e-a2aa-15b457c084ef admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:12.972976 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454e8bb-0a22-45c7-bc70-020ee0ca1866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:12.973747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454e8bb-0a22-45c7-bc70-020ee0ca1866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:12.974039 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454e8bb-0a22-45c7-bc70-020ee0ca1866 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:12.974318 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454e8bb-0a22-45c7-bc70-020ee0ca1866 admin admin] PATH_INFO: `/v3/projects/659f46577e164ceb97667ac44ad073eb` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:12.976352 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454e8bb-0a22-45c7-bc70-020ee0ca1866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=659f46577e164ceb97667ac44ad073eb)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:12.978423 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454e8bb-0a22-45c7-bc70-020ee0ca1866 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:13.009719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:13.045024 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f454e8bb-0a22-45c7-bc70-020ee0ca1866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '659f46577e164ceb97667ac44ad073eb', 'request_id': 'req-f454e8bb-0a22-45c7-bc70-020ee0ca1866'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:13.052189 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f454e8bb-0a22-45c7-bc70-020ee0ca1866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '659f46577e164ceb97667ac44ad073eb', 'request_id': 'req-f454e8bb-0a22-45c7-bc70-020ee0ca1866'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:13.063514 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f454e8bb-0a22-45c7-bc70-020ee0ca1866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '659f46577e164ceb97667ac44ad073eb', 'request_id': 'req-f454e8bb-0a22-45c7-bc70-020ee0ca1866'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:13.079241 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f454e8bb-0a22-45c7-bc70-020ee0ca1866 admin admin] The token cache is being invalidate because project 659f46577e164ceb97667ac44ad073eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:13.079534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f454e8bb-0a22-45c7-bc70-020ee0ca1866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:13.080338 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f454e8bb-0a22-45c7-bc70-020ee0ca1866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:13.086277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1020/2035] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:12 2022] DELETE /identity/v3/projects/659f46577e164ceb97667ac44ad073eb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:13.088317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90abf2-8264-40a7-b172-9dfbd444f9d5 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:13.088706 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90abf2-8264-40a7-b172-9dfbd444f9d5 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:13.089083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90abf2-8264-40a7-b172-9dfbd444f9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:13.109083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-0a90abf2-8264-40a7-b172-9dfbd444f9d5 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:13.110697 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-0a90abf2-8264-40a7-b172-9dfbd444f9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:13.232527 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1016/2036] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:13.240960 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd12d10-b232-4930-9cef-9485237fb97d None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:13.240960 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd12d10-b232-4930-9cef-9485237fb97d None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:13.241180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd12d10-b232-4930-9cef-9485237fb97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:13.268142 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-7cd12d10-b232-4930-9cef-9485237fb97d None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:13.269776 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-7cd12d10-b232-4930-9cef-9485237fb97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:13.282365 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1021/2037] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:13.289404 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90abf2-8264-40a7-b172-9dfbd444f9d5 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:13.310223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90abf2-8264-40a7-b172-9dfbd444f9d5 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:13.323743 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f1d24-717e-41e3-937d-6341f4b6d43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:13.324402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f1d24-717e-41e3-937d-6341f4b6d43e admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:13.324718 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f1d24-717e-41e3-937d-6341f4b6d43e admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:13.326141 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143f1d24-717e-41e3-937d-6341f4b6d43e admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:13.326916 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f1d24-717e-41e3-937d-6341f4b6d43e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:50:13.327232 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f1d24-717e-41e3-937d-6341f4b6d43e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:13.329465 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143f1d24-717e-41e3-937d-6341f4b6d43e admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:13.346444 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1017/2038] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:50:13.351298 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd12d10-b232-4930-9cef-9485237fb97d None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:13.373045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd12d10-b232-4930-9cef-9485237fb97d None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:13.381109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0e36c-a8f1-47ca-89ba-76e8bf02f587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:13.383010 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0e36c-a8f1-47ca-89ba-76e8bf02f587 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:13.383380 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0e36c-a8f1-47ca-89ba-76e8bf02f587 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:13.383720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0e36c-a8f1-47ca-89ba-76e8bf02f587 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:13.385609 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0e36c-a8f1-47ca-89ba-76e8bf02f587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:13.387891 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0e36c-a8f1-47ca-89ba-76e8bf02f587 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:13.447691 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1022/2039] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:13 2022] POST /identity/v3/projects => generated 367 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:13.451572 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f1d24-717e-41e3-937d-6341f4b6d43e admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:13.462393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143f1d24-717e-41e3-937d-6341f4b6d43e admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:13.501257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:13.530381 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb0623-bdd3-4cf4-b609-87df23ad9d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:13.531166 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb0623-bdd3-4cf4-b609-87df23ad9d95 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:13.531449 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb0623-bdd3-4cf4-b609-87df23ad9d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:13.531730 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bb0623-bdd3-4cf4-b609-87df23ad9d95 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:13.532405 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb0623-bdd3-4cf4-b609-87df23ad9d95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:13.534313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bb0623-bdd3-4cf4-b609-87df23ad9d95 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:13.563123 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1018/2040] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:13 2022] POST /identity/v3/users => generated 284 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:13.567292 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0e36c-a8f1-47ca-89ba-76e8bf02f587 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:13.578201 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0e36c-a8f1-47ca-89ba-76e8bf02f587 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:13.583426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb25ca0-eccc-4937-a608-1bd1d1a24ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:13.584482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb25ca0-eccc-4937-a608-1bd1d1a24ede admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:13.584773 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb25ca0-eccc-4937-a608-1bd1d1a24ede admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:13.585090 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb25ca0-eccc-4937-a608-1bd1d1a24ede admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:13.585796 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb25ca0-eccc-4937-a608-1bd1d1a24ede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:13.587449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb25ca0-eccc-4937-a608-1bd1d1a24ede admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:13.599535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1023/2041] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:13.605159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb0623-bdd3-4cf4-b609-87df23ad9d95 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:13.615800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bb0623-bdd3-4cf4-b609-87df23ad9d95 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:13.622553 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3f0bb-75aa-412a-91a2-1d22ced15977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:13.623261 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3f0bb-75aa-412a-91a2-1d22ced15977 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:13.623595 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3f0bb-75aa-412a-91a2-1d22ced15977 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:13.623834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3f0bb-75aa-412a-91a2-1d22ced15977 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:13.624667 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3f0bb-75aa-412a-91a2-1d22ced15977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:13.626901 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3f0bb-75aa-412a-91a2-1d22ced15977 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:13.640821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0935308-9700-4af6-8f0e-d9a86d4b4142 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:13.641119 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0935308-9700-4af6-8f0e-d9a86d4b4142 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:13.641401 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0935308-9700-4af6-8f0e-d9a86d4b4142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:13.648169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1019/2042] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:13.651193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3f0bb-75aa-412a-91a2-1d22ced15977 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:13.668914 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3f0bb-75aa-412a-91a2-1d22ced15977 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:13.674651 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f431446a-6bbb-4add-80dd-3a0d1096501a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:13.674651 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431446a-6bbb-4add-80dd-3a0d1096501a admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:13.674897 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431446a-6bbb-4add-80dd-3a0d1096501a admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:13.674974 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f431446a-6bbb-4add-80dd-3a0d1096501a admin admin] PATH_INFO: `/v3/projects/39ff19f498e64a5c9542c81140adfb91/users/5a45b9d76ab14f41b32a255428f1a96f/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:13.681210 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-b0935308-9700-4af6-8f0e-d9a86d4b4142 None None] MFA Rules not processed for user `ab5ea1fce13d4a11b44e7543b65dc26b`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:13.682464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-b0935308-9700-4af6-8f0e-d9a86d4b4142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:13.696076 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431446a-6bbb-4add-80dd-3a0d1096501a admin admin] RBAC: Authorizing `identity:create_grant(project_id=39ff19f498e64a5c9542c81140adfb91, user_id=5a45b9d76ab14f41b32a255428f1a96f, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:13.700101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f431446a-6bbb-4add-80dd-3a0d1096501a admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:13.719720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1020/2043] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:13 2022] PUT /identity/v3/projects/39ff19f498e64a5c9542c81140adfb91/users/5a45b9d76ab14f41b32a255428f1a96f/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:13.731533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377ddd2-86b4-4285-bf42-4ad8a31e3efb None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:13.731984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377ddd2-86b4-4285-bf42-4ad8a31e3efb None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:13.732390 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2377ddd2-86b4-4285-bf42-4ad8a31e3efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:13.764845 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-2377ddd2-86b4-4285-bf42-4ad8a31e3efb None None] MFA Rules not processed for user `5a45b9d76ab14f41b32a255428f1a96f`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:13.766200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-2377ddd2-86b4-4285-bf42-4ad8a31e3efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:13.821829 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1024/2044] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:13 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:13.838739 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300fc11-8ff0-4d0b-b324-bdf9383d1c60 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:13.838940 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300fc11-8ff0-4d0b-b324-bdf9383d1c60 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:13.839331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4300fc11-8ff0-4d0b-b324-bdf9383d1c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:13.865591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-4300fc11-8ff0-4d0b-b324-bdf9383d1c60 None None] MFA Rules not processed for user `b3fb7d0ea372494abe19bb7d2710acf8`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:13.867392 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-4300fc11-8ff0-4d0b-b324-bdf9383d1c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:13.878770 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1021/2045] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:13.884022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377ddd2-86b4-4285-bf42-4ad8a31e3efb None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:13.934565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1025/2046] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:13.945367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300fc11-8ff0-4d0b-b324-bdf9383d1c60 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:13.946747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-4300fc11-8ff0-4d0b-b324-bdf9383d1c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:13.951648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:13.956620 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2377ddd2-86b4-4285-bf42-4ad8a31e3efb None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:13.962768 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b640cd-9e47-4f1e-860d-258508408d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:13.963455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b640cd-9e47-4f1e-860d-258508408d97 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:13.963744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b640cd-9e47-4f1e-860d-258508408d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:13.964023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b640cd-9e47-4f1e-860d-258508408d97 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:13.964829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b640cd-9e47-4f1e-860d-258508408d97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:13.966924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b640cd-9e47-4f1e-860d-258508408d97 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:13.994214 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1022/2047] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:13 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:13.998237 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b640cd-9e47-4f1e-860d-258508408d97 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:14.004089 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:14.033526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4300fc11-8ff0-4d0b-b324-bdf9383d1c60 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:14.068855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b640cd-9e47-4f1e-860d-258508408d97 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:14.077359 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0960b87-ff36-4b5e-907f-b5447047f275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:14.078059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0960b87-ff36-4b5e-907f-b5447047f275 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:14.078577 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0960b87-ff36-4b5e-907f-b5447047f275 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:14.078887 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0960b87-ff36-4b5e-907f-b5447047f275 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:14.079568 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0960b87-ff36-4b5e-907f-b5447047f275 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:14.082116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0960b87-ff36-4b5e-907f-b5447047f275 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:14.135055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1023/2048] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:13 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:14.136094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0960b87-ff36-4b5e-907f-b5447047f275 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:14.144286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076775f-6acb-4ce1-8f7a-97fe2950534a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:14.144720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076775f-6acb-4ce1-8f7a-97fe2950534a service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:14.145143 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076775f-6acb-4ce1-8f7a-97fe2950534a service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:14.145476 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076775f-6acb-4ce1-8f7a-97fe2950534a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:14.148240 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e076775f-6acb-4ce1-8f7a-97fe2950534a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:14.150182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0960b87-ff36-4b5e-907f-b5447047f275 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:14.155708 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf464f-b33d-4399-a5b5-e9ddda31cea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:14.156339 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf464f-b33d-4399-a5b5-e9ddda31cea0 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:14.159254 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf464f-b33d-4399-a5b5-e9ddda31cea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:14.159544 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf464f-b33d-4399-a5b5-e9ddda31cea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:14.161632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf464f-b33d-4399-a5b5-e9ddda31cea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:14.163944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf464f-b33d-4399-a5b5-e9ddda31cea0 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:14.179058 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1024/2049] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:14.180174 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf464f-b33d-4399-a5b5-e9ddda31cea0 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:14.195054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf464f-b33d-4399-a5b5-e9ddda31cea0 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:14.200789 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62cdf2-bc7a-4a57-8600-0b15cff665a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:14.201741 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62cdf2-bc7a-4a57-8600-0b15cff665a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:14.202506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62cdf2-bc7a-4a57-8600-0b15cff665a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:14.202506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62cdf2-bc7a-4a57-8600-0b15cff665a4 admin admin] PATH_INFO: `/v3/projects/0979390ee55f4130921db93d01ade13c/users/cc8cc39a57984df0861259801b375fcf/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:14.221581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62cdf2-bc7a-4a57-8600-0b15cff665a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0979390ee55f4130921db93d01ade13c, user_id=cc8cc39a57984df0861259801b375fcf, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:14.224450 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62cdf2-bc7a-4a57-8600-0b15cff665a4 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:14.245552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1025/2050] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:14 2022] PUT /identity/v3/projects/0979390ee55f4130921db93d01ade13c/users/cc8cc39a57984df0861259801b375fcf/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:14.252927 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62cdf2-bc7a-4a57-8600-0b15cff665a4 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:14.254716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076775f-6acb-4ce1-8f7a-97fe2950534a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:14.257645 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e076775f-6acb-4ce1-8f7a-97fe2950534a service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:14.268634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1026/2051] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:14.341793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62cdf2-bc7a-4a57-8600-0b15cff665a4 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:14.346443 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7ee8b0-873c-4c41-ad01-4ab554a5b026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:14.347062 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ee8b0-873c-4c41-ad01-4ab554a5b026 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:14.347348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ee8b0-873c-4c41-ad01-4ab554a5b026 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:14.347628 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7ee8b0-873c-4c41-ad01-4ab554a5b026 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:14.348331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ee8b0-873c-4c41-ad01-4ab554a5b026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:14.349932 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7ee8b0-873c-4c41-ad01-4ab554a5b026 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:14.365330 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1026/2052] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:14 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:14.366745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076775f-6acb-4ce1-8f7a-97fe2950534a service nova] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:14.377146 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076775f-6acb-4ce1-8f7a-97fe2950534a service nova] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:14.381646 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e2ac9-0926-4b6f-af63-773a0cfeeccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:14.382885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e2ac9-0926-4b6f-af63-773a0cfeeccd admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:14.383172 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e2ac9-0926-4b6f-af63-773a0cfeeccd admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:14.383485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e2ac9-0926-4b6f-af63-773a0cfeeccd admin admin] PATH_INFO: `/v3/projects/0979390ee55f4130921db93d01ade13c/users/cc8cc39a57984df0861259801b375fcf/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:14.385462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e2ac9-0926-4b6f-af63-773a0cfeeccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0979390ee55f4130921db93d01ade13c, user_id=cc8cc39a57984df0861259801b375fcf, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:14.388104 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78e2ac9-0926-4b6f-af63-773a0cfeeccd admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:14.399720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1027/2053] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:14 2022] PUT /identity/v3/projects/0979390ee55f4130921db93d01ade13c/users/cc8cc39a57984df0861259801b375fcf/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:14.410873 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed486764-846c-4a6f-843c-f819296ddd0c None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:14.411284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed486764-846c-4a6f-843c-f819296ddd0c None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:14.411610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed486764-846c-4a6f-843c-f819296ddd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:14.439830 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-ed486764-846c-4a6f-843c-f819296ddd0c None None] MFA Rules not processed for user `cc8cc39a57984df0861259801b375fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:14.441146 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ed486764-846c-4a6f-843c-f819296ddd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:14.491340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:14.520230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1027/2054] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:14 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:14.532324 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e2ac9-0926-4b6f-af63-773a0cfeeccd admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:14.534161 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-c78e2ac9-0926-4b6f-af63-773a0cfeeccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:14.561855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:14.603682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e2ac9-0926-4b6f-af63-773a0cfeeccd admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:14.607818 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecebc0-3312-4374-bfe5-d27b671aea49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:14.608645 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecebc0-3312-4374-bfe5-d27b671aea49 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:14.609044 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecebc0-3312-4374-bfe5-d27b671aea49 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:14.609326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ecebc0-3312-4374-bfe5-d27b671aea49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:14.624542 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecebc0-3312-4374-bfe5-d27b671aea49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:14.625967 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ecebc0-3312-4374-bfe5-d27b671aea49 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:14.636328 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1028/2055] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:14 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:14.730859 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed486764-846c-4a6f-843c-f819296ddd0c None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:14.742111 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed486764-846c-4a6f-843c-f819296ddd0c None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:14.747031 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848c8e47-bc80-421b-bf6d-36a2edac4fcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:14.747920 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c8e47-bc80-421b-bf6d-36a2edac4fcb service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:14.748206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c8e47-bc80-421b-bf6d-36a2edac4fcb service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:14.748492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848c8e47-bc80-421b-bf6d-36a2edac4fcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:14.813312 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c8e47-bc80-421b-bf6d-36a2edac4fcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:14.814795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848c8e47-bc80-421b-bf6d-36a2edac4fcb service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:14.832900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1028/2056] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:21.737808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecebc0-3312-4374-bfe5-d27b671aea49 service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:21.803146 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ecebc0-3312-4374-bfe5-d27b671aea49 service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:21.808447 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e0af3-acef-4075-9975-e59f2dc90f1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:21.809102 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e0af3-acef-4075-9975-e59f2dc90f1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:21.809389 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e0af3-acef-4075-9975-e59f2dc90f1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:21.809699 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e0af3-acef-4075-9975-e59f2dc90f1e admin admin] PATH_INFO: `/v3/users/5a45b9d76ab14f41b32a255428f1a96f` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:21.810927 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e0af3-acef-4075-9975-e59f2dc90f1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a45b9d76ab14f41b32a255428f1a96f)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:21.812854 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e0af3-acef-4075-9975-e59f2dc90f1e admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:21.862585 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a70e0af3-acef-4075-9975-e59f2dc90f1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a45b9d76ab14f41b32a255428f1a96f'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:21.863367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a70e0af3-acef-4075-9975-e59f2dc90f1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a45b9d76ab14f41b32a255428f1a96f'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:21.877474 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a70e0af3-acef-4075-9975-e59f2dc90f1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a45b9d76ab14f41b32a255428f1a96f'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:21.884292 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a70e0af3-acef-4075-9975-e59f2dc90f1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a45b9d76ab14f41b32a255428f1a96f'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:21.891984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a70e0af3-acef-4075-9975-e59f2dc90f1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a45b9d76ab14f41b32a255428f1a96f'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:21.898417 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1029/2057] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:21 2022] DELETE /identity/v3/users/5a45b9d76ab14f41b32a255428f1a96f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:21.903050 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72dbfe-5c43-43ac-aeb5-6804d16557cc None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:21.903567 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72dbfe-5c43-43ac-aeb5-6804d16557cc None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:21.903873 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb72dbfe-5c43-43ac-aeb5-6804d16557cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:21.923572 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-eb72dbfe-5c43-43ac-aeb5-6804d16557cc None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:21.924905 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-eb72dbfe-5c43-43ac-aeb5-6804d16557cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:21.988822 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1029/2058] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:21.999435 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e0af3-acef-4075-9975-e59f2dc90f1e admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:22.000878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a70e0af3-acef-4075-9975-e59f2dc90f1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:22.055341 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:22.060975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e0af3-acef-4075-9975-e59f2dc90f1e admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:22.065774 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb850ea4-c939-49f6-9f84-73c1c47811e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:22.066436 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb850ea4-c939-49f6-9f84-73c1c47811e9 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:22.066890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb850ea4-c939-49f6-9f84-73c1c47811e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:22.067179 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb850ea4-c939-49f6-9f84-73c1c47811e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:22.076153 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb850ea4-c939-49f6-9f84-73c1c47811e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:22.077576 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb850ea4-c939-49f6-9f84-73c1c47811e9 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:22.087327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1030/2059] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:22.377736 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72dbfe-5c43-43ac-aeb5-6804d16557cc None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:22.379314 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-eb72dbfe-5c43-43ac-aeb5-6804d16557cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:22.392025 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb72dbfe-5c43-43ac-aeb5-6804d16557cc None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:22.396545 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240d311-51c0-4cb7-978f-bc180aadc30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:22.397190 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240d311-51c0-4cb7-978f-bc180aadc30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:22.397993 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240d311-51c0-4cb7-978f-bc180aadc30a admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:22.398311 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240d311-51c0-4cb7-978f-bc180aadc30a admin admin] PATH_INFO: `/v3/projects/39ff19f498e64a5c9542c81140adfb91` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:22.399595 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240d311-51c0-4cb7-978f-bc180aadc30a admin admin] RBAC: Authorizing `identity:delete_project(project_id=39ff19f498e64a5c9542c81140adfb91)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:22.401974 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240d311-51c0-4cb7-978f-bc180aadc30a admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:22.452906 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4240d311-51c0-4cb7-978f-bc180aadc30a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39ff19f498e64a5c9542c81140adfb91', 'request_id': 'req-4240d311-51c0-4cb7-978f-bc180aadc30a'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:22.459118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4240d311-51c0-4cb7-978f-bc180aadc30a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39ff19f498e64a5c9542c81140adfb91', 'request_id': 'req-4240d311-51c0-4cb7-978f-bc180aadc30a'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:22.465063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4240d311-51c0-4cb7-978f-bc180aadc30a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39ff19f498e64a5c9542c81140adfb91', 'request_id': 'req-4240d311-51c0-4cb7-978f-bc180aadc30a'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:22.477641 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4240d311-51c0-4cb7-978f-bc180aadc30a admin admin] The token cache is being invalidate because project 39ff19f498e64a5c9542c81140adfb91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:22.477933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4240d311-51c0-4cb7-978f-bc180aadc30a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:22.478596 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4240d311-51c0-4cb7-978f-bc180aadc30a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:22.480108 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1030/2060] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:22 2022] DELETE /identity/v3/projects/39ff19f498e64a5c9542c81140adfb91 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:22.484124 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb850ea4-c939-49f6-9f84-73c1c47811e9 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:22.493537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb850ea4-c939-49f6-9f84-73c1c47811e9 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:22.548055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf82ff9-99ba-4361-9415-6507a5e15bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:22.548915 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf82ff9-99ba-4361-9415-6507a5e15bf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:22.549200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf82ff9-99ba-4361-9415-6507a5e15bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:22.549480 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf82ff9-99ba-4361-9415-6507a5e15bf1 admin admin] PATH_INFO: `/v3/users/cc8cc39a57984df0861259801b375fcf` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:22.550741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf82ff9-99ba-4361-9415-6507a5e15bf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc8cc39a57984df0861259801b375fcf)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:22.552662 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf82ff9-99ba-4361-9415-6507a5e15bf1 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:22.600912 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1bf82ff9-99ba-4361-9415-6507a5e15bf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc8cc39a57984df0861259801b375fcf'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:22.601632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1bf82ff9-99ba-4361-9415-6507a5e15bf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc8cc39a57984df0861259801b375fcf'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:22.613837 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1bf82ff9-99ba-4361-9415-6507a5e15bf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc8cc39a57984df0861259801b375fcf'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:22.620784 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1bf82ff9-99ba-4361-9415-6507a5e15bf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc8cc39a57984df0861259801b375fcf'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:22.628384 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1bf82ff9-99ba-4361-9415-6507a5e15bf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc8cc39a57984df0861259801b375fcf'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:22.635037 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1031/2061] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:22 2022] DELETE /identity/v3/users/cc8cc39a57984df0861259801b375fcf => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:23.002383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240d311-51c0-4cb7-978f-bc180aadc30a admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:23.004453 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-4240d311-51c0-4cb7-978f-bc180aadc30a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:23.014973 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:23.021839 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240d311-51c0-4cb7-978f-bc180aadc30a admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:23.124306 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a337ef-ea44-440e-a6c8-9b4192508d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:23.125070 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a337ef-ea44-440e-a6c8-9b4192508d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:23.125420 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a337ef-ea44-440e-a6c8-9b4192508d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:23.125763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a337ef-ea44-440e-a6c8-9b4192508d1e admin admin] PATH_INFO: `/v3/projects/0979390ee55f4130921db93d01ade13c` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:23.127199 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a337ef-ea44-440e-a6c8-9b4192508d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0979390ee55f4130921db93d01ade13c)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:23.129174 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a337ef-ea44-440e-a6c8-9b4192508d1e admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:23.211061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-57a337ef-ea44-440e-a6c8-9b4192508d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0979390ee55f4130921db93d01ade13c', 'request_id': 'req-57a337ef-ea44-440e-a6c8-9b4192508d1e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:23.218372 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-57a337ef-ea44-440e-a6c8-9b4192508d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0979390ee55f4130921db93d01ade13c', 'request_id': 'req-57a337ef-ea44-440e-a6c8-9b4192508d1e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:23.225545 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-57a337ef-ea44-440e-a6c8-9b4192508d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0979390ee55f4130921db93d01ade13c', 'request_id': 'req-57a337ef-ea44-440e-a6c8-9b4192508d1e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:23.244220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-57a337ef-ea44-440e-a6c8-9b4192508d1e admin admin] The token cache is being invalidate because project 0979390ee55f4130921db93d01ade13c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:23.244535 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-57a337ef-ea44-440e-a6c8-9b4192508d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:23.245225 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-57a337ef-ea44-440e-a6c8-9b4192508d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:23.247369 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1031/2062] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:23 2022] DELETE /identity/v3/projects/0979390ee55f4130921db93d01ade13c => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:23.251759 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cd49b-51b4-417b-8d84-31bd055d7a6d None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:23.252224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cd49b-51b4-417b-8d84-31bd055d7a6d None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:23.252593 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05cd49b-51b4-417b-8d84-31bd055d7a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:23.278401 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-e05cd49b-51b4-417b-8d84-31bd055d7a6d None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:23.279921 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e05cd49b-51b4-417b-8d84-31bd055d7a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:23.348946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1032/2063] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:23.357511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004745fa-c10c-43d9-9c01-5df618525492 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:23.357804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004745fa-c10c-43d9-9c01-5df618525492 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:23.358082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004745fa-c10c-43d9-9c01-5df618525492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:23.379128 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-004745fa-c10c-43d9-9c01-5df618525492 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:23.380342 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-004745fa-c10c-43d9-9c01-5df618525492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:23.388285 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1032/2064] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:23.392505 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cd49b-51b4-417b-8d84-31bd055d7a6d None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:23.402168 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05cd49b-51b4-417b-8d84-31bd055d7a6d None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:23.407806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d41345-6440-4199-a616-bfcdf9cc5780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:23.408759 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d41345-6440-4199-a616-bfcdf9cc5780 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:23.409083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d41345-6440-4199-a616-bfcdf9cc5780 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:23.409561 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d41345-6440-4199-a616-bfcdf9cc5780 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:23.410831 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d41345-6440-4199-a616-bfcdf9cc5780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:50:23.411190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d41345-6440-4199-a616-bfcdf9cc5780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:23.413827 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d41345-6440-4199-a616-bfcdf9cc5780 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:23.417128 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:23.428319 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1033/2065] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:50:23.433297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004745fa-c10c-43d9-9c01-5df618525492 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:23.447163 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004745fa-c10c-43d9-9c01-5df618525492 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:23.464763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3163c-51c1-4dc1-9169-12fbee56472d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:23.465415 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3163c-51c1-4dc1-9169-12fbee56472d admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:23.465867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3163c-51c1-4dc1-9169-12fbee56472d admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:23.466273 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3163c-51c1-4dc1-9169-12fbee56472d admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:23.467085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3163c-51c1-4dc1-9169-12fbee56472d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:23.469003 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3163c-51c1-4dc1-9169-12fbee56472d admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:23.501012 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1033/2066] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:23 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:23.503344 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d41345-6440-4199-a616-bfcdf9cc5780 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:23.513618 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d41345-6440-4199-a616-bfcdf9cc5780 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:23.569729 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2b40f-f1e6-408c-a810-70b2ef9211a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:23.570359 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2b40f-f1e6-408c-a810-70b2ef9211a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:23.570652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2b40f-f1e6-408c-a810-70b2ef9211a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:23.570930 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2b40f-f1e6-408c-a810-70b2ef9211a7 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:23.571594 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2b40f-f1e6-408c-a810-70b2ef9211a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:23.573549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2b40f-f1e6-408c-a810-70b2ef9211a7 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:23.596803 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1034/2067] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:23 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:23.601544 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3163c-51c1-4dc1-9169-12fbee56472d admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:23.611890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3163c-51c1-4dc1-9169-12fbee56472d admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:23.617125 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7ad14-1486-48bc-a214-d68558137c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:23.617711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7ad14-1486-48bc-a214-d68558137c03 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:23.617989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7ad14-1486-48bc-a214-d68558137c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:23.618257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7ad14-1486-48bc-a214-d68558137c03 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:23.619010 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7ad14-1486-48bc-a214-d68558137c03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:23.620589 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7ad14-1486-48bc-a214-d68558137c03 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:23.630278 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1034/2068] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:23.634151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2b40f-f1e6-408c-a810-70b2ef9211a7 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:23.644081 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2b40f-f1e6-408c-a810-70b2ef9211a7 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:23.649530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893e16c-da23-4b1c-9b29-7837a3d53c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:23.650324 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893e16c-da23-4b1c-9b29-7837a3d53c9a admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:23.650637 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893e16c-da23-4b1c-9b29-7837a3d53c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:23.650915 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893e16c-da23-4b1c-9b29-7837a3d53c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:23.651608 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893e16c-da23-4b1c-9b29-7837a3d53c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:23.653191 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4893e16c-da23-4b1c-9b29-7837a3d53c9a admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:23.664605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1035/2069] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:23.668442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7ad14-1486-48bc-a214-d68558137c03 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:23.678746 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7ad14-1486-48bc-a214-d68558137c03 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:23.683702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffe8a1-8ddd-41bb-8453-8a8a64db6bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:23.684382 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffe8a1-8ddd-41bb-8453-8a8a64db6bae admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:23.684672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffe8a1-8ddd-41bb-8453-8a8a64db6bae admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:23.684950 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ffe8a1-8ddd-41bb-8453-8a8a64db6bae admin admin] PATH_INFO: `/v3/projects/359c2fbe4bc24b99b16ac6632810b873/users/50159e28b53e47ffa934c6d9d354ff28/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:23.699047 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffe8a1-8ddd-41bb-8453-8a8a64db6bae admin admin] RBAC: Authorizing `identity:create_grant(project_id=359c2fbe4bc24b99b16ac6632810b873, user_id=50159e28b53e47ffa934c6d9d354ff28, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:23.701683 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ffe8a1-8ddd-41bb-8453-8a8a64db6bae admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:23.715525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1035/2070] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:23 2022] PUT /identity/v3/projects/359c2fbe4bc24b99b16ac6632810b873/users/50159e28b53e47ffa934c6d9d354ff28/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:23.727178 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4457ae3-24e2-4d73-b71c-d3b841a26c36 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:23.727471 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4457ae3-24e2-4d73-b71c-d3b841a26c36 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:23.727750 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4457ae3-24e2-4d73-b71c-d3b841a26c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:23.755022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-a4457ae3-24e2-4d73-b71c-d3b841a26c36 None None] MFA Rules not processed for user `50159e28b53e47ffa934c6d9d354ff28`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:23.756238 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a4457ae3-24e2-4d73-b71c-d3b841a26c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:23.825141 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1036/2071] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:23.829500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffe8a1-8ddd-41bb-8453-8a8a64db6bae admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:23.866144 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:23.899406 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ffe8a1-8ddd-41bb-8453-8a8a64db6bae admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:23.904115 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640a547-ecbf-419e-967e-65066fa21469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:23.904742 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640a547-ecbf-419e-967e-65066fa21469 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:23.905026 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640a547-ecbf-419e-967e-65066fa21469 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:23.905305 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640a547-ecbf-419e-967e-65066fa21469 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:23.905984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640a547-ecbf-419e-967e-65066fa21469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:23.907995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640a547-ecbf-419e-967e-65066fa21469 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:23.937668 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1036/2072] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:23 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:23.941726 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4457ae3-24e2-4d73-b71c-d3b841a26c36 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:23.953565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4457ae3-24e2-4d73-b71c-d3b841a26c36 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:24.021641 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe52a52-21b3-41c8-8156-f18452f15629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:24.022910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe52a52-21b3-41c8-8156-f18452f15629 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:24.023134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe52a52-21b3-41c8-8156-f18452f15629 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:24.023413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe52a52-21b3-41c8-8156-f18452f15629 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:24.024082 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe52a52-21b3-41c8-8156-f18452f15629 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:24.026112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe52a52-21b3-41c8-8156-f18452f15629 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:24.038446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:24.053994 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1037/2073] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:23 2022] POST /identity/v3/users => generated 300 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:24.057990 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640a547-ecbf-419e-967e-65066fa21469 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:24.068527 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640a547-ecbf-419e-967e-65066fa21469 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:24.073772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd56c0f-1f65-4f1d-ab27-d30cc805ccea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:24.074477 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd56c0f-1f65-4f1d-ab27-d30cc805ccea admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:24.074701 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd56c0f-1f65-4f1d-ab27-d30cc805ccea admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:24.074986 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd56c0f-1f65-4f1d-ab27-d30cc805ccea admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:24.075716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd56c0f-1f65-4f1d-ab27-d30cc805ccea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:24.077365 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd56c0f-1f65-4f1d-ab27-d30cc805ccea admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:24.091548 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1037/2074] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:24.095329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe52a52-21b3-41c8-8156-f18452f15629 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:24.111465 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe52a52-21b3-41c8-8156-f18452f15629 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:24.116705 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10417721-b39e-4feb-9afb-c53da33ec493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:24.117715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10417721-b39e-4feb-9afb-c53da33ec493 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:24.118097 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10417721-b39e-4feb-9afb-c53da33ec493 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:24.118511 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10417721-b39e-4feb-9afb-c53da33ec493 admin admin] PATH_INFO: `/v3/projects/d35aaae996d74bb3b469d5dc81020df0/users/bf7753d79c2a4e4cbd6ea5637ccb829e/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:24.139202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10417721-b39e-4feb-9afb-c53da33ec493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35aaae996d74bb3b469d5dc81020df0, user_id=bf7753d79c2a4e4cbd6ea5637ccb829e, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:24.142233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10417721-b39e-4feb-9afb-c53da33ec493 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:24.159261 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1038/2075] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:24 2022] PUT /identity/v3/projects/d35aaae996d74bb3b469d5dc81020df0/users/bf7753d79c2a4e4cbd6ea5637ccb829e/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:24.163829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd56c0f-1f65-4f1d-ab27-d30cc805ccea admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:24.174949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd56c0f-1f65-4f1d-ab27-d30cc805ccea admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:24.254177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557ef95c-f6fc-4be5-a20e-a8acf49fb44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:24.254895 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ef95c-f6fc-4be5-a20e-a8acf49fb44f admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:24.255182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ef95c-f6fc-4be5-a20e-a8acf49fb44f admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:24.255516 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557ef95c-f6fc-4be5-a20e-a8acf49fb44f admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:24.256241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ef95c-f6fc-4be5-a20e-a8acf49fb44f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:24.258589 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557ef95c-f6fc-4be5-a20e-a8acf49fb44f admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:24.274700 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1038/2076] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:24.275446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10417721-b39e-4feb-9afb-c53da33ec493 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:24.288934 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10417721-b39e-4feb-9afb-c53da33ec493 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:24.295298 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e9dc2-572a-483c-b94c-04df30ae56f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:24.296303 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e9dc2-572a-483c-b94c-04df30ae56f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:24.296722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e9dc2-572a-483c-b94c-04df30ae56f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:24.297655 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e9dc2-572a-483c-b94c-04df30ae56f5 admin admin] PATH_INFO: `/v3/projects/d35aaae996d74bb3b469d5dc81020df0/users/bf7753d79c2a4e4cbd6ea5637ccb829e/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:24.300920 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e9dc2-572a-483c-b94c-04df30ae56f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35aaae996d74bb3b469d5dc81020df0, user_id=bf7753d79c2a4e4cbd6ea5637ccb829e, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:24.305397 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e9dc2-572a-483c-b94c-04df30ae56f5 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:24.327410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1039/2077] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:24 2022] PUT /identity/v3/projects/d35aaae996d74bb3b469d5dc81020df0/users/bf7753d79c2a4e4cbd6ea5637ccb829e/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:24.330089 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c1a9a-20de-4718-b2c3-23352026f528 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:24.330660 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c1a9a-20de-4718-b2c3-23352026f528 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:24.330949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c1a9a-20de-4718-b2c3-23352026f528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:24.393379 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-c02c1a9a-20de-4718-b2c3-23352026f528 None None] MFA Rules not processed for user `bf7753d79c2a4e4cbd6ea5637ccb829e`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:24.398162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c02c1a9a-20de-4718-b2c3-23352026f528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:24.528012 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1039/2078] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:24.540417 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e9dc2-572a-483c-b94c-04df30ae56f5 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:24.545252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-538e9dc2-572a-483c-b94c-04df30ae56f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:24.651140 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e9dc2-572a-483c-b94c-04df30ae56f5 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:24.656029 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199edc37-9b5e-47c8-ac31-0b882e1b9734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:24.656666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199edc37-9b5e-47c8-ac31-0b882e1b9734 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:24.656982 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199edc37-9b5e-47c8-ac31-0b882e1b9734 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:24.657269 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199edc37-9b5e-47c8-ac31-0b882e1b9734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:24.671159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199edc37-9b5e-47c8-ac31-0b882e1b9734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:24.673203 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199edc37-9b5e-47c8-ac31-0b882e1b9734 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:24.685021 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1040/2079] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:50:25.376209 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c1a9a-20de-4718-b2c3-23352026f528 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:25.404140 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:25.445231 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c1a9a-20de-4718-b2c3-23352026f528 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:25.450037 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683bec7-f668-4e9b-9924-29c72b925d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:25.450743 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683bec7-f668-4e9b-9924-29c72b925d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:25.451025 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683bec7-f668-4e9b-9924-29c72b925d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:25.451667 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683bec7-f668-4e9b-9924-29c72b925d11 admin admin] PATH_INFO: `/v3/users/50159e28b53e47ffa934c6d9d354ff28` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:25.452470 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683bec7-f668-4e9b-9924-29c72b925d11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50159e28b53e47ffa934c6d9d354ff28)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:25.454601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683bec7-f668-4e9b-9924-29c72b925d11 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:25.513068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-8683bec7-f668-4e9b-9924-29c72b925d11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50159e28b53e47ffa934c6d9d354ff28'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:25.513644 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-8683bec7-f668-4e9b-9924-29c72b925d11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50159e28b53e47ffa934c6d9d354ff28'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:25.525547 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-8683bec7-f668-4e9b-9924-29c72b925d11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50159e28b53e47ffa934c6d9d354ff28'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:25.540870 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-8683bec7-f668-4e9b-9924-29c72b925d11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50159e28b53e47ffa934c6d9d354ff28'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:25.541714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-8683bec7-f668-4e9b-9924-29c72b925d11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50159e28b53e47ffa934c6d9d354ff28'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:25.558808 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1040/2080] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:25 2022] DELETE /identity/v3/users/50159e28b53e47ffa934c6d9d354ff28 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:25.563150 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead73c0b-0845-4403-bfe6-b9d942e0198c None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:25.564057 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead73c0b-0845-4403-bfe6-b9d942e0198c None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:25.564534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead73c0b-0845-4403-bfe6-b9d942e0198c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:25.601563 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-ead73c0b-0845-4403-bfe6-b9d942e0198c None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:25.603854 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ead73c0b-0845-4403-bfe6-b9d942e0198c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:25.692548 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1041/2081] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:25.701647 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683bec7-f668-4e9b-9924-29c72b925d11 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:25.703146 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8683bec7-f668-4e9b-9924-29c72b925d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:25.763521 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683bec7-f668-4e9b-9924-29c72b925d11 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:25.767128 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b8b7d-2c69-475a-ae21-10eed6e05cb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:25.767745 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b8b7d-2c69-475a-ae21-10eed6e05cb0 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:25.768641 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b8b7d-2c69-475a-ae21-10eed6e05cb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:25.768926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b8b7d-2c69-475a-ae21-10eed6e05cb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:25.778081 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b8b7d-2c69-475a-ae21-10eed6e05cb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:25.779553 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b8b7d-2c69-475a-ae21-10eed6e05cb0 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:25.790119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1041/2082] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:26.059116 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead73c0b-0845-4403-bfe6-b9d942e0198c None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:26.060559 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ead73c0b-0845-4403-bfe6-b9d942e0198c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:26.074269 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead73c0b-0845-4403-bfe6-b9d942e0198c None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:26.078996 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb7196-06d0-41b4-9880-af18dd7e7098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:26.079648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb7196-06d0-41b4-9880-af18dd7e7098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:26.079931 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb7196-06d0-41b4-9880-af18dd7e7098 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:26.080350 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb7196-06d0-41b4-9880-af18dd7e7098 admin admin] PATH_INFO: `/v3/projects/359c2fbe4bc24b99b16ac6632810b873` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:26.081508 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb7196-06d0-41b4-9880-af18dd7e7098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=359c2fbe4bc24b99b16ac6632810b873)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:26.083737 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb7196-06d0-41b4-9880-af18dd7e7098 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:26.133160 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-09bb7196-06d0-41b4-9880-af18dd7e7098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '359c2fbe4bc24b99b16ac6632810b873', 'request_id': 'req-09bb7196-06d0-41b4-9880-af18dd7e7098'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:26.137326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:26.140093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-09bb7196-06d0-41b4-9880-af18dd7e7098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '359c2fbe4bc24b99b16ac6632810b873', 'request_id': 'req-09bb7196-06d0-41b4-9880-af18dd7e7098'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:26.149491 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-09bb7196-06d0-41b4-9880-af18dd7e7098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '359c2fbe4bc24b99b16ac6632810b873', 'request_id': 'req-09bb7196-06d0-41b4-9880-af18dd7e7098'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:26.161861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-09bb7196-06d0-41b4-9880-af18dd7e7098 admin admin] The token cache is being invalidate because project 359c2fbe4bc24b99b16ac6632810b873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:26.162152 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-09bb7196-06d0-41b4-9880-af18dd7e7098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:26.163376 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-09bb7196-06d0-41b4-9880-af18dd7e7098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:26.165121 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1042/2083] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:26 2022] DELETE /identity/v3/projects/359c2fbe4bc24b99b16ac6632810b873 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:26.169052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b8b7d-2c69-475a-ae21-10eed6e05cb0 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:26.179152 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b8b7d-2c69-475a-ae21-10eed6e05cb0 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:26.223084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:26.237821 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545279a6-3a04-4ef8-a783-9512a479422a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:26.238430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545279a6-3a04-4ef8-a783-9512a479422a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:26.238719 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545279a6-3a04-4ef8-a783-9512a479422a admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:26.238997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545279a6-3a04-4ef8-a783-9512a479422a admin admin] PATH_INFO: `/v3/users/bf7753d79c2a4e4cbd6ea5637ccb829e` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:26.240202 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545279a6-3a04-4ef8-a783-9512a479422a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf7753d79c2a4e4cbd6ea5637ccb829e)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:26.242135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545279a6-3a04-4ef8-a783-9512a479422a admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:26.287297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-545279a6-3a04-4ef8-a783-9512a479422a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf7753d79c2a4e4cbd6ea5637ccb829e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:26.289726 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-545279a6-3a04-4ef8-a783-9512a479422a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf7753d79c2a4e4cbd6ea5637ccb829e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:26.296880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-545279a6-3a04-4ef8-a783-9512a479422a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf7753d79c2a4e4cbd6ea5637ccb829e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:26.308770 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-545279a6-3a04-4ef8-a783-9512a479422a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf7753d79c2a4e4cbd6ea5637ccb829e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:26.309407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-545279a6-3a04-4ef8-a783-9512a479422a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf7753d79c2a4e4cbd6ea5637ccb829e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:26.322619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1042/2084] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:26 2022] DELETE /identity/v3/users/bf7753d79c2a4e4cbd6ea5637ccb829e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:26.587963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb7196-06d0-41b4-9880-af18dd7e7098 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:26.589375 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-09bb7196-06d0-41b4-9880-af18dd7e7098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:26.602253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb7196-06d0-41b4-9880-af18dd7e7098 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:26.664296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8dc78-e36d-444f-b606-2741a259d8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:26.664955 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8dc78-e36d-444f-b606-2741a259d8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:26.665246 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8dc78-e36d-444f-b606-2741a259d8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:26.665529 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e8dc78-e36d-444f-b606-2741a259d8c2 admin admin] PATH_INFO: `/v3/projects/d35aaae996d74bb3b469d5dc81020df0` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:26.666762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8dc78-e36d-444f-b606-2741a259d8c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d35aaae996d74bb3b469d5dc81020df0)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:26.668665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e8dc78-e36d-444f-b606-2741a259d8c2 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:26.724300 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-92e8dc78-e36d-444f-b606-2741a259d8c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd35aaae996d74bb3b469d5dc81020df0', 'request_id': 'req-92e8dc78-e36d-444f-b606-2741a259d8c2'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:26.730971 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-92e8dc78-e36d-444f-b606-2741a259d8c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd35aaae996d74bb3b469d5dc81020df0', 'request_id': 'req-92e8dc78-e36d-444f-b606-2741a259d8c2'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:26.743215 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-92e8dc78-e36d-444f-b606-2741a259d8c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd35aaae996d74bb3b469d5dc81020df0', 'request_id': 'req-92e8dc78-e36d-444f-b606-2741a259d8c2'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:26.756436 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-92e8dc78-e36d-444f-b606-2741a259d8c2 admin admin] The token cache is being invalidate because project d35aaae996d74bb3b469d5dc81020df0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:26.756793 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-92e8dc78-e36d-444f-b606-2741a259d8c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:26.757461 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-92e8dc78-e36d-444f-b606-2741a259d8c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:26.759603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1043/2085] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:26 2022] DELETE /identity/v3/projects/d35aaae996d74bb3b469d5dc81020df0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:26.764306 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253ebc5-0830-4767-876b-504052d18e03 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:26.764749 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253ebc5-0830-4767-876b-504052d18e03 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:26.765203 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253ebc5-0830-4767-876b-504052d18e03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:26.785491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-8253ebc5-0830-4767-876b-504052d18e03 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:26.786558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8253ebc5-0830-4767-876b-504052d18e03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:26.848666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8dc78-e36d-444f-b606-2741a259d8c2 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:26.850055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-92e8dc78-e36d-444f-b606-2741a259d8c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:26.855785 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1043/2086] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:26.863790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f1f11-f021-4cd8-9354-b27335da3078 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:26.863935 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f1f11-f021-4cd8-9354-b27335da3078 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:26.864221 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f1f11-f021-4cd8-9354-b27335da3078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:26.870025 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e8dc78-e36d-444f-b606-2741a259d8c2 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:26.876712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b5b4d-6981-4afa-8958-21d8c3f9e292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:26.877461 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b5b4d-6981-4afa-8958-21d8c3f9e292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:26.877749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b5b4d-6981-4afa-8958-21d8c3f9e292 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:26.878485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b5b4d-6981-4afa-8958-21d8c3f9e292 admin admin] PATH_INFO: `/v3/users/aa00abb19f074a38a0e14644cf616302` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:26.879720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b5b4d-6981-4afa-8958-21d8c3f9e292 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa00abb19f074a38a0e14644cf616302)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:26.882201 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b5b4d-6981-4afa-8958-21d8c3f9e292 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:26.884493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-634f1f11-f021-4cd8-9354-b27335da3078 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:26.885692 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-634f1f11-f021-4cd8-9354-b27335da3078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:26.896188 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1044/2087] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:26.900502 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f1f11-f021-4cd8-9354-b27335da3078 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:26.913634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634f1f11-f021-4cd8-9354-b27335da3078 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:26.918918 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c3ac9-a86d-4a4f-ba43-d697373c0dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:26.919651 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c3ac9-a86d-4a4f-ba43-d697373c0dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:26.920046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c3ac9-a86d-4a4f-ba43-d697373c0dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:26.920288 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c3ac9-a86d-4a4f-ba43-d697373c0dc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:26.921195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c3ac9-a86d-4a4f-ba43-d697373c0dc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:50:26.921568 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c3ac9-a86d-4a4f-ba43-d697373c0dc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:26.923526 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92c3ac9-a86d-4a4f-ba43-d697373c0dc0 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:26.949077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1045/2088] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:50:26.949077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c3ac9-a86d-4a4f-ba43-d697373c0dc0 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:26.960402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-fb6b5b4d-6981-4afa-8958-21d8c3f9e292 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa00abb19f074a38a0e14644cf616302'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:26.962262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-fb6b5b4d-6981-4afa-8958-21d8c3f9e292 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa00abb19f074a38a0e14644cf616302'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:26.963709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92c3ac9-a86d-4a4f-ba43-d697373c0dc0 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:26.972559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50e053-9553-4833-a0ca-b2e80bbb8cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:26.973428 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50e053-9553-4833-a0ca-b2e80bbb8cef admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:26.974176 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50e053-9553-4833-a0ca-b2e80bbb8cef admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:26.974495 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50e053-9553-4833-a0ca-b2e80bbb8cef admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:26.975384 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50e053-9553-4833-a0ca-b2e80bbb8cef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:26.977939 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50e053-9553-4833-a0ca-b2e80bbb8cef admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:26.979543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-fb6b5b4d-6981-4afa-8958-21d8c3f9e292 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa00abb19f074a38a0e14644cf616302'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:26.982294 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:26.990550 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-fb6b5b4d-6981-4afa-8958-21d8c3f9e292 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa00abb19f074a38a0e14644cf616302'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:27.001256 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-fb6b5b4d-6981-4afa-8958-21d8c3f9e292 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa00abb19f074a38a0e14644cf616302'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:27.009292 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1044/2089] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:26 2022] DELETE /identity/v3/users/aa00abb19f074a38a0e14644cf616302 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:27.014329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1046/2090] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:26 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:27.015225 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50e053-9553-4833-a0ca-b2e80bbb8cef admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:27.015582 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806b07b-2175-4b7c-8bba-74ebe77c5ae9 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:27.015871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806b07b-2175-4b7c-8bba-74ebe77c5ae9 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:27.016149 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806b07b-2175-4b7c-8bba-74ebe77c5ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:27.017164 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-6d50e053-9553-4833-a0ca-b2e80bbb8cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:27.034442 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-4806b07b-2175-4b7c-8bba-74ebe77c5ae9 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:27.035625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-4806b07b-2175-4b7c-8bba-74ebe77c5ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:27.046624 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:27.087105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50e053-9553-4833-a0ca-b2e80bbb8cef admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:27.091898 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470341d-dace-48d6-b17a-389ab0cd2381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:27.092521 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470341d-dace-48d6-b17a-389ab0cd2381 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:27.092812 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470341d-dace-48d6-b17a-389ab0cd2381 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:27.093094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1470341d-dace-48d6-b17a-389ab0cd2381 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:27.093807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470341d-dace-48d6-b17a-389ab0cd2381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:27.095808 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1470341d-dace-48d6-b17a-389ab0cd2381 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:27.096815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1045/2091] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:27.107263 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806b07b-2175-4b7c-8bba-74ebe77c5ae9 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:27.108646 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-4806b07b-2175-4b7c-8bba-74ebe77c5ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:27.120395 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1047/2092] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:27 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:27.124509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470341d-dace-48d6-b17a-389ab0cd2381 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:27.134563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1470341d-dace-48d6-b17a-389ab0cd2381 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:27.139210 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f034f5-cf47-4c81-97e7-bcefddd70ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:27.139818 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f034f5-cf47-4c81-97e7-bcefddd70ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:27.140105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f034f5-cf47-4c81-97e7-bcefddd70ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:27.140382 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f034f5-cf47-4c81-97e7-bcefddd70ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:27.141073 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f034f5-cf47-4c81-97e7-bcefddd70ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:27.142708 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f034f5-cf47-4c81-97e7-bcefddd70ae1 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:27.155894 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1048/2093] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:27.156980 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f034f5-cf47-4c81-97e7-bcefddd70ae1 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:27.167912 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f034f5-cf47-4c81-97e7-bcefddd70ae1 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:27.172563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5d4fc-ab61-42c2-94f9-679fb2f112b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:27.173199 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5d4fc-ab61-42c2-94f9-679fb2f112b2 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:27.173485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5d4fc-ab61-42c2-94f9-679fb2f112b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:27.173580 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806b07b-2175-4b7c-8bba-74ebe77c5ae9 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:27.173760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5d4fc-ab61-42c2-94f9-679fb2f112b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:27.174471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5d4fc-ab61-42c2-94f9-679fb2f112b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:27.176073 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5d4fc-ab61-42c2-94f9-679fb2f112b2 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:27.177236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e2a5e8-8ef9-43ca-883f-c00339eb6a0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:27.177749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2a5e8-8ef9-43ca-883f-c00339eb6a0d service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:27.178035 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2a5e8-8ef9-43ca-883f-c00339eb6a0d service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:27.178315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e2a5e8-8ef9-43ca-883f-c00339eb6a0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:27.187128 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1049/2094] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:27.191068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2a5e8-8ef9-43ca-883f-c00339eb6a0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:27.191222 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5d4fc-ab61-42c2-94f9-679fb2f112b2 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:27.192615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e2a5e8-8ef9-43ca-883f-c00339eb6a0d service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:27.201301 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5d4fc-ab61-42c2-94f9-679fb2f112b2 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:27.203132 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1046/2095] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:50:27.208215 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5de756-9c00-4784-bc54-87a82f1633cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:27.208906 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5de756-9c00-4784-bc54-87a82f1633cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:27.209227 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5de756-9c00-4784-bc54-87a82f1633cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:27.209529 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5de756-9c00-4784-bc54-87a82f1633cb admin admin] PATH_INFO: `/v3/projects/bb2974da9dc4490493fe281c2bc3cb50/users/1d834466d42f47b1a3bffda50281999b/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:27.230157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5de756-9c00-4784-bc54-87a82f1633cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb2974da9dc4490493fe281c2bc3cb50, user_id=1d834466d42f47b1a3bffda50281999b, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:27.232919 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5de756-9c00-4784-bc54-87a82f1633cb admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:27.251981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1050/2096] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:27 2022] PUT /identity/v3/projects/bb2974da9dc4490493fe281c2bc3cb50/users/1d834466d42f47b1a3bffda50281999b/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:27.267801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba5754-969a-4c00-8325-86568131fab0 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:27.268222 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba5754-969a-4c00-8325-86568131fab0 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:27.268517 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba5754-969a-4c00-8325-86568131fab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:27.302868 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-8fba5754-969a-4c00-8325-86568131fab0 None None] MFA Rules not processed for user `1d834466d42f47b1a3bffda50281999b`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:27.304844 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8fba5754-969a-4c00-8325-86568131fab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:27.379092 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1047/2097] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:27.390515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5de756-9c00-4784-bc54-87a82f1633cb admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:27.392230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-6a5de756-9c00-4784-bc54-87a82f1633cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:27.455711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5de756-9c00-4784-bc54-87a82f1633cb admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:27.460530 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe54c6f-035d-4b9d-9f7b-e66f402887ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:27.461269 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe54c6f-035d-4b9d-9f7b-e66f402887ff service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:27.461558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe54c6f-035d-4b9d-9f7b-e66f402887ff service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:27.461835 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe54c6f-035d-4b9d-9f7b-e66f402887ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:27.483199 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe54c6f-035d-4b9d-9f7b-e66f402887ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:27.484875 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe54c6f-035d-4b9d-9f7b-e66f402887ff service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:27.494890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1051/2098] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:27.497924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba5754-969a-4c00-8325-86568131fab0 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:27.499631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8fba5754-969a-4c00-8325-86568131fab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:27.517143 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe54c6f-035d-4b9d-9f7b-e66f402887ff service cinder] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:27.524664 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:27.574054 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba5754-969a-4c00-8325-86568131fab0 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:27.582723 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac577676-dd2a-4890-999e-f292728355d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:27.583412 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac577676-dd2a-4890-999e-f292728355d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:27.583703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac577676-dd2a-4890-999e-f292728355d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:27.583980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac577676-dd2a-4890-999e-f292728355d0 admin admin] PATH_INFO: `/v3/projects/9daa2431297c46c98da78c30922e045f` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:27.585688 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac577676-dd2a-4890-999e-f292728355d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9daa2431297c46c98da78c30922e045f)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:27.587692 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac577676-dd2a-4890-999e-f292728355d0 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:27.589767 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe54c6f-035d-4b9d-9f7b-e66f402887ff service cinder] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:27.595140 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3b5dfb-d27a-4da5-9c93-5961816975e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:27.595455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b5dfb-d27a-4da5-9c93-5961816975e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:27.595733 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b5dfb-d27a-4da5-9c93-5961816975e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:27.596137 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3b5dfb-d27a-4da5-9c93-5961816975e1 admin admin] PATH_INFO: `/v3/users/1d834466d42f47b1a3bffda50281999b` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:27.599200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b5dfb-d27a-4da5-9c93-5961816975e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d834466d42f47b1a3bffda50281999b)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:27.602253 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3b5dfb-d27a-4da5-9c93-5961816975e1 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:27.618213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:27.650475 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ac577676-dd2a-4890-999e-f292728355d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9daa2431297c46c98da78c30922e045f', 'request_id': 'req-ac577676-dd2a-4890-999e-f292728355d0'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:27.660544 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ac577676-dd2a-4890-999e-f292728355d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9daa2431297c46c98da78c30922e045f', 'request_id': 'req-ac577676-dd2a-4890-999e-f292728355d0'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:27.666097 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-0a3b5dfb-d27a-4da5-9c93-5961816975e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d834466d42f47b1a3bffda50281999b'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:27.666839 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-0a3b5dfb-d27a-4da5-9c93-5961816975e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d834466d42f47b1a3bffda50281999b'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:27.672853 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ac577676-dd2a-4890-999e-f292728355d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9daa2431297c46c98da78c30922e045f', 'request_id': 'req-ac577676-dd2a-4890-999e-f292728355d0'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:27.676389 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-0a3b5dfb-d27a-4da5-9c93-5961816975e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d834466d42f47b1a3bffda50281999b'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:27.687661 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ac577676-dd2a-4890-999e-f292728355d0 admin admin] The token cache is being invalidate because project 9daa2431297c46c98da78c30922e045f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:27.688251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ac577676-dd2a-4890-999e-f292728355d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:27.690090 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ac577676-dd2a-4890-999e-f292728355d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:27.696309 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1048/2099] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:27 2022] DELETE /identity/v3/projects/9daa2431297c46c98da78c30922e045f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:27.696624 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-0a3b5dfb-d27a-4da5-9c93-5961816975e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d834466d42f47b1a3bffda50281999b'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:27.697830 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-0a3b5dfb-d27a-4da5-9c93-5961816975e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d834466d42f47b1a3bffda50281999b'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:27.698658 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c05e6-ea1c-495e-b77c-987a7eb15dff None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:27.699113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c05e6-ea1c-495e-b77c-987a7eb15dff None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:27.699580 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454c05e6-ea1c-495e-b77c-987a7eb15dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:27.717100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1052/2100] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:27 2022] DELETE /identity/v3/users/1d834466d42f47b1a3bffda50281999b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:27.721785 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b50790-4597-4123-b82d-cb1d0ed829f2 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:27.722086 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b50790-4597-4123-b82d-cb1d0ed829f2 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:27.722397 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b50790-4597-4123-b82d-cb1d0ed829f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:27.726385 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-454c05e6-ea1c-495e-b77c-987a7eb15dff None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:27.727866 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-454c05e6-ea1c-495e-b77c-987a7eb15dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:27.743381 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-94b50790-4597-4123-b82d-cb1d0ed829f2 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:27.744606 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-94b50790-4597-4123-b82d-cb1d0ed829f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:27.815055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1053/2101] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:27.826386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1049/2102] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:27.826960 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b50790-4597-4123-b82d-cb1d0ed829f2 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:27.828734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-94b50790-4597-4123-b82d-cb1d0ed829f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:27.839488 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e503c-a7e1-41b1-ab17-07d785484b35 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:27.839673 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e503c-a7e1-41b1-ab17-07d785484b35 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:27.839941 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e503c-a7e1-41b1-ab17-07d785484b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:27.865298 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-a22e503c-a7e1-41b1-ab17-07d785484b35 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:27.866772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a22e503c-a7e1-41b1-ab17-07d785484b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:27.880576 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1050/2103] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:27.882744 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e503c-a7e1-41b1-ab17-07d785484b35 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:27.893490 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22e503c-a7e1-41b1-ab17-07d785484b35 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:27.899828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76220faa-d563-42df-bee4-564cc7787364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:27.900522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76220faa-d563-42df-bee4-564cc7787364 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:27.900866 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76220faa-d563-42df-bee4-564cc7787364 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:27.901153 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76220faa-d563-42df-bee4-564cc7787364 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:27.902167 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76220faa-d563-42df-bee4-564cc7787364 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:50:27.902515 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76220faa-d563-42df-bee4-564cc7787364 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:27.904614 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76220faa-d563-42df-bee4-564cc7787364 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:27.926209 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1051/2104] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:50:27.927931 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76220faa-d563-42df-bee4-564cc7787364 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:27.931613 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b50790-4597-4123-b82d-cb1d0ed829f2 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:27.936500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6dd73-5777-4743-a99b-7aed42abffb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:27.937279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6dd73-5777-4743-a99b-7aed42abffb7 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:27.937665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6dd73-5777-4743-a99b-7aed42abffb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:27.938315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d6dd73-5777-4743-a99b-7aed42abffb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:27.941069 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76220faa-d563-42df-bee4-564cc7787364 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:27.948578 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda9e72-e9d2-4a9e-9619-5a9665083896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:27.949150 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6dd73-5777-4743-a99b-7aed42abffb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:27.949710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda9e72-e9d2-4a9e-9619-5a9665083896 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:27.949996 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda9e72-e9d2-4a9e-9619-5a9665083896 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:27.950275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda9e72-e9d2-4a9e-9619-5a9665083896 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:27.951033 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d6dd73-5777-4743-a99b-7aed42abffb7 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:27.951856 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda9e72-e9d2-4a9e-9619-5a9665083896 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:27.964040 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1054/2105] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:50:27.973972 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda9e72-e9d2-4a9e-9619-5a9665083896 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:28.051507 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1052/2106] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:27 2022] POST /identity/v3/projects => generated 375 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:28.065516 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6dd73-5777-4743-a99b-7aed42abffb7 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:28.079569 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d6dd73-5777-4743-a99b-7aed42abffb7 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:28.156848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:28.237990 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d895da8-4434-4825-8b52-74800f852916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:28.239051 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d895da8-4434-4825-8b52-74800f852916 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:28.239492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d895da8-4434-4825-8b52-74800f852916 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:28.239928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d895da8-4434-4825-8b52-74800f852916 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:28.240736 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d895da8-4434-4825-8b52-74800f852916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:28.243744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d895da8-4434-4825-8b52-74800f852916 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:28.291508 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1055/2107] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:28 2022] POST /identity/v3/users => generated 288 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:28.292637 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda9e72-e9d2-4a9e-9619-5a9665083896 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:28.310293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda9e72-e9d2-4a9e-9619-5a9665083896 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:28.318470 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc49b30-caad-4c66-a45c-cae293313322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:28.322097 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc49b30-caad-4c66-a45c-cae293313322 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:28.322414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc49b30-caad-4c66-a45c-cae293313322 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:28.323896 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc49b30-caad-4c66-a45c-cae293313322 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:28.324667 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc49b30-caad-4c66-a45c-cae293313322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:28.328622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc49b30-caad-4c66-a45c-cae293313322 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:28.330782 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:28.344720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1053/2108] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:28.349091 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d895da8-4434-4825-8b52-74800f852916 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:28.364198 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d895da8-4434-4825-8b52-74800f852916 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:28.375830 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e208b9-6ad2-4971-a43c-5118e18f2c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:28.378397 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e208b9-6ad2-4971-a43c-5118e18f2c6c admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:28.378792 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e208b9-6ad2-4971-a43c-5118e18f2c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:28.379115 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e208b9-6ad2-4971-a43c-5118e18f2c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:28.380704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e208b9-6ad2-4971-a43c-5118e18f2c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:28.385340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e208b9-6ad2-4971-a43c-5118e18f2c6c admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:28.412156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1056/2109] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:28.416905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc49b30-caad-4c66-a45c-cae293313322 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:28.440678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc49b30-caad-4c66-a45c-cae293313322 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:28.449395 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d80710-7a90-4634-97c0-d414c9976e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:28.450286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d80710-7a90-4634-97c0-d414c9976e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:28.450709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d80710-7a90-4634-97c0-d414c9976e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:28.450997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d80710-7a90-4634-97c0-d414c9976e51 admin admin] PATH_INFO: `/v3/projects/e5d53111c2c54c2d9c7f33061d1afdf4/users/fccbfcf0cccf4cabae107d5339c89b79/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:28.484270 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d80710-7a90-4634-97c0-d414c9976e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d53111c2c54c2d9c7f33061d1afdf4, user_id=fccbfcf0cccf4cabae107d5339c89b79, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:28.494402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d80710-7a90-4634-97c0-d414c9976e51 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:28.533376 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e208b9-6ad2-4971-a43c-5118e18f2c6c admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:28.533376 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c6e208b9-6ad2-4971-a43c-5118e18f2c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:28.535569 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1054/2110] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:28 2022] PUT /identity/v3/projects/e5d53111c2c54c2d9c7f33061d1afdf4/users/fccbfcf0cccf4cabae107d5339c89b79/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:28.549095 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e208b9-6ad2-4971-a43c-5118e18f2c6c admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:28.556338 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d7370-9f74-49e7-8a4a-23ddf7a30574 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:28.556338 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d7370-9f74-49e7-8a4a-23ddf7a30574 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:28.556489 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d7370-9f74-49e7-8a4a-23ddf7a30574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:28.607805 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-990d7370-9f74-49e7-8a4a-23ddf7a30574 None None] MFA Rules not processed for user `fccbfcf0cccf4cabae107d5339c89b79`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:28.609044 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-990d7370-9f74-49e7-8a4a-23ddf7a30574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:28.673532 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f024e0-fad0-4944-bb02-a5c611a379b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:28.674197 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f024e0-fad0-4944-bb02-a5c611a379b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:28.674518 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f024e0-fad0-4944-bb02-a5c611a379b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:28.674784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f024e0-fad0-4944-bb02-a5c611a379b8 admin admin] PATH_INFO: `/v3/projects/bb2974da9dc4490493fe281c2bc3cb50` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:28.675973 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f024e0-fad0-4944-bb02-a5c611a379b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb2974da9dc4490493fe281c2bc3cb50)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:28.679627 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f024e0-fad0-4944-bb02-a5c611a379b8 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:28.733370 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1055/2111] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:28.738669 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d7370-9f74-49e7-8a4a-23ddf7a30574 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:28.738997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e5f024e0-fad0-4944-bb02-a5c611a379b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb2974da9dc4490493fe281c2bc3cb50', 'request_id': 'req-e5f024e0-fad0-4944-bb02-a5c611a379b8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:28.747309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e5f024e0-fad0-4944-bb02-a5c611a379b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb2974da9dc4490493fe281c2bc3cb50', 'request_id': 'req-e5f024e0-fad0-4944-bb02-a5c611a379b8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:28.755564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d7370-9f74-49e7-8a4a-23ddf7a30574 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:28.756611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e5f024e0-fad0-4944-bb02-a5c611a379b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb2974da9dc4490493fe281c2bc3cb50', 'request_id': 'req-e5f024e0-fad0-4944-bb02-a5c611a379b8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:28.771613 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e5f024e0-fad0-4944-bb02-a5c611a379b8 admin admin] The token cache is being invalidate because project bb2974da9dc4490493fe281c2bc3cb50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:28.771933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e5f024e0-fad0-4944-bb02-a5c611a379b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:28.772909 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e5f024e0-fad0-4944-bb02-a5c611a379b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:28.776055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1057/2112] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:28 2022] DELETE /identity/v3/projects/bb2974da9dc4490493fe281c2bc3cb50 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:28.780626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea50124-3b82-4ccb-a192-1b54139808e8 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:28.780922 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea50124-3b82-4ccb-a192-1b54139808e8 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:28.781208 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea50124-3b82-4ccb-a192-1b54139808e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:28.803066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-aea50124-3b82-4ccb-a192-1b54139808e8 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:28.804859 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-aea50124-3b82-4ccb-a192-1b54139808e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:28.827573 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4595d-001a-46d5-990a-82dc069a671c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:28.828214 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4595d-001a-46d5-990a-82dc069a671c admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:28.829041 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4595d-001a-46d5-990a-82dc069a671c admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:28.829462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4595d-001a-46d5-990a-82dc069a671c admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:28.830439 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4595d-001a-46d5-990a-82dc069a671c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:28.833857 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4595d-001a-46d5-990a-82dc069a671c admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:28.851011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:28.865693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1056/2113] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:28 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:28.867305 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4595d-001a-46d5-990a-82dc069a671c admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:28.869024 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-86a4595d-001a-46d5-990a-82dc069a671c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:28.879297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1058/2114] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:28.888253 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a723b5-76b1-4abf-9e13-7bb8e82d238c None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:28.888690 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a723b5-76b1-4abf-9e13-7bb8e82d238c None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:28.889066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a723b5-76b1-4abf-9e13-7bb8e82d238c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:28.910385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-e2a723b5-76b1-4abf-9e13-7bb8e82d238c None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:28.911697 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e2a723b5-76b1-4abf-9e13-7bb8e82d238c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:28.923214 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:28.939731 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4595d-001a-46d5-990a-82dc069a671c admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:28.944070 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc648a25-d689-44b3-b093-ea8f2bb3d4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:28.944684 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc648a25-d689-44b3-b093-ea8f2bb3d4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:28.944974 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc648a25-d689-44b3-b093-ea8f2bb3d4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:28.945251 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc648a25-d689-44b3-b093-ea8f2bb3d4d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:28.945907 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc648a25-d689-44b3-b093-ea8f2bb3d4d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:28.947846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc648a25-d689-44b3-b093-ea8f2bb3d4d9 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:28.973288 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1057/2115] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:28 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:28.974463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc648a25-d689-44b3-b093-ea8f2bb3d4d9 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:28.975959 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1059/2116] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:28.979916 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a723b5-76b1-4abf-9e13-7bb8e82d238c None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:28.984751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc648a25-d689-44b3-b093-ea8f2bb3d4d9 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:28.988614 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a723b5-76b1-4abf-9e13-7bb8e82d238c None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:28.989403 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f4001-4719-482f-9ea3-feae6f61505c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:28.989999 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f4001-4719-482f-9ea3-feae6f61505c admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:28.990283 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f4001-4719-482f-9ea3-feae6f61505c admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:28.990589 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f4001-4719-482f-9ea3-feae6f61505c admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:28.991302 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f4001-4719-482f-9ea3-feae6f61505c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:28.992870 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f4001-4719-482f-9ea3-feae6f61505c admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:28.993394 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bdd55-c13e-4bed-a81c-d9041c8d23c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:28.993999 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bdd55-c13e-4bed-a81c-d9041c8d23c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:28.994287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bdd55-c13e-4bed-a81c-d9041c8d23c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:28.994597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bdd55-c13e-4bed-a81c-d9041c8d23c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:28.995291 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bdd55-c13e-4bed-a81c-d9041c8d23c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:50:28.995601 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bdd55-c13e-4bed-a81c-d9041c8d23c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:28.997169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318bdd55-c13e-4bed-a81c-d9041c8d23c8 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:29.004197 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1058/2117] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:29.008299 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f4001-4719-482f-9ea3-feae6f61505c admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:29.009818 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1060/2118] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:50:29.013774 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bdd55-c13e-4bed-a81c-d9041c8d23c8 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:29.018183 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f4001-4719-482f-9ea3-feae6f61505c admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:29.023809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdbd24-716c-437b-a1f7-3eddd140cae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:29.023974 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bdd55-c13e-4bed-a81c-d9041c8d23c8 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:29.024424 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdbd24-716c-437b-a1f7-3eddd140cae3 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:29.024844 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdbd24-716c-437b-a1f7-3eddd140cae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:29.025132 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdbd24-716c-437b-a1f7-3eddd140cae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:29.025825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdbd24-716c-437b-a1f7-3eddd140cae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:29.027493 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befdbd24-716c-437b-a1f7-3eddd140cae3 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:29.028474 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a0522-6102-49d4-8140-50b48a4201ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:29.029062 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a0522-6102-49d4-8140-50b48a4201ac admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:29.029343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a0522-6102-49d4-8140-50b48a4201ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:29.029621 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319a0522-6102-49d4-8140-50b48a4201ac admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:29.030276 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a0522-6102-49d4-8140-50b48a4201ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:29.032331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319a0522-6102-49d4-8140-50b48a4201ac admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:29.038855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1059/2119] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:29.042804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdbd24-716c-437b-a1f7-3eddd140cae3 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:29.052755 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdbd24-716c-437b-a1f7-3eddd140cae3 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:29.060022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61b969-7a10-4eab-bc56-d150fe32c14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:29.061098 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61b969-7a10-4eab-bc56-d150fe32c14a admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:29.061541 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61b969-7a10-4eab-bc56-d150fe32c14a admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:29.062020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61b969-7a10-4eab-bc56-d150fe32c14a admin admin] PATH_INFO: `/v3/projects/7ba64ced13cf466c85e3dea3ae48e4af/users/db75a32fe79c42a4aa4c4678f023ae41/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:29.067776 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1061/2120] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:29 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:29.069462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a0522-6102-49d4-8140-50b48a4201ac admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:29.083766 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61b969-7a10-4eab-bc56-d150fe32c14a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba64ced13cf466c85e3dea3ae48e4af, user_id=db75a32fe79c42a4aa4c4678f023ae41, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:29.088913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61b969-7a10-4eab-bc56-d150fe32c14a admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:29.108712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1060/2121] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:29 2022] PUT /identity/v3/projects/7ba64ced13cf466c85e3dea3ae48e4af/users/db75a32fe79c42a4aa4c4678f023ae41/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:29.126943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dd996-4392-4567-b824-903c0859e379 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:29.127250 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dd996-4392-4567-b824-903c0859e379 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:29.127531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dd996-4392-4567-b824-903c0859e379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:29.151729 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319a0522-6102-49d4-8140-50b48a4201ac admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:29.156087 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-fa5dd996-4392-4567-b824-903c0859e379 None None] MFA Rules not processed for user `db75a32fe79c42a4aa4c4678f023ae41`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:29.157294 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-fa5dd996-4392-4567-b824-903c0859e379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:29.201248 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:29.210153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b119d-0abd-49cb-8732-6b5e761937f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:29.210823 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b119d-0abd-49cb-8732-6b5e761937f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:29.211111 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b119d-0abd-49cb-8732-6b5e761937f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:29.211478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b119d-0abd-49cb-8732-6b5e761937f0 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:29.212156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b119d-0abd-49cb-8732-6b5e761937f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:29.214075 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b119d-0abd-49cb-8732-6b5e761937f0 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:29.223866 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1061/2122] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:29.229385 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dd996-4392-4567-b824-903c0859e379 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:29.236833 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1062/2123] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:29 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:29.240689 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b119d-0abd-49cb-8732-6b5e761937f0 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:29.241863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dd996-4392-4567-b824-903c0859e379 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:29.246585 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd11e3-965e-46f5-8a80-23849ac8447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:29.247235 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd11e3-965e-46f5-8a80-23849ac8447f admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:29.247553 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd11e3-965e-46f5-8a80-23849ac8447f admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:29.247837 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbd11e3-965e-46f5-8a80-23849ac8447f admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:29.248560 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd11e3-965e-46f5-8a80-23849ac8447f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:29.249947 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b119d-0abd-49cb-8732-6b5e761937f0 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:29.250547 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbd11e3-965e-46f5-8a80-23849ac8447f admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:29.254518 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bd402-591f-4439-b55b-1bc95a741b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:29.255116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bd402-591f-4439-b55b-1bc95a741b9c admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:29.255395 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bd402-591f-4439-b55b-1bc95a741b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:29.255668 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99bd402-591f-4439-b55b-1bc95a741b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:29.256356 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bd402-591f-4439-b55b-1bc95a741b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:29.257913 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99bd402-591f-4439-b55b-1bc95a741b9c admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:29.271665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1063/2124] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:29.273782 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bd402-591f-4439-b55b-1bc95a741b9c admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:29.279674 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1062/2125] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:29 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:29.283547 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd11e3-965e-46f5-8a80-23849ac8447f admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:29.286644 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99bd402-591f-4439-b55b-1bc95a741b9c admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:29.342178 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:29.344538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7788660-2013-42b5-a168-9e68cd10fed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:29.345222 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7788660-2013-42b5-a168-9e68cd10fed5 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:29.345604 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7788660-2013-42b5-a168-9e68cd10fed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:29.345890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7788660-2013-42b5-a168-9e68cd10fed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:29.346167 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbd11e3-965e-46f5-8a80-23849ac8447f admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:29.346622 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7788660-2013-42b5-a168-9e68cd10fed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:29.348249 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7788660-2013-42b5-a168-9e68cd10fed5 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:29.355022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce9abb-2572-480c-9344-79f9a9d77a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:29.355643 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce9abb-2572-480c-9344-79f9a9d77a58 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:29.355926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce9abb-2572-480c-9344-79f9a9d77a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:29.356201 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce9abb-2572-480c-9344-79f9a9d77a58 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:29.356870 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce9abb-2572-480c-9344-79f9a9d77a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:29.358454 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1064/2126] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:29.361932 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce9abb-2572-480c-9344-79f9a9d77a58 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:29.362618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7788660-2013-42b5-a168-9e68cd10fed5 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:29.375739 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7788660-2013-42b5-a168-9e68cd10fed5 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:29.380563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41165127-8d71-470d-9eeb-37af1f1bf370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:29.381232 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41165127-8d71-470d-9eeb-37af1f1bf370 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:29.382058 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41165127-8d71-470d-9eeb-37af1f1bf370 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:29.382298 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41165127-8d71-470d-9eeb-37af1f1bf370 admin admin] PATH_INFO: `/v3/projects/fa53368497ff461da2474efb7e52484e/users/fe4c6ad9372d49128121a9f00196c0be/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:29.384943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1063/2127] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:29 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:29.388555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce9abb-2572-480c-9344-79f9a9d77a58 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:29.401494 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce9abb-2572-480c-9344-79f9a9d77a58 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:29.401930 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41165127-8d71-470d-9eeb-37af1f1bf370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa53368497ff461da2474efb7e52484e, user_id=fe4c6ad9372d49128121a9f00196c0be, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:29.405248 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41165127-8d71-470d-9eeb-37af1f1bf370 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:29.406944 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f67412-585d-4fc8-a652-24698befd67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:29.407666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f67412-585d-4fc8-a652-24698befd67e admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:29.408318 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f67412-585d-4fc8-a652-24698befd67e admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:29.408318 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f67412-585d-4fc8-a652-24698befd67e admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:29.409017 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f67412-585d-4fc8-a652-24698befd67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:29.411225 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f67412-585d-4fc8-a652-24698befd67e admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:29.423783 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1065/2128] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:29 2022] PUT /identity/v3/projects/fa53368497ff461da2474efb7e52484e/users/fe4c6ad9372d49128121a9f00196c0be/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:29.427367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1064/2129] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:29.428584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41165127-8d71-470d-9eeb-37af1f1bf370 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:29.435279 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bf16e-311c-47fa-adaf-6f5b3d739df7 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:29.435650 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bf16e-311c-47fa-adaf-6f5b3d739df7 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:29.435975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2bf16e-311c-47fa-adaf-6f5b3d739df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:29.473881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-1d2bf16e-311c-47fa-adaf-6f5b3d739df7 None None] MFA Rules not processed for user `fe4c6ad9372d49128121a9f00196c0be`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:29.475628 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-1d2bf16e-311c-47fa-adaf-6f5b3d739df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:29.506279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41165127-8d71-470d-9eeb-37af1f1bf370 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:29.512981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4a479-54cb-42c5-8d4e-57bc47bf4952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:29.513720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4a479-54cb-42c5-8d4e-57bc47bf4952 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:29.514014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4a479-54cb-42c5-8d4e-57bc47bf4952 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:29.514297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4a479-54cb-42c5-8d4e-57bc47bf4952 admin admin] PATH_INFO: `/v3/projects/d84c3422fa37448ab9f1a5360186f0f2/users/52e17dc2839845a3b141c87e5e7f1456/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:29.531150 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4a479-54cb-42c5-8d4e-57bc47bf4952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84c3422fa37448ab9f1a5360186f0f2, user_id=52e17dc2839845a3b141c87e5e7f1456, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:29.534656 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4a479-54cb-42c5-8d4e-57bc47bf4952 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:29.565945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1066/2130] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:29 2022] PUT /identity/v3/projects/d84c3422fa37448ab9f1a5360186f0f2/users/52e17dc2839845a3b141c87e5e7f1456/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:29.570740 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4a479-54cb-42c5-8d4e-57bc47bf4952 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:29.594174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1065/2131] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:29.607511 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bf16e-311c-47fa-adaf-6f5b3d739df7 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:29.623068 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:29.643643 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2bf16e-311c-47fa-adaf-6f5b3d739df7 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:29.685013 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4a479-54cb-42c5-8d4e-57bc47bf4952 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:29.690583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc63b9e-2bae-4943-84f3-5cb0c1251e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:29.691307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc63b9e-2bae-4943-84f3-5cb0c1251e22 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:29.691664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc63b9e-2bae-4943-84f3-5cb0c1251e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:29.692156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc63b9e-2bae-4943-84f3-5cb0c1251e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:29.693111 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc63b9e-2bae-4943-84f3-5cb0c1251e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:29.695865 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc63b9e-2bae-4943-84f3-5cb0c1251e22 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:29.723078 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1067/2132] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:29.724386 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc63b9e-2bae-4943-84f3-5cb0c1251e22 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:29.746784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc63b9e-2bae-4943-84f3-5cb0c1251e22 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:29.750617 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe4127-197c-4fdd-8ac7-095f26dea329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:29.751299 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe4127-197c-4fdd-8ac7-095f26dea329 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:29.751584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe4127-197c-4fdd-8ac7-095f26dea329 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:29.751862 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe4127-197c-4fdd-8ac7-095f26dea329 admin admin] PATH_INFO: `/v3/projects/d84c3422fa37448ab9f1a5360186f0f2/users/52e17dc2839845a3b141c87e5e7f1456/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:29.751987 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2384c-cc62-43bc-b63f-83d58c96ee81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:29.752576 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2384c-cc62-43bc-b63f-83d58c96ee81 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:29.752867 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2384c-cc62-43bc-b63f-83d58c96ee81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:29.753216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e2384c-cc62-43bc-b63f-83d58c96ee81 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:29.753882 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2384c-cc62-43bc-b63f-83d58c96ee81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:29.755751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e2384c-cc62-43bc-b63f-83d58c96ee81 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:29.767306 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe4127-197c-4fdd-8ac7-095f26dea329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84c3422fa37448ab9f1a5360186f0f2, user_id=52e17dc2839845a3b141c87e5e7f1456, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:29.769973 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe4127-197c-4fdd-8ac7-095f26dea329 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:29.783233 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1068/2133] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:29 2022] PUT /identity/v3/projects/d84c3422fa37448ab9f1a5360186f0f2/users/52e17dc2839845a3b141c87e5e7f1456/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:29.796032 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad507a2-bceb-4ea4-80df-5973827c29f0 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:29.796032 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad507a2-bceb-4ea4-80df-5973827c29f0 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:29.796032 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad507a2-bceb-4ea4-80df-5973827c29f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:29.798695 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1066/2134] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:29 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:29.802921 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2384c-cc62-43bc-b63f-83d58c96ee81 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:29.837981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-aad507a2-bceb-4ea4-80df-5973827c29f0 None None] MFA Rules not processed for user `52e17dc2839845a3b141c87e5e7f1456`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:29.839462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-aad507a2-bceb-4ea4-80df-5973827c29f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:29.892322 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:29.909826 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e2384c-cc62-43bc-b63f-83d58c96ee81 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:29.917608 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5536660-8f15-4bb9-9826-af7c8c3ff115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:29.918352 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5536660-8f15-4bb9-9826-af7c8c3ff115 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:29.918876 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5536660-8f15-4bb9-9826-af7c8c3ff115 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:29.919348 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5536660-8f15-4bb9-9826-af7c8c3ff115 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:29.920212 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5536660-8f15-4bb9-9826-af7c8c3ff115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:29.923661 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5536660-8f15-4bb9-9826-af7c8c3ff115 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:29.954932 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1069/2135] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:29.959323 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1067/2136] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:29 2022] POST /identity/v3/users => generated 291 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:29.963517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad507a2-bceb-4ea4-80df-5973827c29f0 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:29.979787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad507a2-bceb-4ea4-80df-5973827c29f0 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:29.985869 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3429355-20eb-4167-8095-d9404c145abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:29.987366 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3429355-20eb-4167-8095-d9404c145abb admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:29.987799 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3429355-20eb-4167-8095-d9404c145abb admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:29.988178 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3429355-20eb-4167-8095-d9404c145abb admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:29.989742 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3429355-20eb-4167-8095-d9404c145abb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:29.992733 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3429355-20eb-4167-8095-d9404c145abb admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:30.012985 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5536660-8f15-4bb9-9826-af7c8c3ff115 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:30.013460 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1070/2137] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:30.035500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3429355-20eb-4167-8095-d9404c145abb admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:30.038761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a3429355-20eb-4167-8095-d9404c145abb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:30.038995 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5536660-8f15-4bb9-9826-af7c8c3ff115 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:30.046712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ff839-9c09-4c54-a733-0024d824e1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:30.047705 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ff839-9c09-4c54-a733-0024d824e1aa admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:30.048312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ff839-9c09-4c54-a733-0024d824e1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:30.048739 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ff839-9c09-4c54-a733-0024d824e1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:30.049642 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ff839-9c09-4c54-a733-0024d824e1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:30.051813 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ff839-9c09-4c54-a733-0024d824e1aa admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:30.093902 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1068/2138] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:30.098480 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ff839-9c09-4c54-a733-0024d824e1aa admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:30.117585 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ff839-9c09-4c54-a733-0024d824e1aa admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:30.126025 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe4ff8-6b82-430c-a3c9-557e490afd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:30.127814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe4ff8-6b82-430c-a3c9-557e490afd48 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:30.128278 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe4ff8-6b82-430c-a3c9-557e490afd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:30.128782 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe4ff8-6b82-430c-a3c9-557e490afd48 admin admin] PATH_INFO: `/v3/projects/ea42d2c4225e41ae880496e9289fcecb/users/f698c1feec28480cadd5b0aa4b9c1a53/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:30.129537 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3429355-20eb-4167-8095-d9404c145abb admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:30.134287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b4bb5-ac2a-4216-822c-d48c0ec74cf8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:30.136098 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b4bb5-ac2a-4216-822c-d48c0ec74cf8 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:30.136392 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b4bb5-ac2a-4216-822c-d48c0ec74cf8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:30.136676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b4bb5-ac2a-4216-822c-d48c0ec74cf8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:30.143900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-270b4bb5-ac2a-4216-822c-d48c0ec74cf8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:30.151278 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe4ff8-6b82-430c-a3c9-557e490afd48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea42d2c4225e41ae880496e9289fcecb, user_id=f698c1feec28480cadd5b0aa4b9c1a53, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:30.155620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe4ff8-6b82-430c-a3c9-557e490afd48 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:30.190133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1069/2139] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:30 2022] PUT /identity/v3/projects/ea42d2c4225e41ae880496e9289fcecb/users/f698c1feec28480cadd5b0aa4b9c1a53/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:30.219722 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:30.253264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b4bb5-ac2a-4216-822c-d48c0ec74cf8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:30.256280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b4bb5-ac2a-4216-822c-d48c0ec74cf8 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:30.262607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739dd5d-443b-4bf6-8289-438b7ed2591d None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:30.262907 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739dd5d-443b-4bf6-8289-438b7ed2591d None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:30.263254 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6739dd5d-443b-4bf6-8289-438b7ed2591d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:30.282557 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1071/2140] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:30.293927 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-6739dd5d-443b-4bf6-8289-438b7ed2591d None None] MFA Rules not processed for user `f698c1feec28480cadd5b0aa4b9c1a53`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:30.295217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6739dd5d-443b-4bf6-8289-438b7ed2591d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:30.380217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1070/2141] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:30.385699 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b4bb5-ac2a-4216-822c-d48c0ec74cf8 service cinder] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:30.399098 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b4bb5-ac2a-4216-822c-d48c0ec74cf8 service cinder] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:30.481726 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ad123-0d58-443f-a310-b2b643cd19be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:30.482393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ad123-0d58-443f-a310-b2b643cd19be admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:30.482686 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ad123-0d58-443f-a310-b2b643cd19be admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:30.482967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ad123-0d58-443f-a310-b2b643cd19be admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:30.484138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ad123-0d58-443f-a310-b2b643cd19be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:30.485633 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ad123-0d58-443f-a310-b2b643cd19be admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:30.527257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1072/2142] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:30 2022] POST /identity/v3/projects => generated 383 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:30.528500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739dd5d-443b-4bf6-8289-438b7ed2591d None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:30.540309 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6739dd5d-443b-4bf6-8289-438b7ed2591d None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:30.617551 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991e37e-7a39-43f5-8113-eda2d0f6751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:30.618188 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991e37e-7a39-43f5-8113-eda2d0f6751b admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:30.618516 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991e37e-7a39-43f5-8113-eda2d0f6751b admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:30.618791 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d991e37e-7a39-43f5-8113-eda2d0f6751b admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:30.619471 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991e37e-7a39-43f5-8113-eda2d0f6751b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:30.621413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d991e37e-7a39-43f5-8113-eda2d0f6751b admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:30.653873 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1071/2143] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:30 2022] POST /identity/v3/users => generated 298 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:30.655011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ad123-0d58-443f-a310-b2b643cd19be admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:30.668566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ad123-0d58-443f-a310-b2b643cd19be admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:30.676271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11914ea1-9aba-4846-a46b-a3eccc4eca37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:30.677012 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11914ea1-9aba-4846-a46b-a3eccc4eca37 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:30.677325 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11914ea1-9aba-4846-a46b-a3eccc4eca37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:30.677678 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11914ea1-9aba-4846-a46b-a3eccc4eca37 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:30.678500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11914ea1-9aba-4846-a46b-a3eccc4eca37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:30.680156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11914ea1-9aba-4846-a46b-a3eccc4eca37 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:30.692325 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1073/2144] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:30.696420 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991e37e-7a39-43f5-8113-eda2d0f6751b admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:30.707591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d991e37e-7a39-43f5-8113-eda2d0f6751b admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:30.714051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46caa9-2ffb-4fb7-9250-a7296647cf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:30.714893 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46caa9-2ffb-4fb7-9250-a7296647cf37 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:30.715281 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46caa9-2ffb-4fb7-9250-a7296647cf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:30.715719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46caa9-2ffb-4fb7-9250-a7296647cf37 admin admin] PATH_INFO: `/v3/projects/f0af8fce9c404a9086518d05f4524274/users/9433fabfe20c414ebb4e785ee80d4b82/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:30.739051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46caa9-2ffb-4fb7-9250-a7296647cf37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0af8fce9c404a9086518d05f4524274, user_id=9433fabfe20c414ebb4e785ee80d4b82, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:30.741773 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46caa9-2ffb-4fb7-9250-a7296647cf37 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:30.755291 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:30.761447 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1072/2145] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:30 2022] PUT /identity/v3/projects/f0af8fce9c404a9086518d05f4524274/users/9433fabfe20c414ebb4e785ee80d4b82/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:30.766716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11914ea1-9aba-4846-a46b-a3eccc4eca37 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:30.780120 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11914ea1-9aba-4846-a46b-a3eccc4eca37 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:30.857422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12595943-8c7d-4f77-94bd-7f6d12fb7129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:30.858054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12595943-8c7d-4f77-94bd-7f6d12fb7129 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:30.858360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12595943-8c7d-4f77-94bd-7f6d12fb7129 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:30.858644 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12595943-8c7d-4f77-94bd-7f6d12fb7129 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:30.859344 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12595943-8c7d-4f77-94bd-7f6d12fb7129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:30.860942 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12595943-8c7d-4f77-94bd-7f6d12fb7129 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:30.872357 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1074/2146] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:30 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:30.876480 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46caa9-2ffb-4fb7-9250-a7296647cf37 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:30.887605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46caa9-2ffb-4fb7-9250-a7296647cf37 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:30.893146 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7ddca-488c-43e3-9f4e-6f4deafadbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:30.893819 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7ddca-488c-43e3-9f4e-6f4deafadbf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:30.894104 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7ddca-488c-43e3-9f4e-6f4deafadbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:30.894410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7ddca-488c-43e3-9f4e-6f4deafadbf8 admin admin] PATH_INFO: `/v3/projects/f0af8fce9c404a9086518d05f4524274/users/9433fabfe20c414ebb4e785ee80d4b82/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:30.896336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7ddca-488c-43e3-9f4e-6f4deafadbf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0af8fce9c404a9086518d05f4524274, user_id=9433fabfe20c414ebb4e785ee80d4b82, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:30.899653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7ddca-488c-43e3-9f4e-6f4deafadbf8 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:30.911716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1073/2147] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:30 2022] PUT /identity/v3/projects/f0af8fce9c404a9086518d05f4524274/users/9433fabfe20c414ebb4e785ee80d4b82/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:30.922456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ac55e-ffb5-4cc9-b327-c6e842643399 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:30.922912 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ac55e-ffb5-4cc9-b327-c6e842643399 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:30.923194 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ac55e-ffb5-4cc9-b327-c6e842643399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:30.951528 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-877ac55e-ffb5-4cc9-b327-c6e842643399 None None] MFA Rules not processed for user `9433fabfe20c414ebb4e785ee80d4b82`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:30.952751 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-877ac55e-ffb5-4cc9-b327-c6e842643399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:30.992878 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:31.021468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1075/2148] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:31.033852 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7ddca-488c-43e3-9f4e-6f4deafadbf8 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:31.093917 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7ddca-488c-43e3-9f4e-6f4deafadbf8 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:31.097150 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d29839-bac4-45dd-bf57-bdb171ff3a03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:31.097775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d29839-bac4-45dd-bf57-bdb171ff3a03 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:31.098059 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d29839-bac4-45dd-bf57-bdb171ff3a03 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:31.098358 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d29839-bac4-45dd-bf57-bdb171ff3a03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:31.163324 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d29839-bac4-45dd-bf57-bdb171ff3a03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:31.164727 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d29839-bac4-45dd-bf57-bdb171ff3a03 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:31.173818 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1074/2149] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:32.039971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ac55e-ffb5-4cc9-b327-c6e842643399 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:32.042156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-877ac55e-ffb5-4cc9-b327-c6e842643399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:32.056897 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ac55e-ffb5-4cc9-b327-c6e842643399 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:32.060755 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9098343-2b5e-476b-ae96-f6b7135a9500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:32.061383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9098343-2b5e-476b-ae96-f6b7135a9500 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:32.061667 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9098343-2b5e-476b-ae96-f6b7135a9500 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:32.061947 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9098343-2b5e-476b-ae96-f6b7135a9500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:32.135226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9098343-2b5e-476b-ae96-f6b7135a9500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:32.136790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9098343-2b5e-476b-ae96-f6b7135a9500 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:32.146595 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1076/2150] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:32.796685 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d29839-bac4-45dd-bf57-bdb171ff3a03 service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:32.810371 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d29839-bac4-45dd-bf57-bdb171ff3a03 service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:32.815200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41dee8-a946-4667-a880-bc674162089e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:32.816066 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41dee8-a946-4667-a880-bc674162089e service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:32.816400 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41dee8-a946-4667-a880-bc674162089e service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:32.816687 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c41dee8-a946-4667-a880-bc674162089e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:32.878811 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9098343-2b5e-476b-ae96-f6b7135a9500 service cinder] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:32.893290 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9098343-2b5e-476b-ae96-f6b7135a9500 service cinder] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:32.900167 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3da63-e5ad-48af-89bc-1d8d646be839 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:32.901206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3da63-e5ad-48af-89bc-1d8d646be839 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:32.901592 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3da63-e5ad-48af-89bc-1d8d646be839 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:32.901989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3da63-e5ad-48af-89bc-1d8d646be839 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:32.902212 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41dee8-a946-4667-a880-bc674162089e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:32.903733 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c41dee8-a946-4667-a880-bc674162089e service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:32.916665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1075/2151] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:32.978005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3da63-e5ad-48af-89bc-1d8d646be839 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:32.979680 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3da63-e5ad-48af-89bc-1d8d646be839 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:33.006170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1077/2152] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:33.863618 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41dee8-a946-4667-a880-bc674162089e service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:33.874244 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c41dee8-a946-4667-a880-bc674162089e service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:33.879079 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a553c9b-a3a3-4928-a307-2204a3cf9328 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:33.879707 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a553c9b-a3a3-4928-a307-2204a3cf9328 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:33.880662 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a553c9b-a3a3-4928-a307-2204a3cf9328 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:33.881122 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a553c9b-a3a3-4928-a307-2204a3cf9328 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:33.893413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a553c9b-a3a3-4928-a307-2204a3cf9328 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:33.894872 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a553c9b-a3a3-4928-a307-2204a3cf9328 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:33.910571 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1076/2153] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:50:35.212681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa3d88-af58-4718-9582-2e306934f949 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:35.213187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa3d88-af58-4718-9582-2e306934f949 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:35.213303 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa3d88-af58-4718-9582-2e306934f949 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:35.214781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1078/2154] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 22:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:50:35.243997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1a094-4e43-4f13-84da-d6591635005e None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:35.244447 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1a094-4e43-4f13-84da-d6591635005e None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:35.244577 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1a094-4e43-4f13-84da-d6591635005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:35.265474 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-26f1a094-4e43-4f13-84da-d6591635005e None None] MFA Rules not processed for user `2e3a1384f3b34999a75572ee10a1e3fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:35.266976 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-26f1a094-4e43-4f13-84da-d6591635005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:35.290154 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa3d88-af58-4718-9582-2e306934f949 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:35.294915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-32fa3d88-af58-4718-9582-2e306934f949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:35.309647 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:35.362695 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1077/2155] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 22:50:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:35.375522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1a094-4e43-4f13-84da-d6591635005e None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:35.377625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-26f1a094-4e43-4f13-84da-d6591635005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:35.391916 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa3d88-af58-4718-9582-2e306934f949 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:35.394076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1a094-4e43-4f13-84da-d6591635005e None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:35.406249 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec15f2-2614-46b0-91f6-375761a322ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a1384f3b34999a75572ee10a1e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:35.409537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec15f2-2614-46b0-91f6-375761a322ee service placement] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:35.409537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec15f2-2614-46b0-91f6-375761a322ee service placement] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:35.409537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dec15f2-2614-46b0-91f6-375761a322ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:35.409889 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544d9cd-6605-4f88-9e3d-0802ad53e829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:35.410228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544d9cd-6605-4f88-9e3d-0802ad53e829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:35.410786 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544d9cd-6605-4f88-9e3d-0802ad53e829 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:35.411250 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544d9cd-6605-4f88-9e3d-0802ad53e829 admin admin] PATH_INFO: `/v3/users/16e9ba7fa4c74a5ea1204daa44e03f28` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:35.413429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544d9cd-6605-4f88-9e3d-0802ad53e829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16e9ba7fa4c74a5ea1204daa44e03f28)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:35.415746 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544d9cd-6605-4f88-9e3d-0802ad53e829 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:35.418162 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec15f2-2614-46b0-91f6-375761a322ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:35.420421 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dec15f2-2614-46b0-91f6-375761a322ee service placement] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:35.429020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:35.432948 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1078/2156] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:35.492263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b544d9cd-6605-4f88-9e3d-0802ad53e829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16e9ba7fa4c74a5ea1204daa44e03f28'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:35.493155 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b544d9cd-6605-4f88-9e3d-0802ad53e829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16e9ba7fa4c74a5ea1204daa44e03f28'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:35.503245 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b544d9cd-6605-4f88-9e3d-0802ad53e829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16e9ba7fa4c74a5ea1204daa44e03f28'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:35.520271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b544d9cd-6605-4f88-9e3d-0802ad53e829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16e9ba7fa4c74a5ea1204daa44e03f28'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:35.521031 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b544d9cd-6605-4f88-9e3d-0802ad53e829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16e9ba7fa4c74a5ea1204daa44e03f28'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:35.536170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1079/2157] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:35 2022] DELETE /identity/v3/users/16e9ba7fa4c74a5ea1204daa44e03f28 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:35.754973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec15f2-2614-46b0-91f6-375761a322ee service placement] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:35.769553 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dec15f2-2614-46b0-91f6-375761a322ee service placement] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:35.826904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49487c80-4ecb-4a7e-8375-0da32d6795e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:35.827543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49487c80-4ecb-4a7e-8375-0da32d6795e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:35.827824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49487c80-4ecb-4a7e-8375-0da32d6795e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:35.828127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49487c80-4ecb-4a7e-8375-0da32d6795e9 admin admin] PATH_INFO: `/v3/projects/b39bf78701364a34b2110730bdfee792` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:35.829257 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49487c80-4ecb-4a7e-8375-0da32d6795e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b39bf78701364a34b2110730bdfee792)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:35.831171 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49487c80-4ecb-4a7e-8375-0da32d6795e9 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:35.877240 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-49487c80-4ecb-4a7e-8375-0da32d6795e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b39bf78701364a34b2110730bdfee792', 'request_id': 'req-49487c80-4ecb-4a7e-8375-0da32d6795e9'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:35.884538 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-49487c80-4ecb-4a7e-8375-0da32d6795e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b39bf78701364a34b2110730bdfee792', 'request_id': 'req-49487c80-4ecb-4a7e-8375-0da32d6795e9'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:35.892262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-49487c80-4ecb-4a7e-8375-0da32d6795e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b39bf78701364a34b2110730bdfee792', 'request_id': 'req-49487c80-4ecb-4a7e-8375-0da32d6795e9'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:35.908611 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-49487c80-4ecb-4a7e-8375-0da32d6795e9 admin admin] The token cache is being invalidate because project b39bf78701364a34b2110730bdfee792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:35.909071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-49487c80-4ecb-4a7e-8375-0da32d6795e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:35.909907 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-49487c80-4ecb-4a7e-8375-0da32d6795e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:35.912441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1079/2158] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:35 2022] DELETE /identity/v3/projects/b39bf78701364a34b2110730bdfee792 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:35.918586 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f4550-978c-45ed-9c16-fc51b3b1a746 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:35.918586 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f4550-978c-45ed-9c16-fc51b3b1a746 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:35.918586 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f4550-978c-45ed-9c16-fc51b3b1a746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:35.939622 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-454f4550-978c-45ed-9c16-fc51b3b1a746 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:35.940796 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-454f4550-978c-45ed-9c16-fc51b3b1a746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:35.994682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49487c80-4ecb-4a7e-8375-0da32d6795e9 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:35.996101 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-49487c80-4ecb-4a7e-8375-0da32d6795e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:36.008521 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1080/2159] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:36.016041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20534e63-35de-42ac-b910-f0667a56177c None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:36.016335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20534e63-35de-42ac-b910-f0667a56177c None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:36.016615 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20534e63-35de-42ac-b910-f0667a56177c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:36.038305 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-20534e63-35de-42ac-b910-f0667a56177c None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:36.039450 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-20534e63-35de-42ac-b910-f0667a56177c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:36.044242 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:36.048426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1081/2160] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:36.055292 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20534e63-35de-42ac-b910-f0667a56177c None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:36.062708 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49487c80-4ecb-4a7e-8375-0da32d6795e9 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:36.064938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20534e63-35de-42ac-b910-f0667a56177c None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:36.066791 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e35a98-bb68-441a-bb77-a3250542a36a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:36.067442 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35a98-bb68-441a-bb77-a3250542a36a service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:36.067725 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35a98-bb68-441a-bb77-a3250542a36a service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:36.068004 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e35a98-bb68-441a-bb77-a3250542a36a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:36.069688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e436ce7-2447-4267-a134-f552123a04a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:36.069811 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-55e35a98-bb68-441a-bb77-a3250542a36a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:36.070311 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e436ce7-2447-4267-a134-f552123a04a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:36.070635 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e436ce7-2447-4267-a134-f552123a04a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:36.070918 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e436ce7-2447-4267-a134-f552123a04a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:36.071619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e436ce7-2447-4267-a134-f552123a04a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:50:36.071931 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e436ce7-2447-4267-a134-f552123a04a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:36.073688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e436ce7-2447-4267-a134-f552123a04a8 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:36.090070 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1082/2161] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:50:36.094362 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e436ce7-2447-4267-a134-f552123a04a8 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:36.105299 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e436ce7-2447-4267-a134-f552123a04a8 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:36.112105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b50943-ce4f-4116-8712-90e4a368d245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:36.112971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b50943-ce4f-4116-8712-90e4a368d245 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:36.113299 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b50943-ce4f-4116-8712-90e4a368d245 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:36.113543 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b50943-ce4f-4116-8712-90e4a368d245 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:36.114364 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b50943-ce4f-4116-8712-90e4a368d245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:36.116941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b50943-ce4f-4116-8712-90e4a368d245 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:36.148366 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1083/2162] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:36 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:36.148581 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e35a98-bb68-441a-bb77-a3250542a36a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:36.148682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e35a98-bb68-441a-bb77-a3250542a36a service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:36.149391 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b50943-ce4f-4116-8712-90e4a368d245 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:36.159233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1080/2163] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:35 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:50:36.200088 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:36.217480 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b50943-ce4f-4116-8712-90e4a368d245 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:36.222315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec69e29-55f2-49b2-a489-d281741abab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:36.222965 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec69e29-55f2-49b2-a489-d281741abab0 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:36.223252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec69e29-55f2-49b2-a489-d281741abab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:36.223536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec69e29-55f2-49b2-a489-d281741abab0 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:36.224230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec69e29-55f2-49b2-a489-d281741abab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:36.226703 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec69e29-55f2-49b2-a489-d281741abab0 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:36.248541 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1084/2164] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:36 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:36.252771 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e35a98-bb68-441a-bb77-a3250542a36a service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:36.265248 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e35a98-bb68-441a-bb77-a3250542a36a service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:36.270873 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb8a38-29cb-4dae-a348-1aa210140fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:36.271561 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb8a38-29cb-4dae-a348-1aa210140fdb admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:36.271967 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb8a38-29cb-4dae-a348-1aa210140fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:36.272310 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fb8a38-29cb-4dae-a348-1aa210140fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:36.273077 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb8a38-29cb-4dae-a348-1aa210140fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:36.274848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fb8a38-29cb-4dae-a348-1aa210140fdb admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:36.292771 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1081/2165] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:36.298722 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec69e29-55f2-49b2-a489-d281741abab0 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:36.311385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec69e29-55f2-49b2-a489-d281741abab0 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:36.316335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b30c1-813b-4ffc-995d-98913afe32ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:36.316951 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b30c1-813b-4ffc-995d-98913afe32ee admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:36.317236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b30c1-813b-4ffc-995d-98913afe32ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:36.317545 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b30c1-813b-4ffc-995d-98913afe32ee admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:36.318222 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b30c1-813b-4ffc-995d-98913afe32ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:36.319962 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b30c1-813b-4ffc-995d-98913afe32ee admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:36.333392 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1085/2166] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:36.334537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb8a38-29cb-4dae-a348-1aa210140fdb admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:36.345198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fb8a38-29cb-4dae-a348-1aa210140fdb admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:36.349875 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b02084-63de-4fd7-88f9-23e5059f5ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:36.353135 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b02084-63de-4fd7-88f9-23e5059f5ca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:36.353429 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b02084-63de-4fd7-88f9-23e5059f5ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:36.354146 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b02084-63de-4fd7-88f9-23e5059f5ca3 admin admin] PATH_INFO: `/v3/projects/fa16f8956dbe4fc5b9749994cec8af94/users/05b6a406a6144e44ad8690df107d7f6d/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:36.375605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b02084-63de-4fd7-88f9-23e5059f5ca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa16f8956dbe4fc5b9749994cec8af94, user_id=05b6a406a6144e44ad8690df107d7f6d, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:36.378567 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b02084-63de-4fd7-88f9-23e5059f5ca3 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:36.391082 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1082/2167] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:36 2022] PUT /identity/v3/projects/fa16f8956dbe4fc5b9749994cec8af94/users/05b6a406a6144e44ad8690df107d7f6d/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:36.401689 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8582c9a-ed1e-4826-a0d2-6864a2a8335e None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:36.401924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8582c9a-ed1e-4826-a0d2-6864a2a8335e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:36.402209 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8582c9a-ed1e-4826-a0d2-6864a2a8335e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:36.435130 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-e8582c9a-ed1e-4826-a0d2-6864a2a8335e None None] MFA Rules not processed for user `05b6a406a6144e44ad8690df107d7f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:36.436507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e8582c9a-ed1e-4826-a0d2-6864a2a8335e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:36.511414 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1086/2168] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:36.522961 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b02084-63de-4fd7-88f9-23e5059f5ca3 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:36.524746 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d1b02084-63de-4fd7-88f9-23e5059f5ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:36.590636 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b02084-63de-4fd7-88f9-23e5059f5ca3 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:36.594321 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b384f6-3a27-4f8e-84d3-ed3bfd6a910d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:36.594976 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b384f6-3a27-4f8e-84d3-ed3bfd6a910d service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:36.595254 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b384f6-3a27-4f8e-84d3-ed3bfd6a910d service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:36.595526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b384f6-3a27-4f8e-84d3-ed3bfd6a910d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:36.606539 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b384f6-3a27-4f8e-84d3-ed3bfd6a910d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:36.608271 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b384f6-3a27-4f8e-84d3-ed3bfd6a910d service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:36.616997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1083/2169] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:50:38.219734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8582c9a-ed1e-4826-a0d2-6864a2a8335e None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:38.220856 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e8582c9a-ed1e-4826-a0d2-6864a2a8335e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:38.289326 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8582c9a-ed1e-4826-a0d2-6864a2a8335e None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:38.294748 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5795a-bcae-40ee-9586-56c1e3092bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:38.295390 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5795a-bcae-40ee-9586-56c1e3092bd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:38.295670 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5795a-bcae-40ee-9586-56c1e3092bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:38.295948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5795a-bcae-40ee-9586-56c1e3092bd1 admin admin] PATH_INFO: `/v3/users/fe4c6ad9372d49128121a9f00196c0be` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:38.297132 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5795a-bcae-40ee-9586-56c1e3092bd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe4c6ad9372d49128121a9f00196c0be)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:38.299642 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5795a-bcae-40ee-9586-56c1e3092bd1 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:38.335248 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b384f6-3a27-4f8e-84d3-ed3bfd6a910d service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:38.336664 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-21b384f6-3a27-4f8e-84d3-ed3bfd6a910d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:38.361354 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bcb5795a-bcae-40ee-9586-56c1e3092bd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe4c6ad9372d49128121a9f00196c0be'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:38.361626 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b384f6-3a27-4f8e-84d3-ed3bfd6a910d service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:38.362707 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bcb5795a-bcae-40ee-9586-56c1e3092bd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe4c6ad9372d49128121a9f00196c0be'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:38.369887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f8981-7266-4dab-87f6-0eb1529f0e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:38.370633 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f8981-7266-4dab-87f6-0eb1529f0e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:38.371405 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f8981-7266-4dab-87f6-0eb1529f0e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:38.372231 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f8981-7266-4dab-87f6-0eb1529f0e22 admin admin] PATH_INFO: `/v3/users/3bfd5a1e8a8b470ebf1d69e943737846` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:38.378803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bcb5795a-bcae-40ee-9586-56c1e3092bd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe4c6ad9372d49128121a9f00196c0be'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:38.379634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f8981-7266-4dab-87f6-0eb1529f0e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bfd5a1e8a8b470ebf1d69e943737846)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:38.380863 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:38.382895 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f8981-7266-4dab-87f6-0eb1529f0e22 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:38.402258 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bcb5795a-bcae-40ee-9586-56c1e3092bd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe4c6ad9372d49128121a9f00196c0be'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:38.403038 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bcb5795a-bcae-40ee-9586-56c1e3092bd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe4c6ad9372d49128121a9f00196c0be'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:38.419537 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1087/2170] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:38 2022] DELETE /identity/v3/users/fe4c6ad9372d49128121a9f00196c0be => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:38.424648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20971bf7-0612-43c9-b44b-abffa5a59c1a None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:38.425051 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20971bf7-0612-43c9-b44b-abffa5a59c1a None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:38.425386 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20971bf7-0612-43c9-b44b-abffa5a59c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:38.449390 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1c1f8981-7266-4dab-87f6-0eb1529f0e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bfd5a1e8a8b470ebf1d69e943737846'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:38.450137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1c1f8981-7266-4dab-87f6-0eb1529f0e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bfd5a1e8a8b470ebf1d69e943737846'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:38.450930 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-20971bf7-0612-43c9-b44b-abffa5a59c1a None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:38.452310 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-20971bf7-0612-43c9-b44b-abffa5a59c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:38.455344 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:38.465915 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1c1f8981-7266-4dab-87f6-0eb1529f0e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bfd5a1e8a8b470ebf1d69e943737846'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:38.475990 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1c1f8981-7266-4dab-87f6-0eb1529f0e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bfd5a1e8a8b470ebf1d69e943737846'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:38.486382 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1c1f8981-7266-4dab-87f6-0eb1529f0e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bfd5a1e8a8b470ebf1d69e943737846'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:38.502634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1084/2171] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:38 2022] DELETE /identity/v3/users/3bfd5a1e8a8b470ebf1d69e943737846 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:38.502634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f8981-7266-4dab-87f6-0eb1529f0e22 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:38.502634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-1c1f8981-7266-4dab-87f6-0eb1529f0e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:38.549247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1088/2172] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:38.550863 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362c31f-b515-4fac-878b-e4b8b3191867 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:38.551156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362c31f-b515-4fac-878b-e4b8b3191867 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:38.551437 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c362c31f-b515-4fac-878b-e4b8b3191867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:38.592357 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-c362c31f-b515-4fac-878b-e4b8b3191867 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:38.601252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c362c31f-b515-4fac-878b-e4b8b3191867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:38.609921 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f8981-7266-4dab-87f6-0eb1529f0e22 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:38.617055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1089/2173] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:38.618251 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362c31f-b515-4fac-878b-e4b8b3191867 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:38.620417 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c362c31f-b515-4fac-878b-e4b8b3191867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:38.622139 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bffaa-4eb2-46c5-9c33-7bfd44fee03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:38.622824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bffaa-4eb2-46c5-9c33-7bfd44fee03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:38.623102 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bffaa-4eb2-46c5-9c33-7bfd44fee03d admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:38.623381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bffaa-4eb2-46c5-9c33-7bfd44fee03d admin admin] PATH_INFO: `/v3/users/fccbfcf0cccf4cabae107d5339c89b79` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:38.624570 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405bffaa-4eb2-46c5-9c33-7bfd44fee03d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fccbfcf0cccf4cabae107d5339c89b79)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:38.626614 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405bffaa-4eb2-46c5-9c33-7bfd44fee03d admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:38.691568 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c362c31f-b515-4fac-878b-e4b8b3191867 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:38.693477 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-405bffaa-4eb2-46c5-9c33-7bfd44fee03d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fccbfcf0cccf4cabae107d5339c89b79'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:38.694783 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-405bffaa-4eb2-46c5-9c33-7bfd44fee03d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fccbfcf0cccf4cabae107d5339c89b79'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:38.696700 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1bc8c-92bc-40bc-95d7-8c3a2414d1d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:38.697362 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1bc8c-92bc-40bc-95d7-8c3a2414d1d8 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:38.697872 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1bc8c-92bc-40bc-95d7-8c3a2414d1d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:38.698163 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1bc8c-92bc-40bc-95d7-8c3a2414d1d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:38.708807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1bc8c-92bc-40bc-95d7-8c3a2414d1d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:38.710272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1bc8c-92bc-40bc-95d7-8c3a2414d1d8 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:38.710414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-405bffaa-4eb2-46c5-9c33-7bfd44fee03d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fccbfcf0cccf4cabae107d5339c89b79'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:38.718787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-405bffaa-4eb2-46c5-9c33-7bfd44fee03d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fccbfcf0cccf4cabae107d5339c89b79'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:38.720571 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1090/2174] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:38.723783 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1bc8c-92bc-40bc-95d7-8c3a2414d1d8 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:38.725463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-9bf1bc8c-92bc-40bc-95d7-8c3a2414d1d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:38.730159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-405bffaa-4eb2-46c5-9c33-7bfd44fee03d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fccbfcf0cccf4cabae107d5339c89b79'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:38.741201 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1085/2175] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:38 2022] DELETE /identity/v3/users/fccbfcf0cccf4cabae107d5339c89b79 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:38.745769 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc39cc-6b57-461b-960a-be58d38bdcd8 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:38.746058 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc39cc-6b57-461b-960a-be58d38bdcd8 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:38.746401 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcc39cc-6b57-461b-960a-be58d38bdcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:38.746833 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1bc8c-92bc-40bc-95d7-8c3a2414d1d8 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:38.781971 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-0fcc39cc-6b57-461b-960a-be58d38bdcd8 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:38.783576 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-0fcc39cc-6b57-461b-960a-be58d38bdcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:38.809067 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc680d3-ab46-4055-86f7-c6e0f1de7852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:38.809698 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc680d3-ab46-4055-86f7-c6e0f1de7852 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:38.809991 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc680d3-ab46-4055-86f7-c6e0f1de7852 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:38.810273 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc680d3-ab46-4055-86f7-c6e0f1de7852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:38.812148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5cc680d3-ab46-4055-86f7-c6e0f1de7852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:38.838659 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:38.840522 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:38.859747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1086/2176] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:38.870008 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc39cc-6b57-461b-960a-be58d38bdcd8 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:38.873151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-0fcc39cc-6b57-461b-960a-be58d38bdcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:38.888633 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcc39cc-6b57-461b-960a-be58d38bdcd8 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:38.901299 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64b427-6e55-4714-ae7b-722ee4fd5257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:38.902643 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64b427-6e55-4714-ae7b-722ee4fd5257 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:38.903306 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64b427-6e55-4714-ae7b-722ee4fd5257 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:38.903586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64b427-6e55-4714-ae7b-722ee4fd5257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:38.903950 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc680d3-ab46-4055-86f7-c6e0f1de7852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:38.906236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc680d3-ab46-4055-86f7-c6e0f1de7852 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:38.918253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64b427-6e55-4714-ae7b-722ee4fd5257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:38.918981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1091/2177] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:38.920238 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64b427-6e55-4714-ae7b-722ee4fd5257 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:38.931677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1087/2178] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:50:39.184578 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc680d3-ab46-4055-86f7-c6e0f1de7852 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:39.186916 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5cc680d3-ab46-4055-86f7-c6e0f1de7852 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:39.198748 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc680d3-ab46-4055-86f7-c6e0f1de7852 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:39.203439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc161700-5cfd-40fa-923e-f09c2c65df54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:39.204005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc161700-5cfd-40fa-923e-f09c2c65df54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:39.204284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc161700-5cfd-40fa-923e-f09c2c65df54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:39.204560 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc161700-5cfd-40fa-923e-f09c2c65df54 admin admin] PATH_INFO: `/v3/projects/fa53368497ff461da2474efb7e52484e` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:39.206279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc161700-5cfd-40fa-923e-f09c2c65df54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa53368497ff461da2474efb7e52484e)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:39.207902 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc161700-5cfd-40fa-923e-f09c2c65df54 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:39.284668 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bc161700-5cfd-40fa-923e-f09c2c65df54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa53368497ff461da2474efb7e52484e', 'request_id': 'req-bc161700-5cfd-40fa-923e-f09c2c65df54'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:39.296260 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bc161700-5cfd-40fa-923e-f09c2c65df54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa53368497ff461da2474efb7e52484e', 'request_id': 'req-bc161700-5cfd-40fa-923e-f09c2c65df54'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:39.304474 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bc161700-5cfd-40fa-923e-f09c2c65df54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa53368497ff461da2474efb7e52484e', 'request_id': 'req-bc161700-5cfd-40fa-923e-f09c2c65df54'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:39.319658 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bc161700-5cfd-40fa-923e-f09c2c65df54 admin admin] The token cache is being invalidate because project fa53368497ff461da2474efb7e52484e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:39.319954 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bc161700-5cfd-40fa-923e-f09c2c65df54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:39.320607 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bc161700-5cfd-40fa-923e-f09c2c65df54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:39.322142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1092/2179] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:39 2022] DELETE /identity/v3/projects/fa53368497ff461da2474efb7e52484e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:39.326568 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64b427-6e55-4714-ae7b-722ee4fd5257 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:39.337834 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64b427-6e55-4714-ae7b-722ee4fd5257 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:39.403536 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8897e-bbfe-49dc-a08c-a4a1757e4022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:39.404298 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8897e-bbfe-49dc-a08c-a4a1757e4022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:39.404636 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8897e-bbfe-49dc-a08c-a4a1757e4022 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:39.404919 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8897e-bbfe-49dc-a08c-a4a1757e4022 admin admin] PATH_INFO: `/v3/users/f698c1feec28480cadd5b0aa4b9c1a53` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:39.406183 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8897e-bbfe-49dc-a08c-a4a1757e4022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f698c1feec28480cadd5b0aa4b9c1a53)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:39.408978 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8897e-bbfe-49dc-a08c-a4a1757e4022 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:39.458875 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-42e8897e-bbfe-49dc-a08c-a4a1757e4022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f698c1feec28480cadd5b0aa4b9c1a53'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:39.460281 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-42e8897e-bbfe-49dc-a08c-a4a1757e4022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f698c1feec28480cadd5b0aa4b9c1a53'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:39.475723 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-42e8897e-bbfe-49dc-a08c-a4a1757e4022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f698c1feec28480cadd5b0aa4b9c1a53'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:39.483539 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-42e8897e-bbfe-49dc-a08c-a4a1757e4022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f698c1feec28480cadd5b0aa4b9c1a53'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:39.494981 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-42e8897e-bbfe-49dc-a08c-a4a1757e4022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f698c1feec28480cadd5b0aa4b9c1a53'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:39.505639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1088/2180] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:39 2022] DELETE /identity/v3/users/f698c1feec28480cadd5b0aa4b9c1a53 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:39.522315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc161700-5cfd-40fa-923e-f09c2c65df54 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:39.526160 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-bc161700-5cfd-40fa-923e-f09c2c65df54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:39.526287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8897e-bbfe-49dc-a08c-a4a1757e4022 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:39.527778 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-42e8897e-bbfe-49dc-a08c-a4a1757e4022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:39.544698 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc161700-5cfd-40fa-923e-f09c2c65df54 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:39.628665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:39.633720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8897e-bbfe-49dc-a08c-a4a1757e4022 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:39.638616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459bb0e-dd3e-4dec-bc47-248df960390b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:39.639627 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459bb0e-dd3e-4dec-bc47-248df960390b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:39.640097 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459bb0e-dd3e-4dec-bc47-248df960390b admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:39.640614 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7459bb0e-dd3e-4dec-bc47-248df960390b admin admin] PATH_INFO: `/v3/projects/e5d53111c2c54c2d9c7f33061d1afdf4` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:39.641993 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459bb0e-dd3e-4dec-bc47-248df960390b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d53111c2c54c2d9c7f33061d1afdf4)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:39.643248 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83178e59-17b2-4e53-9baa-9bb55c02a1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:39.644670 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7459bb0e-dd3e-4dec-bc47-248df960390b admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:39.645103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83178e59-17b2-4e53-9baa-9bb55c02a1df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:39.645583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83178e59-17b2-4e53-9baa-9bb55c02a1df admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:39.646079 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83178e59-17b2-4e53-9baa-9bb55c02a1df admin admin] PATH_INFO: `/v3/projects/2f1a7f6453434379b459138112f5a61b` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:39.648782 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83178e59-17b2-4e53-9baa-9bb55c02a1df admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f1a7f6453434379b459138112f5a61b)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:39.652089 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83178e59-17b2-4e53-9baa-9bb55c02a1df admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:39.710284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:39.717598 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7459bb0e-dd3e-4dec-bc47-248df960390b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d53111c2c54c2d9c7f33061d1afdf4', 'request_id': 'req-7459bb0e-dd3e-4dec-bc47-248df960390b'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:39.730143 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7459bb0e-dd3e-4dec-bc47-248df960390b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d53111c2c54c2d9c7f33061d1afdf4', 'request_id': 'req-7459bb0e-dd3e-4dec-bc47-248df960390b'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:39.743606 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7459bb0e-dd3e-4dec-bc47-248df960390b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d53111c2c54c2d9c7f33061d1afdf4', 'request_id': 'req-7459bb0e-dd3e-4dec-bc47-248df960390b'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:39.747896 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-83178e59-17b2-4e53-9baa-9bb55c02a1df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f1a7f6453434379b459138112f5a61b', 'request_id': 'req-83178e59-17b2-4e53-9baa-9bb55c02a1df'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:39.758969 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-83178e59-17b2-4e53-9baa-9bb55c02a1df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f1a7f6453434379b459138112f5a61b', 'request_id': 'req-83178e59-17b2-4e53-9baa-9bb55c02a1df'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:39.761308 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7459bb0e-dd3e-4dec-bc47-248df960390b admin admin] The token cache is being invalidate because project e5d53111c2c54c2d9c7f33061d1afdf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:39.761716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7459bb0e-dd3e-4dec-bc47-248df960390b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:39.763385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7459bb0e-dd3e-4dec-bc47-248df960390b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:39.771571 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1093/2181] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:39 2022] DELETE /identity/v3/projects/e5d53111c2c54c2d9c7f33061d1afdf4 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:39.771571 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459bb0e-dd3e-4dec-bc47-248df960390b admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:39.771571 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-7459bb0e-dd3e-4dec-bc47-248df960390b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:39.786784 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-83178e59-17b2-4e53-9baa-9bb55c02a1df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f1a7f6453434379b459138112f5a61b', 'request_id': 'req-83178e59-17b2-4e53-9baa-9bb55c02a1df'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:39.807886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-83178e59-17b2-4e53-9baa-9bb55c02a1df admin admin] The token cache is being invalidate because project 2f1a7f6453434379b459138112f5a61b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:39.808190 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-83178e59-17b2-4e53-9baa-9bb55c02a1df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:39.808996 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-83178e59-17b2-4e53-9baa-9bb55c02a1df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:39.815035 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1089/2182] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:39 2022] DELETE /identity/v3/projects/2f1a7f6453434379b459138112f5a61b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:39.815980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42f8ce-948a-4a72-83b6-cd2dc6537cf6 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:39.816268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42f8ce-948a-4a72-83b6-cd2dc6537cf6 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:39.816549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42f8ce-948a-4a72-83b6-cd2dc6537cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:39.857944 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-bc42f8ce-948a-4a72-83b6-cd2dc6537cf6 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:39.860654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-bc42f8ce-948a-4a72-83b6-cd2dc6537cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:39.907013 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7459bb0e-dd3e-4dec-bc47-248df960390b admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:39.978923 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1090/2183] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:39.989905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755caa53-f77a-4879-8f6b-0f0d17b79860 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:39.990779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755caa53-f77a-4879-8f6b-0f0d17b79860 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:39.991301 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755caa53-f77a-4879-8f6b-0f0d17b79860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:40.022990 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae98711-dd00-48bb-b353-dfaa3e8a0899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:40.023748 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae98711-dd00-48bb-b353-dfaa3e8a0899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:40.024674 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae98711-dd00-48bb-b353-dfaa3e8a0899 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:40.024911 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-755caa53-f77a-4879-8f6b-0f0d17b79860 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:40.025026 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae98711-dd00-48bb-b353-dfaa3e8a0899 admin admin] PATH_INFO: `/v3/users/db75a32fe79c42a4aa4c4678f023ae41` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:40.026322 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-755caa53-f77a-4879-8f6b-0f0d17b79860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:40.026820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae98711-dd00-48bb-b353-dfaa3e8a0899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db75a32fe79c42a4aa4c4678f023ae41)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:40.029433 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae98711-dd00-48bb-b353-dfaa3e8a0899 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:40.041027 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1091/2184] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:40.045301 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755caa53-f77a-4879-8f6b-0f0d17b79860 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:40.064477 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755caa53-f77a-4879-8f6b-0f0d17b79860 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:40.078733 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf865b-6029-4fe2-b8bb-868dda6ed206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:40.079613 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf865b-6029-4fe2-b8bb-868dda6ed206 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:40.079932 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf865b-6029-4fe2-b8bb-868dda6ed206 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:40.080284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf865b-6029-4fe2-b8bb-868dda6ed206 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:40.081385 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf865b-6029-4fe2-b8bb-868dda6ed206 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:50:40.081385 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf865b-6029-4fe2-b8bb-868dda6ed206 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:40.083488 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf865b-6029-4fe2-b8bb-868dda6ed206 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:40.108140 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-aae98711-dd00-48bb-b353-dfaa3e8a0899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db75a32fe79c42a4aa4c4678f023ae41'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:40.113840 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1092/2185] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:50:40.118208 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-aae98711-dd00-48bb-b353-dfaa3e8a0899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db75a32fe79c42a4aa4c4678f023ae41'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:40.118770 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf865b-6029-4fe2-b8bb-868dda6ed206 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:40.155413 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-aae98711-dd00-48bb-b353-dfaa3e8a0899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db75a32fe79c42a4aa4c4678f023ae41'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:40.177197 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf865b-6029-4fe2-b8bb-868dda6ed206 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:40.182131 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-aae98711-dd00-48bb-b353-dfaa3e8a0899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db75a32fe79c42a4aa4c4678f023ae41'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:40.186394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90e1f0-6780-4c08-be32-c9610adfb978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:40.187272 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90e1f0-6780-4c08-be32-c9610adfb978 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:40.187568 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90e1f0-6780-4c08-be32-c9610adfb978 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:40.188247 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea90e1f0-6780-4c08-be32-c9610adfb978 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:40.189082 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90e1f0-6780-4c08-be32-c9610adfb978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:40.193164 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea90e1f0-6780-4c08-be32-c9610adfb978 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:40.197348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-aae98711-dd00-48bb-b353-dfaa3e8a0899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db75a32fe79c42a4aa4c4678f023ae41'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:40.226484 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:40.232329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1094/2186] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:39 2022] DELETE /identity/v3/users/db75a32fe79c42a4aa4c4678f023ae41 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:40.233349 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae98711-dd00-48bb-b353-dfaa3e8a0899 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:40.249753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-aae98711-dd00-48bb-b353-dfaa3e8a0899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:40.265283 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1093/2187] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:40 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:40.269353 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90e1f0-6780-4c08-be32-c9610adfb978 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:40.271039 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ea90e1f0-6780-4c08-be32-c9610adfb978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:40.341131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:40.367891 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea90e1f0-6780-4c08-be32-c9610adfb978 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:40.378201 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360adb7-741f-40e2-98e9-b104fd9b67b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:40.379477 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360adb7-741f-40e2-98e9-b104fd9b67b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:40.379477 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360adb7-741f-40e2-98e9-b104fd9b67b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:40.379871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360adb7-741f-40e2-98e9-b104fd9b67b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:40.380653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360adb7-741f-40e2-98e9-b104fd9b67b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:40.385053 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360adb7-741f-40e2-98e9-b104fd9b67b0 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:40.402907 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae98711-dd00-48bb-b353-dfaa3e8a0899 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:40.413902 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a813e6-fc0f-4c27-840f-c50a5442f841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:40.415513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a813e6-fc0f-4c27-840f-c50a5442f841 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:40.416019 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a813e6-fc0f-4c27-840f-c50a5442f841 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:40.416372 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a813e6-fc0f-4c27-840f-c50a5442f841 admin admin] PATH_INFO: `/v3/projects/ea42d2c4225e41ae880496e9289fcecb` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:40.418084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a813e6-fc0f-4c27-840f-c50a5442f841 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea42d2c4225e41ae880496e9289fcecb)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:40.420542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a813e6-fc0f-4c27-840f-c50a5442f841 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:40.427878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1094/2188] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:40 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:40.429930 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360adb7-741f-40e2-98e9-b104fd9b67b0 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:40.448346 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360adb7-741f-40e2-98e9-b104fd9b67b0 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:40.462592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828f476-1fdf-413a-acc6-f435332a3fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:40.463546 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828f476-1fdf-413a-acc6-f435332a3fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:40.464647 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828f476-1fdf-413a-acc6-f435332a3fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:40.465301 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828f476-1fdf-413a-acc6-f435332a3fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:40.467208 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828f476-1fdf-413a-acc6-f435332a3fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:40.471459 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828f476-1fdf-413a-acc6-f435332a3fb7 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:40.500573 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1095/2189] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:40.504624 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828f476-1fdf-413a-acc6-f435332a3fb7 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:40.509252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d1a813e6-fc0f-4c27-840f-c50a5442f841 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea42d2c4225e41ae880496e9289fcecb', 'request_id': 'req-d1a813e6-fc0f-4c27-840f-c50a5442f841'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:40.518859 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d1a813e6-fc0f-4c27-840f-c50a5442f841 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea42d2c4225e41ae880496e9289fcecb', 'request_id': 'req-d1a813e6-fc0f-4c27-840f-c50a5442f841'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:40.519077 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828f476-1fdf-413a-acc6-f435332a3fb7 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:40.531525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d1a813e6-fc0f-4c27-840f-c50a5442f841 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea42d2c4225e41ae880496e9289fcecb', 'request_id': 'req-d1a813e6-fc0f-4c27-840f-c50a5442f841'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:40.561668 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d1a813e6-fc0f-4c27-840f-c50a5442f841 admin admin] The token cache is being invalidate because project ea42d2c4225e41ae880496e9289fcecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:40.562716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d1a813e6-fc0f-4c27-840f-c50a5442f841 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:40.563937 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d1a813e6-fc0f-4c27-840f-c50a5442f841 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:40.570580 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1095/2190] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:40 2022] DELETE /identity/v3/projects/ea42d2c4225e41ae880496e9289fcecb => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:40.580341 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a813e6-fc0f-4c27-840f-c50a5442f841 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:40.589140 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d1a813e6-fc0f-4c27-840f-c50a5442f841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:40.659101 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a20c1c-74bd-47ec-ab9e-3106b45c7ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:40.659785 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a20c1c-74bd-47ec-ab9e-3106b45c7ace admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:40.660071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a20c1c-74bd-47ec-ab9e-3106b45c7ace admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:40.660353 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a20c1c-74bd-47ec-ab9e-3106b45c7ace admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:40.661063 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a20c1c-74bd-47ec-ab9e-3106b45c7ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:40.664173 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a20c1c-74bd-47ec-ab9e-3106b45c7ace admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:40.689809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1096/2191] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:40 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:40.691058 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a20c1c-74bd-47ec-ab9e-3106b45c7ace admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:40.693349 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-90a20c1c-74bd-47ec-ab9e-3106b45c7ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:40.694662 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a813e6-fc0f-4c27-840f-c50a5442f841 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:40.699454 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de5adb-393a-45e7-9167-af4a6b22b9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:40.700188 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de5adb-393a-45e7-9167-af4a6b22b9ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:40.700546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de5adb-393a-45e7-9167-af4a6b22b9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:40.700897 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de5adb-393a-45e7-9167-af4a6b22b9ad admin admin] PATH_INFO: `/v3/users/9433fabfe20c414ebb4e785ee80d4b82` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:40.702195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de5adb-393a-45e7-9167-af4a6b22b9ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=9433fabfe20c414ebb4e785ee80d4b82)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:40.704245 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de5adb-393a-45e7-9167-af4a6b22b9ad admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:40.707871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a20c1c-74bd-47ec-ab9e-3106b45c7ace admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:40.718304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30166328-f390-446f-977a-4bc8d0a0bdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:40.719066 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30166328-f390-446f-977a-4bc8d0a0bdf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:40.719482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30166328-f390-446f-977a-4bc8d0a0bdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:40.719764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30166328-f390-446f-977a-4bc8d0a0bdf2 admin admin] PATH_INFO: `/v3/projects/fb68a0bb23d544a9a7848a2d4404aa55/users/3c93163f814e44728d7778ff6b6fd727/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:40.737395 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30166328-f390-446f-977a-4bc8d0a0bdf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb68a0bb23d544a9a7848a2d4404aa55, user_id=3c93163f814e44728d7778ff6b6fd727, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:40.741210 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30166328-f390-446f-977a-4bc8d0a0bdf2 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:40.749387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:40.762401 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1097/2192] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:40 2022] PUT /identity/v3/projects/fb68a0bb23d544a9a7848a2d4404aa55/users/3c93163f814e44728d7778ff6b6fd727/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:40.769904 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-03de5adb-393a-45e7-9167-af4a6b22b9ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9433fabfe20c414ebb4e785ee80d4b82'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:40.770613 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-03de5adb-393a-45e7-9167-af4a6b22b9ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9433fabfe20c414ebb4e785ee80d4b82'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:40.773398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574cdea-758a-4abe-8c47-e8f62469ec17 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:40.773690 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574cdea-758a-4abe-8c47-e8f62469ec17 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:40.773972 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574cdea-758a-4abe-8c47-e8f62469ec17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:40.782275 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-03de5adb-393a-45e7-9167-af4a6b22b9ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9433fabfe20c414ebb4e785ee80d4b82'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:40.798128 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-03de5adb-393a-45e7-9167-af4a6b22b9ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9433fabfe20c414ebb4e785ee80d4b82'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:40.798892 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-03de5adb-393a-45e7-9167-af4a6b22b9ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9433fabfe20c414ebb4e785ee80d4b82'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:40.808824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-f574cdea-758a-4abe-8c47-e8f62469ec17 None None] MFA Rules not processed for user `3c93163f814e44728d7778ff6b6fd727`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:40.810230 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-f574cdea-758a-4abe-8c47-e8f62469ec17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:40.814094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1096/2193] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:40 2022] DELETE /identity/v3/users/9433fabfe20c414ebb4e785ee80d4b82 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:40.817134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de5adb-393a-45e7-9167-af4a6b22b9ad admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:40.817134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-03de5adb-393a-45e7-9167-af4a6b22b9ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:40.899012 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1098/2194] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:40.902959 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de5adb-393a-45e7-9167-af4a6b22b9ad admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:40.911519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574cdea-758a-4abe-8c47-e8f62469ec17 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:40.913661 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-f574cdea-758a-4abe-8c47-e8f62469ec17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:40.915650 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395124c-c151-47dd-9c4c-b6cf2a595eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:40.916313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395124c-c151-47dd-9c4c-b6cf2a595eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:40.916602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395124c-c151-47dd-9c4c-b6cf2a595eab admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:40.916886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1395124c-c151-47dd-9c4c-b6cf2a595eab admin admin] PATH_INFO: `/v3/projects/7ba64ced13cf466c85e3dea3ae48e4af` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:40.918061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395124c-c151-47dd-9c4c-b6cf2a595eab admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ba64ced13cf466c85e3dea3ae48e4af)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:40.920065 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1395124c-c151-47dd-9c4c-b6cf2a595eab admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:40.953388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:40.979786 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1395124c-c151-47dd-9c4c-b6cf2a595eab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba64ced13cf466c85e3dea3ae48e4af', 'request_id': 'req-1395124c-c151-47dd-9c4c-b6cf2a595eab'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:40.994953 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1395124c-c151-47dd-9c4c-b6cf2a595eab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba64ced13cf466c85e3dea3ae48e4af', 'request_id': 'req-1395124c-c151-47dd-9c4c-b6cf2a595eab'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:40.995865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574cdea-758a-4abe-8c47-e8f62469ec17 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:41.005497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1395124c-c151-47dd-9c4c-b6cf2a595eab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba64ced13cf466c85e3dea3ae48e4af', 'request_id': 'req-1395124c-c151-47dd-9c4c-b6cf2a595eab'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:41.023375 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1395124c-c151-47dd-9c4c-b6cf2a595eab admin admin] The token cache is being invalidate because project 7ba64ced13cf466c85e3dea3ae48e4af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:41.023723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1395124c-c151-47dd-9c4c-b6cf2a595eab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:41.024604 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1395124c-c151-47dd-9c4c-b6cf2a595eab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:41.026700 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1097/2195] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:40 2022] DELETE /identity/v3/projects/7ba64ced13cf466c85e3dea3ae48e4af => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:41.030546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395124c-c151-47dd-9c4c-b6cf2a595eab admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:41.032149 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-1395124c-c151-47dd-9c4c-b6cf2a595eab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:41.078969 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd182fdb-9a73-4508-b118-3edd48a4caa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:41.079603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd182fdb-9a73-4508-b118-3edd48a4caa0 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:41.079891 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd182fdb-9a73-4508-b118-3edd48a4caa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:41.080170 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd182fdb-9a73-4508-b118-3edd48a4caa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:41.082374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-fd182fdb-9a73-4508-b118-3edd48a4caa0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:41.086203 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:41.130529 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1395124c-c151-47dd-9c4c-b6cf2a595eab admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:41.136138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510982d-a016-484f-ac0f-eabd03f3a6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:41.136988 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510982d-a016-484f-ac0f-eabd03f3a6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:41.137297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510982d-a016-484f-ac0f-eabd03f3a6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:41.137610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510982d-a016-484f-ac0f-eabd03f3a6f3 admin admin] PATH_INFO: `/v3/users/52e17dc2839845a3b141c87e5e7f1456` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:41.138968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510982d-a016-484f-ac0f-eabd03f3a6f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e17dc2839845a3b141c87e5e7f1456)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:41.141047 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510982d-a016-484f-ac0f-eabd03f3a6f3 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:41.187227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd182fdb-9a73-4508-b118-3edd48a4caa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:41.189145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd182fdb-9a73-4508-b118-3edd48a4caa0 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:41.201650 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1099/2196] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:41.202573 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd182fdb-9a73-4508-b118-3edd48a4caa0 service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:41.204097 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-fd182fdb-9a73-4508-b118-3edd48a4caa0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:41.223837 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd182fdb-9a73-4508-b118-3edd48a4caa0 service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:41.230479 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4fb9e7-9de0-40a6-8a24-de3b1f9f1d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:41.231460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fb9e7-9de0-40a6-8a24-de3b1f9f1d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:41.232460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fb9e7-9de0-40a6-8a24-de3b1f9f1d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:41.233370 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4fb9e7-9de0-40a6-8a24-de3b1f9f1d5c admin admin] PATH_INFO: `/v3/projects/f0af8fce9c404a9086518d05f4524274` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:41.235915 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fb9e7-9de0-40a6-8a24-de3b1f9f1d5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0af8fce9c404a9086518d05f4524274)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:41.238916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4fb9e7-9de0-40a6-8a24-de3b1f9f1d5c admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:41.242379 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1510982d-a016-484f-ac0f-eabd03f3a6f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e17dc2839845a3b141c87e5e7f1456'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:41.243198 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1510982d-a016-484f-ac0f-eabd03f3a6f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e17dc2839845a3b141c87e5e7f1456'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:41.256317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1510982d-a016-484f-ac0f-eabd03f3a6f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e17dc2839845a3b141c87e5e7f1456'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:41.278918 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1510982d-a016-484f-ac0f-eabd03f3a6f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e17dc2839845a3b141c87e5e7f1456'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:41.279672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1510982d-a016-484f-ac0f-eabd03f3a6f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e17dc2839845a3b141c87e5e7f1456'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:41.296917 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1098/2197] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:41 2022] DELETE /identity/v3/users/52e17dc2839845a3b141c87e5e7f1456 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:41.307482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7a4fb9e7-9de0-40a6-8a24-de3b1f9f1d5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0af8fce9c404a9086518d05f4524274', 'request_id': 'req-7a4fb9e7-9de0-40a6-8a24-de3b1f9f1d5c'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:41.314317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7a4fb9e7-9de0-40a6-8a24-de3b1f9f1d5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0af8fce9c404a9086518d05f4524274', 'request_id': 'req-7a4fb9e7-9de0-40a6-8a24-de3b1f9f1d5c'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:41.332399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7a4fb9e7-9de0-40a6-8a24-de3b1f9f1d5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0af8fce9c404a9086518d05f4524274', 'request_id': 'req-7a4fb9e7-9de0-40a6-8a24-de3b1f9f1d5c'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:41.353790 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7a4fb9e7-9de0-40a6-8a24-de3b1f9f1d5c admin admin] The token cache is being invalidate because project f0af8fce9c404a9086518d05f4524274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:41.354415 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7a4fb9e7-9de0-40a6-8a24-de3b1f9f1d5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:41.355315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7a4fb9e7-9de0-40a6-8a24-de3b1f9f1d5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:41.357539 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1100/2198] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:41 2022] DELETE /identity/v3/projects/f0af8fce9c404a9086518d05f4524274 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:41.363230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64467082-a90e-4b41-a701-9d174db7e6f0 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:41.363653 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64467082-a90e-4b41-a701-9d174db7e6f0 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:41.364526 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64467082-a90e-4b41-a701-9d174db7e6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:41.399328 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-64467082-a90e-4b41-a701-9d174db7e6f0 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:41.401525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-64467082-a90e-4b41-a701-9d174db7e6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:41.534448 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1099/2199] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:41.540551 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49780c-ee8f-4fcf-a563-54fd5a1d8d9f None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:41.541029 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49780c-ee8f-4fcf-a563-54fd5a1d8d9f None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:41.541145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49780c-ee8f-4fcf-a563-54fd5a1d8d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:41.564794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-2b49780c-ee8f-4fcf-a563-54fd5a1d8d9f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:41.566550 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-2b49780c-ee8f-4fcf-a563-54fd5a1d8d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:41.578246 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1101/2200] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:41.582909 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64467082-a90e-4b41-a701-9d174db7e6f0 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:41.604679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64467082-a90e-4b41-a701-9d174db7e6f0 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:41.611434 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5158794-a46d-4da2-9df6-6b4f9d9b60a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:41.612170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5158794-a46d-4da2-9df6-6b4f9d9b60a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:41.612533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5158794-a46d-4da2-9df6-6b4f9d9b60a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:41.612908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5158794-a46d-4da2-9df6-6b4f9d9b60a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:41.613781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5158794-a46d-4da2-9df6-6b4f9d9b60a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:50:41.614314 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5158794-a46d-4da2-9df6-6b4f9d9b60a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:41.616140 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5158794-a46d-4da2-9df6-6b4f9d9b60a0 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:41.648743 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1100/2201] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:50:41.653463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49780c-ee8f-4fcf-a563-54fd5a1d8d9f None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:41.667529 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49780c-ee8f-4fcf-a563-54fd5a1d8d9f None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:41.677071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d20b6-4adf-4618-a643-96c281331a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:41.678864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d20b6-4adf-4618-a643-96c281331a13 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:41.681093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d20b6-4adf-4618-a643-96c281331a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:41.681634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d20b6-4adf-4618-a643-96c281331a13 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:41.682806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d20b6-4adf-4618-a643-96c281331a13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:41.686838 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454d20b6-4adf-4618-a643-96c281331a13 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:41.694883 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5158794-a46d-4da2-9df6-6b4f9d9b60a0 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:41.699738 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d5158794-a46d-4da2-9df6-6b4f9d9b60a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:41.703104 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:41.742381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1102/2202] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:41 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:41.743689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d20b6-4adf-4618-a643-96c281331a13 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:41.747831 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5158794-a46d-4da2-9df6-6b4f9d9b60a0 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:41.819322 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:41.839317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884c590-fea6-4be0-bc8c-23a2754e81f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:41.839986 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884c590-fea6-4be0-bc8c-23a2754e81f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:41.840548 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884c590-fea6-4be0-bc8c-23a2754e81f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:41.840835 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884c590-fea6-4be0-bc8c-23a2754e81f4 admin admin] PATH_INFO: `/v3/projects/d84c3422fa37448ab9f1a5360186f0f2` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:41.842039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884c590-fea6-4be0-bc8c-23a2754e81f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84c3422fa37448ab9f1a5360186f0f2)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:41.843397 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454d20b6-4adf-4618-a643-96c281331a13 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:41.844506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884c590-fea6-4be0-bc8c-23a2754e81f4 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:41.849481 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71001e-35f2-4e7d-a9e4-7bfbd423f62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:41.850454 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71001e-35f2-4e7d-a9e4-7bfbd423f62a admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:41.851272 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71001e-35f2-4e7d-a9e4-7bfbd423f62a admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:41.852331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71001e-35f2-4e7d-a9e4-7bfbd423f62a admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:41.853192 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71001e-35f2-4e7d-a9e4-7bfbd423f62a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:41.856789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71001e-35f2-4e7d-a9e4-7bfbd423f62a admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:41.893807 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1103/2203] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:41 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:41.898690 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71001e-35f2-4e7d-a9e4-7bfbd423f62a admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:41.911676 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71001e-35f2-4e7d-a9e4-7bfbd423f62a admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:41.918650 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-8884c590-fea6-4be0-bc8c-23a2754e81f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84c3422fa37448ab9f1a5360186f0f2', 'request_id': 'req-8884c590-fea6-4be0-bc8c-23a2754e81f4'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:41.926438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-8884c590-fea6-4be0-bc8c-23a2754e81f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84c3422fa37448ab9f1a5360186f0f2', 'request_id': 'req-8884c590-fea6-4be0-bc8c-23a2754e81f4'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:41.934714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-8884c590-fea6-4be0-bc8c-23a2754e81f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84c3422fa37448ab9f1a5360186f0f2', 'request_id': 'req-8884c590-fea6-4be0-bc8c-23a2754e81f4'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:41.955988 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-8884c590-fea6-4be0-bc8c-23a2754e81f4 admin admin] The token cache is being invalidate because project d84c3422fa37448ab9f1a5360186f0f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:41.956145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-8884c590-fea6-4be0-bc8c-23a2754e81f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:41.957472 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-8884c590-fea6-4be0-bc8c-23a2754e81f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:41.959839 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1101/2204] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:41 2022] DELETE /identity/v3/projects/d84c3422fa37448ab9f1a5360186f0f2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:41.972768 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2f718-c589-4f17-a7e0-d0263e14e6f0 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:41.972768 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2f718-c589-4f17-a7e0-d0263e14e6f0 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:41.972768 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2f718-c589-4f17-a7e0-d0263e14e6f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:41.994793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-89e2f718-c589-4f17-a7e0-d0263e14e6f0 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:41.996238 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-89e2f718-c589-4f17-a7e0-d0263e14e6f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:42.016259 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926332c-1c87-4ddb-9c8a-dd4636621da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:42.017129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926332c-1c87-4ddb-9c8a-dd4636621da9 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:42.017640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926332c-1c87-4ddb-9c8a-dd4636621da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:42.018035 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8926332c-1c87-4ddb-9c8a-dd4636621da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:42.018906 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926332c-1c87-4ddb-9c8a-dd4636621da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:42.021718 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8926332c-1c87-4ddb-9c8a-dd4636621da9 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:42.041268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1104/2205] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:41 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:42.042545 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926332c-1c87-4ddb-9c8a-dd4636621da9 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:42.044177 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8926332c-1c87-4ddb-9c8a-dd4636621da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:42.058450 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8926332c-1c87-4ddb-9c8a-dd4636621da9 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:42.063485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62db2f-9094-4127-862c-2ca98c415380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:42.063999 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62db2f-9094-4127-862c-2ca98c415380 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:42.064315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62db2f-9094-4127-862c-2ca98c415380 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:42.064563 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce62db2f-9094-4127-862c-2ca98c415380 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:42.065257 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62db2f-9094-4127-862c-2ca98c415380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:42.066950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce62db2f-9094-4127-862c-2ca98c415380 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:42.071679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1102/2206] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:42.079806 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88b254-b773-45a4-8c4b-7136a7556413 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:42.080073 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88b254-b773-45a4-8c4b-7136a7556413 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:42.080213 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1105/2207] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:42.080480 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a88b254-b773-45a4-8c4b-7136a7556413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:42.090667 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62db2f-9094-4127-862c-2ca98c415380 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:42.102668 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-5a88b254-b773-45a4-8c4b-7136a7556413 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:42.103925 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5a88b254-b773-45a4-8c4b-7136a7556413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:42.104863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce62db2f-9094-4127-862c-2ca98c415380 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:42.109706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23d4980-2743-43be-bc64-4fe60547ae4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:42.110472 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d4980-2743-43be-bc64-4fe60547ae4c admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:42.110774 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d4980-2743-43be-bc64-4fe60547ae4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:42.111129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23d4980-2743-43be-bc64-4fe60547ae4c admin admin] PATH_INFO: `/v3/projects/3b6e8d888bc84ad9911249e990a50d67/users/5b1e09a2671c433c8562763ca83c4596/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:42.112292 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1103/2208] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:42.116926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88b254-b773-45a4-8c4b-7136a7556413 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:42.126269 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a88b254-b773-45a4-8c4b-7136a7556413 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:42.130272 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d4980-2743-43be-bc64-4fe60547ae4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b6e8d888bc84ad9911249e990a50d67, user_id=5b1e09a2671c433c8562763ca83c4596, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:42.131088 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1948a3-c045-4185-aa57-53cceb655ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:42.131724 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1948a3-c045-4185-aa57-53cceb655ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:42.132004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1948a3-c045-4185-aa57-53cceb655ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:42.132275 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1948a3-c045-4185-aa57-53cceb655ba2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:42.132969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1948a3-c045-4185-aa57-53cceb655ba2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:50:42.133271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1948a3-c045-4185-aa57-53cceb655ba2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:42.133508 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23d4980-2743-43be-bc64-4fe60547ae4c admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:42.134872 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1948a3-c045-4185-aa57-53cceb655ba2 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:42.148533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1104/2209] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:50:42.149884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1106/2210] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:42 2022] PUT /identity/v3/projects/3b6e8d888bc84ad9911249e990a50d67/users/5b1e09a2671c433c8562763ca83c4596/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:42.155261 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1948a3-c045-4185-aa57-53cceb655ba2 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:42.155422 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36fec5-3e81-4fbb-92e9-cecf18f826aa None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:42.155422 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36fec5-3e81-4fbb-92e9-cecf18f826aa None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:42.155422 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd36fec5-3e81-4fbb-92e9-cecf18f826aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:42.166550 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1948a3-c045-4185-aa57-53cceb655ba2 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:42.175101 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-cd36fec5-3e81-4fbb-92e9-cecf18f826aa None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:42.176308 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-cd36fec5-3e81-4fbb-92e9-cecf18f826aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:42.217146 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:42.227713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:42.236841 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216227ea-9432-4f0b-af14-da84d320d05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:42.237568 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216227ea-9432-4f0b-af14-da84d320d05d admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:42.238426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216227ea-9432-4f0b-af14-da84d320d05d admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:42.238801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216227ea-9432-4f0b-af14-da84d320d05d admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:42.240454 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216227ea-9432-4f0b-af14-da84d320d05d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:42.243680 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216227ea-9432-4f0b-af14-da84d320d05d admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:42.248601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1107/2211] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:42.258234 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36fec5-3e81-4fbb-92e9-cecf18f826aa None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:42.259650 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-cd36fec5-3e81-4fbb-92e9-cecf18f826aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:42.282431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1105/2212] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:42 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:42.286880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216227ea-9432-4f0b-af14-da84d320d05d admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:42.322316 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd36fec5-3e81-4fbb-92e9-cecf18f826aa None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:42.362030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216227ea-9432-4f0b-af14-da84d320d05d admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:42.367772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a1e15-dd70-4bd5-ba08-a3c90153d8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:42.368545 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a1e15-dd70-4bd5-ba08-a3c90153d8b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:42.370687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a1e15-dd70-4bd5-ba08-a3c90153d8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:42.370687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77a1e15-dd70-4bd5-ba08-a3c90153d8b0 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:42.370687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a1e15-dd70-4bd5-ba08-a3c90153d8b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:42.372464 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77a1e15-dd70-4bd5-ba08-a3c90153d8b0 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:42.377035 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd58e7-c700-4753-9e0c-0ac60d7dcada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:42.377035 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd58e7-c700-4753-9e0c-0ac60d7dcada service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:42.377035 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd58e7-c700-4753-9e0c-0ac60d7dcada service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:42.377035 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd58e7-c700-4753-9e0c-0ac60d7dcada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:42.397446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd58e7-c700-4753-9e0c-0ac60d7dcada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:42.399405 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd58e7-c700-4753-9e0c-0ac60d7dcada service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:42.409902 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1106/2213] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:42 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:42.410726 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1108/2214] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:42.415377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a1e15-dd70-4bd5-ba08-a3c90153d8b0 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:42.431345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77a1e15-dd70-4bd5-ba08-a3c90153d8b0 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:42.436518 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26989964-4258-4a1f-ad11-8d480f73fb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:42.437321 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26989964-4258-4a1f-ad11-8d480f73fb80 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:42.437732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26989964-4258-4a1f-ad11-8d480f73fb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:42.438081 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26989964-4258-4a1f-ad11-8d480f73fb80 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:42.439297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26989964-4258-4a1f-ad11-8d480f73fb80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:42.440721 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26989964-4258-4a1f-ad11-8d480f73fb80 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:42.462218 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1107/2215] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:42.467270 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd58e7-c700-4753-9e0c-0ac60d7dcada service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:42.481861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd58e7-c700-4753-9e0c-0ac60d7dcada service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:42.491267 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5179a33-4e16-4dee-bb3b-652091a9b466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:42.492539 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5179a33-4e16-4dee-bb3b-652091a9b466 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:42.492984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5179a33-4e16-4dee-bb3b-652091a9b466 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:42.493338 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5179a33-4e16-4dee-bb3b-652091a9b466 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:42.494722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5179a33-4e16-4dee-bb3b-652091a9b466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:42.497233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5179a33-4e16-4dee-bb3b-652091a9b466 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:42.515611 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1109/2216] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:42.520832 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26989964-4258-4a1f-ad11-8d480f73fb80 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:42.534429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26989964-4258-4a1f-ad11-8d480f73fb80 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:42.541840 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f724a27-af91-4b98-9dc7-8ce2e00f071e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:42.543055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724a27-af91-4b98-9dc7-8ce2e00f071e admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:42.543407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724a27-af91-4b98-9dc7-8ce2e00f071e admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:42.544054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f724a27-af91-4b98-9dc7-8ce2e00f071e admin admin] PATH_INFO: `/v3/projects/f38aa8cac01344aabaf626198f43b3ce/users/2c902e596ae24613865448cf0ee05210/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:42.567999 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f724a27-af91-4b98-9dc7-8ce2e00f071e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f38aa8cac01344aabaf626198f43b3ce, user_id=2c902e596ae24613865448cf0ee05210, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:42.571941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f724a27-af91-4b98-9dc7-8ce2e00f071e admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:42.604580 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1108/2217] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:42 2022] PUT /identity/v3/projects/f38aa8cac01344aabaf626198f43b3ce/users/2c902e596ae24613865448cf0ee05210/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:42.683936 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04bd69-9a1f-493e-b1f5-2b64d3fa67c4 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:42.684527 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04bd69-9a1f-493e-b1f5-2b64d3fa67c4 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:42.684949 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04bd69-9a1f-493e-b1f5-2b64d3fa67c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:42.732817 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-9d04bd69-9a1f-493e-b1f5-2b64d3fa67c4 None None] MFA Rules not processed for user `2c902e596ae24613865448cf0ee05210`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:42.734057 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-9d04bd69-9a1f-493e-b1f5-2b64d3fa67c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:42.830529 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1110/2218] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:42.838309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f724a27-af91-4b98-9dc7-8ce2e00f071e admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:42.840041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-2f724a27-af91-4b98-9dc7-8ce2e00f071e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:42.919514 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f724a27-af91-4b98-9dc7-8ce2e00f071e admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:42.927144 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7260bd-1035-4939-a09b-496cdc196a8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:42.930770 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7260bd-1035-4939-a09b-496cdc196a8b service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:42.931289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7260bd-1035-4939-a09b-496cdc196a8b service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:42.931880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7260bd-1035-4939-a09b-496cdc196a8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:42.947966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7260bd-1035-4939-a09b-496cdc196a8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:42.949912 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7260bd-1035-4939-a09b-496cdc196a8b service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:42.964026 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1109/2219] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:42.993657 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04bd69-9a1f-493e-b1f5-2b64d3fa67c4 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:43.020493 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:43.089998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04bd69-9a1f-493e-b1f5-2b64d3fa67c4 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:43.097848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb953dfb-26ec-4be1-bdd3-d642b3f8ff35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:43.099733 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb953dfb-26ec-4be1-bdd3-d642b3f8ff35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:43.101883 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb953dfb-26ec-4be1-bdd3-d642b3f8ff35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:43.101883 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb953dfb-26ec-4be1-bdd3-d642b3f8ff35 admin admin] PATH_INFO: `/v3/users/2c902e596ae24613865448cf0ee05210` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:43.104226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb953dfb-26ec-4be1-bdd3-d642b3f8ff35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c902e596ae24613865448cf0ee05210)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:43.106248 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb953dfb-26ec-4be1-bdd3-d642b3f8ff35 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:43.170155 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-bb953dfb-26ec-4be1-bdd3-d642b3f8ff35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c902e596ae24613865448cf0ee05210'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:43.170871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-bb953dfb-26ec-4be1-bdd3-d642b3f8ff35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c902e596ae24613865448cf0ee05210'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:43.187736 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-bb953dfb-26ec-4be1-bdd3-d642b3f8ff35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c902e596ae24613865448cf0ee05210'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:43.197088 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-bb953dfb-26ec-4be1-bdd3-d642b3f8ff35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c902e596ae24613865448cf0ee05210'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:43.204633 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-bb953dfb-26ec-4be1-bdd3-d642b3f8ff35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c902e596ae24613865448cf0ee05210'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:43.212313 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1111/2220] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:42 2022] DELETE /identity/v3/users/2c902e596ae24613865448cf0ee05210 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:43.217083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f48126-cd17-4110-aac1-794216cdd01f None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:43.217432 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f48126-cd17-4110-aac1-794216cdd01f None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:43.217661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f48126-cd17-4110-aac1-794216cdd01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:43.256838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-13f48126-cd17-4110-aac1-794216cdd01f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:43.258699 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-13f48126-cd17-4110-aac1-794216cdd01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:43.260653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1772cd6-0372-46cd-8c86-ba81dfd7b6f7 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:43.261160 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1772cd6-0372-46cd-8c86-ba81dfd7b6f7 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:43.261563 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1772cd6-0372-46cd-8c86-ba81dfd7b6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:43.310486 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-a1772cd6-0372-46cd-8c86-ba81dfd7b6f7 None None] MFA Rules not processed for user `5b1e09a2671c433c8562763ca83c4596`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:43.312334 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a1772cd6-0372-46cd-8c86-ba81dfd7b6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:43.313013 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:43.355161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1110/2221] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:43.365977 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f48126-cd17-4110-aac1-794216cdd01f None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:43.368079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-13f48126-cd17-4110-aac1-794216cdd01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:43.413014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1112/2222] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:43.425646 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1772cd6-0372-46cd-8c86-ba81dfd7b6f7 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:43.427125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a1772cd6-0372-46cd-8c86-ba81dfd7b6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:43.462035 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f48126-cd17-4110-aac1-794216cdd01f None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:43.463020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:43.466194 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2c3f1-6080-499c-9640-e731a563e7ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:43.467586 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2c3f1-6080-499c-9640-e731a563e7ae service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:43.468019 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2c3f1-6080-499c-9640-e731a563e7ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:43.468418 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa2c3f1-6080-499c-9640-e731a563e7ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:43.485170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2c3f1-6080-499c-9640-e731a563e7ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:43.486859 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa2c3f1-6080-499c-9640-e731a563e7ae service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:43.493674 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1772cd6-0372-46cd-8c86-ba81dfd7b6f7 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:43.497703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7331c671-57fa-4ff4-b3d0-c5575fe69c7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:43.498322 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331c671-57fa-4ff4-b3d0-c5575fe69c7e service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:43.498582 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1111/2223] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:43.502439 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331c671-57fa-4ff4-b3d0-c5575fe69c7e service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:43.502764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7331c671-57fa-4ff4-b3d0-c5575fe69c7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:43.512187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331c671-57fa-4ff4-b3d0-c5575fe69c7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:43.513609 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7331c671-57fa-4ff4-b3d0-c5575fe69c7e service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:43.523130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1113/2224] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:50:43.815239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2c3f1-6080-499c-9640-e731a563e7ae service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:43.816888 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5fa2c3f1-6080-499c-9640-e731a563e7ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:43.876893 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa2c3f1-6080-499c-9640-e731a563e7ae service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:43.891076 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7176a203-4788-4524-86b6-862368f8746e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:43.892257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176a203-4788-4524-86b6-862368f8746e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:43.893049 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176a203-4788-4524-86b6-862368f8746e admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:43.894152 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7176a203-4788-4524-86b6-862368f8746e admin admin] PATH_INFO: `/v3/projects/f38aa8cac01344aabaf626198f43b3ce` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:43.896435 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176a203-4788-4524-86b6-862368f8746e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f38aa8cac01344aabaf626198f43b3ce)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:43.900330 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7176a203-4788-4524-86b6-862368f8746e admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:43.972493 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7176a203-4788-4524-86b6-862368f8746e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f38aa8cac01344aabaf626198f43b3ce', 'request_id': 'req-7176a203-4788-4524-86b6-862368f8746e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:43.980928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7176a203-4788-4524-86b6-862368f8746e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f38aa8cac01344aabaf626198f43b3ce', 'request_id': 'req-7176a203-4788-4524-86b6-862368f8746e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:43.990525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7176a203-4788-4524-86b6-862368f8746e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f38aa8cac01344aabaf626198f43b3ce', 'request_id': 'req-7176a203-4788-4524-86b6-862368f8746e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:44.007250 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7176a203-4788-4524-86b6-862368f8746e admin admin] The token cache is being invalidate because project f38aa8cac01344aabaf626198f43b3ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:44.007621 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7176a203-4788-4524-86b6-862368f8746e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:44.008382 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7176a203-4788-4524-86b6-862368f8746e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:44.009906 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1112/2225] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:43 2022] DELETE /identity/v3/projects/f38aa8cac01344aabaf626198f43b3ce => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:44.015165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d4594-6e75-4c26-914f-9333c84e6d19 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:44.015523 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d4594-6e75-4c26-914f-9333c84e6d19 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:44.016377 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5d4594-6e75-4c26-914f-9333c84e6d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:44.036935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-ec5d4594-6e75-4c26-914f-9333c84e6d19 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:44.038880 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ec5d4594-6e75-4c26-914f-9333c84e6d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:44.103206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1114/2226] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:44.111272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e36232-9b36-4d97-8e3e-a89ec628793e None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:44.111508 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e36232-9b36-4d97-8e3e-a89ec628793e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:44.111786 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e36232-9b36-4d97-8e3e-a89ec628793e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:44.134231 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-14e36232-9b36-4d97-8e3e-a89ec628793e None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:44.135581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-14e36232-9b36-4d97-8e3e-a89ec628793e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:44.144362 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1113/2227] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:44.149265 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d4594-6e75-4c26-914f-9333c84e6d19 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:44.159007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5d4594-6e75-4c26-914f-9333c84e6d19 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:44.160679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e36232-9b36-4d97-8e3e-a89ec628793e None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:44.162027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-14e36232-9b36-4d97-8e3e-a89ec628793e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:44.164806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae63b51-504a-4573-817f-5f5bf2bbc8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:44.165462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae63b51-504a-4573-817f-5f5bf2bbc8fd admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:44.165865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae63b51-504a-4573-817f-5f5bf2bbc8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:44.166146 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae63b51-504a-4573-817f-5f5bf2bbc8fd admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:44.166954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae63b51-504a-4573-817f-5f5bf2bbc8fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:50:44.167264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae63b51-504a-4573-817f-5f5bf2bbc8fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:44.168848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae63b51-504a-4573-817f-5f5bf2bbc8fd admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:44.175219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e36232-9b36-4d97-8e3e-a89ec628793e None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:44.179903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ca482-49ed-453c-ab1e-bc21e354d1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:44.180539 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ca482-49ed-453c-ab1e-bc21e354d1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:44.180838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ca482-49ed-453c-ab1e-bc21e354d1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:44.180954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1115/2228] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:50:44.181104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ca482-49ed-453c-ab1e-bc21e354d1b6 admin admin] PATH_INFO: `/v3/users/3c93163f814e44728d7778ff6b6fd727` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:44.182276 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ca482-49ed-453c-ab1e-bc21e354d1b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c93163f814e44728d7778ff6b6fd727)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:44.184233 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ca482-49ed-453c-ab1e-bc21e354d1b6 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:44.185176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae63b51-504a-4573-817f-5f5bf2bbc8fd admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:44.194601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae63b51-504a-4573-817f-5f5bf2bbc8fd admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:44.199513 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04894c04-d790-457c-9b68-f583553e5a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:44.200110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04894c04-d790-457c-9b68-f583553e5a75 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:44.200396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04894c04-d790-457c-9b68-f583553e5a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:44.200677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04894c04-d790-457c-9b68-f583553e5a75 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:44.201331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04894c04-d790-457c-9b68-f583553e5a75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:44.203323 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04894c04-d790-457c-9b68-f583553e5a75 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:44.236707 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1116/2229] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:44 2022] POST /identity/v3/projects => generated 399 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:44.240640 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7b1ca482-49ed-453c-ab1e-bc21e354d1b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c93163f814e44728d7778ff6b6fd727'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:44.241364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04894c04-d790-457c-9b68-f583553e5a75 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:44.241487 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7b1ca482-49ed-453c-ab1e-bc21e354d1b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c93163f814e44728d7778ff6b6fd727'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:44.249579 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7b1ca482-49ed-453c-ab1e-bc21e354d1b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c93163f814e44728d7778ff6b6fd727'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:44.251134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:44.275459 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7b1ca482-49ed-453c-ab1e-bc21e354d1b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c93163f814e44728d7778ff6b6fd727'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:44.276518 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7b1ca482-49ed-453c-ab1e-bc21e354d1b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c93163f814e44728d7778ff6b6fd727'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:44.293907 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1114/2230] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:44 2022] DELETE /identity/v3/users/3c93163f814e44728d7778ff6b6fd727 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:44.299142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ae570-6e33-4478-9d19-c975b638f022 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:44.299525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ae570-6e33-4478-9d19-c975b638f022 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:44.299881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ae570-6e33-4478-9d19-c975b638f022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:44.322418 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-3b6ae570-6e33-4478-9d19-c975b638f022 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:44.323819 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-3b6ae570-6e33-4478-9d19-c975b638f022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:44.325358 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04894c04-d790-457c-9b68-f583553e5a75 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:44.374749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:44.394635 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5758683-0004-4384-96e5-275fdbaa9d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:44.395423 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5758683-0004-4384-96e5-275fdbaa9d54 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:44.395789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5758683-0004-4384-96e5-275fdbaa9d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:44.396083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5758683-0004-4384-96e5-275fdbaa9d54 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:44.397348 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5758683-0004-4384-96e5-275fdbaa9d54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:44.399145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1115/2231] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:44.399537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5758683-0004-4384-96e5-275fdbaa9d54 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:44.410148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ae570-6e33-4478-9d19-c975b638f022 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:44.412067 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-3b6ae570-6e33-4478-9d19-c975b638f022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:44.424075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1117/2232] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:44 2022] POST /identity/v3/users => generated 300 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:44.425079 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5758683-0004-4384-96e5-275fdbaa9d54 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:44.426691 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e5758683-0004-4384-96e5-275fdbaa9d54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:44.438272 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5758683-0004-4384-96e5-275fdbaa9d54 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:44.442999 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e09f0-5d4e-483b-b4d6-98035413bb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:44.444206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e09f0-5d4e-483b-b4d6-98035413bb68 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:44.444495 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e09f0-5d4e-483b-b4d6-98035413bb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:44.444810 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e09f0-5d4e-483b-b4d6-98035413bb68 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:44.445528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e09f0-5d4e-483b-b4d6-98035413bb68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:44.447364 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e09f0-5d4e-483b-b4d6-98035413bb68 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:44.460847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1118/2233] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:44.461930 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e09f0-5d4e-483b-b4d6-98035413bb68 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:44.471264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e09f0-5d4e-483b-b4d6-98035413bb68 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:44.474749 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ae570-6e33-4478-9d19-c975b638f022 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:44.476565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c1098-3902-4a9f-b7f2-653dd26da404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:44.477472 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c1098-3902-4a9f-b7f2-653dd26da404 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:44.477763 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c1098-3902-4a9f-b7f2-653dd26da404 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:44.478201 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4c1098-3902-4a9f-b7f2-653dd26da404 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:44.479033 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c1098-3902-4a9f-b7f2-653dd26da404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:44.479226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294766c-18a3-4699-99df-bf937d65e766 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:44.479924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294766c-18a3-4699-99df-bf937d65e766 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:44.480237 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294766c-18a3-4699-99df-bf937d65e766 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:44.480538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294766c-18a3-4699-99df-bf937d65e766 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:44.480831 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4c1098-3902-4a9f-b7f2-653dd26da404 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:44.490121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294766c-18a3-4699-99df-bf937d65e766 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:44.491528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1119/2234] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:44.491644 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294766c-18a3-4699-99df-bf937d65e766 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:44.495629 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c1098-3902-4a9f-b7f2-653dd26da404 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:44.502333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1116/2235] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:50:44.506776 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4c1098-3902-4a9f-b7f2-653dd26da404 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:44.511718 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743a359-0120-4414-8eda-40c92b889d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:44.512391 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743a359-0120-4414-8eda-40c92b889d5a admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:44.512677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743a359-0120-4414-8eda-40c92b889d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:44.512957 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743a359-0120-4414-8eda-40c92b889d5a admin admin] PATH_INFO: `/v3/projects/198900dd07e84fb2a9df84551cba3bbd/users/cfb6e119637f4d0197c5d976fee00ad8/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:44.529500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743a359-0120-4414-8eda-40c92b889d5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=198900dd07e84fb2a9df84551cba3bbd, user_id=cfb6e119637f4d0197c5d976fee00ad8, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:44.532345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743a359-0120-4414-8eda-40c92b889d5a admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:44.547624 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1120/2236] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:44 2022] PUT /identity/v3/projects/198900dd07e84fb2a9df84551cba3bbd/users/cfb6e119637f4d0197c5d976fee00ad8/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:44.558370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038aa713-bcf2-4109-80c8-7d1bc6f2cc9d None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:44.558672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038aa713-bcf2-4109-80c8-7d1bc6f2cc9d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:44.558949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038aa713-bcf2-4109-80c8-7d1bc6f2cc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:44.592603 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-038aa713-bcf2-4109-80c8-7d1bc6f2cc9d None None] MFA Rules not processed for user `cfb6e119637f4d0197c5d976fee00ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:44.593830 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-038aa713-bcf2-4109-80c8-7d1bc6f2cc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:44.673158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1117/2237] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:44.685510 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743a359-0120-4414-8eda-40c92b889d5a admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:44.687302 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8743a359-0120-4414-8eda-40c92b889d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:44.750030 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743a359-0120-4414-8eda-40c92b889d5a admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:44.753733 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b642746-6edb-438d-a17b-6671fd0b5bed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:44.754387 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b642746-6edb-438d-a17b-6671fd0b5bed service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:44.754959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b642746-6edb-438d-a17b-6671fd0b5bed service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:44.755247 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b642746-6edb-438d-a17b-6671fd0b5bed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:44.766968 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b642746-6edb-438d-a17b-6671fd0b5bed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:44.768910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b642746-6edb-438d-a17b-6671fd0b5bed service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:44.786272 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1121/2238] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:44 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:44.804325 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038aa713-bcf2-4109-80c8-7d1bc6f2cc9d None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:44.806087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-038aa713-bcf2-4109-80c8-7d1bc6f2cc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:44.814084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:44.888289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038aa713-bcf2-4109-80c8-7d1bc6f2cc9d None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:44.894067 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac0d05-16de-4bec-886b-da91222e98d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:44.894813 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac0d05-16de-4bec-886b-da91222e98d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:44.895102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac0d05-16de-4bec-886b-da91222e98d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:44.895332 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac0d05-16de-4bec-886b-da91222e98d2 admin admin] PATH_INFO: `/v3/projects/fb68a0bb23d544a9a7848a2d4404aa55` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:44.896735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac0d05-16de-4bec-886b-da91222e98d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb68a0bb23d544a9a7848a2d4404aa55)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:44.899498 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac0d05-16de-4bec-886b-da91222e98d2 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:44.971767 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-32ac0d05-16de-4bec-886b-da91222e98d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb68a0bb23d544a9a7848a2d4404aa55', 'request_id': 'req-32ac0d05-16de-4bec-886b-da91222e98d2'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:44.986546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-32ac0d05-16de-4bec-886b-da91222e98d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb68a0bb23d544a9a7848a2d4404aa55', 'request_id': 'req-32ac0d05-16de-4bec-886b-da91222e98d2'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:44.993899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-32ac0d05-16de-4bec-886b-da91222e98d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb68a0bb23d544a9a7848a2d4404aa55', 'request_id': 'req-32ac0d05-16de-4bec-886b-da91222e98d2'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:45.000365 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d036ba-9daa-492b-b364-feae962b238f None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:45.000698 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d036ba-9daa-492b-b364-feae962b238f None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:45.001125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d036ba-9daa-492b-b364-feae962b238f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:45.011968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-32ac0d05-16de-4bec-886b-da91222e98d2 admin admin] The token cache is being invalidate because project fb68a0bb23d544a9a7848a2d4404aa55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:45.012250 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-32ac0d05-16de-4bec-886b-da91222e98d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:45.013085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-32ac0d05-16de-4bec-886b-da91222e98d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:45.014906 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1118/2239] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:44 2022] DELETE /identity/v3/projects/fb68a0bb23d544a9a7848a2d4404aa55 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:45.021510 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-a5d036ba-9daa-492b-b364-feae962b238f None None] MFA Rules not processed for user `5b1e09a2671c433c8562763ca83c4596`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:45.022848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a5d036ba-9daa-492b-b364-feae962b238f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:45.110764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1122/2240] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:45.961733 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac0d05-16de-4bec-886b-da91222e98d2 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:45.964512 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-32ac0d05-16de-4bec-886b-da91222e98d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:46.034788 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac0d05-16de-4bec-886b-da91222e98d2 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:46.039506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c4c32-0a7c-47c4-8b21-6e49b4de7fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:46.040155 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c4c32-0a7c-47c4-8b21-6e49b4de7fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:46.040440 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c4c32-0a7c-47c4-8b21-6e49b4de7fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:46.040718 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c4c32-0a7c-47c4-8b21-6e49b4de7fe8 admin admin] PATH_INFO: `/v3/users/05b6a406a6144e44ad8690df107d7f6d` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:46.041884 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c4c32-0a7c-47c4-8b21-6e49b4de7fe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b6a406a6144e44ad8690df107d7f6d)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:46.043917 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1c4c32-0a7c-47c4-8b21-6e49b4de7fe8 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:46.086761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:46.098089 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4c1c4c32-0a7c-47c4-8b21-6e49b4de7fe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b6a406a6144e44ad8690df107d7f6d'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:46.099047 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4c1c4c32-0a7c-47c4-8b21-6e49b4de7fe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b6a406a6144e44ad8690df107d7f6d'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:46.107624 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4c1c4c32-0a7c-47c4-8b21-6e49b4de7fe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b6a406a6144e44ad8690df107d7f6d'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:46.121815 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4c1c4c32-0a7c-47c4-8b21-6e49b4de7fe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b6a406a6144e44ad8690df107d7f6d'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:46.122541 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4c1c4c32-0a7c-47c4-8b21-6e49b4de7fe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b6a406a6144e44ad8690df107d7f6d'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:46.136798 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1119/2241] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:45 2022] DELETE /identity/v3/users/05b6a406a6144e44ad8690df107d7f6d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:46.141322 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857288c8-9e72-4686-9767-320da1cbc061 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:46.141778 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857288c8-9e72-4686-9767-320da1cbc061 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:46.142047 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857288c8-9e72-4686-9767-320da1cbc061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:46.162148 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-857288c8-9e72-4686-9767-320da1cbc061 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:46.163456 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-857288c8-9e72-4686-9767-320da1cbc061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:46.192217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:46.233062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1123/2242] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:46.243211 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c4c32-0a7c-47c4-8b21-6e49b4de7fe8 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:46.245506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-4c1c4c32-0a7c-47c4-8b21-6e49b4de7fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:46.305579 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c4c32-0a7c-47c4-8b21-6e49b4de7fe8 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:46.309303 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df836072-dcac-43d3-9b21-b1c774267b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:46.309927 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df836072-dcac-43d3-9b21-b1c774267b70 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:46.310211 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df836072-dcac-43d3-9b21-b1c774267b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:46.310525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df836072-dcac-43d3-9b21-b1c774267b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:46.320298 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df836072-dcac-43d3-9b21-b1c774267b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:46.321723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df836072-dcac-43d3-9b21-b1c774267b70 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:46.331036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1120/2243] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:46.659158 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857288c8-9e72-4686-9767-320da1cbc061 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:46.660721 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-857288c8-9e72-4686-9767-320da1cbc061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:46.687257 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857288c8-9e72-4686-9767-320da1cbc061 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:46.693373 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102075d-eb66-4e11-83a4-29e1a741e674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:46.694051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102075d-eb66-4e11-83a4-29e1a741e674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:46.694425 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102075d-eb66-4e11-83a4-29e1a741e674 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:46.694649 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102075d-eb66-4e11-83a4-29e1a741e674 admin admin] PATH_INFO: `/v3/projects/fa16f8956dbe4fc5b9749994cec8af94` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:46.695819 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102075d-eb66-4e11-83a4-29e1a741e674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa16f8956dbe4fc5b9749994cec8af94)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:46.697792 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102075d-eb66-4e11-83a4-29e1a741e674 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:46.755154 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8102075d-eb66-4e11-83a4-29e1a741e674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa16f8956dbe4fc5b9749994cec8af94', 'request_id': 'req-8102075d-eb66-4e11-83a4-29e1a741e674'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:46.762587 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8102075d-eb66-4e11-83a4-29e1a741e674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa16f8956dbe4fc5b9749994cec8af94', 'request_id': 'req-8102075d-eb66-4e11-83a4-29e1a741e674'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:46.771357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8102075d-eb66-4e11-83a4-29e1a741e674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa16f8956dbe4fc5b9749994cec8af94', 'request_id': 'req-8102075d-eb66-4e11-83a4-29e1a741e674'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:46.783895 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8102075d-eb66-4e11-83a4-29e1a741e674 admin admin] The token cache is being invalidate because project fa16f8956dbe4fc5b9749994cec8af94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:46.784231 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8102075d-eb66-4e11-83a4-29e1a741e674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:46.784982 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8102075d-eb66-4e11-83a4-29e1a741e674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:46.790414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1124/2244] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:46 2022] DELETE /identity/v3/projects/fa16f8956dbe4fc5b9749994cec8af94 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:46.793695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f3aab-de0c-49ae-b732-61b2d09b7c0d None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:46.794011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f3aab-de0c-49ae-b732-61b2d09b7c0d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:46.794291 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881f3aab-de0c-49ae-b732-61b2d09b7c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:46.833246 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-881f3aab-de0c-49ae-b732-61b2d09b7c0d None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:46.834562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-881f3aab-de0c-49ae-b732-61b2d09b7c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:46.930366 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1121/2245] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:46.947171 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a044f-6c53-4c25-bcdc-c82cd443cdc6 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:46.947401 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a044f-6c53-4c25-bcdc-c82cd443cdc6 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:46.947688 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a044f-6c53-4c25-bcdc-c82cd443cdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:46.970609 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-ee8a044f-6c53-4c25-bcdc-c82cd443cdc6 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:46.971844 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ee8a044f-6c53-4c25-bcdc-c82cd443cdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:46.983014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1125/2246] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:46.987484 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f3aab-de0c-49ae-b732-61b2d09b7c0d None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:46.998600 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881f3aab-de0c-49ae-b732-61b2d09b7c0d None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:47.004395 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee3fef-250a-44a9-b77c-5c9591957e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:47.005127 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee3fef-250a-44a9-b77c-5c9591957e8d admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:47.005481 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee3fef-250a-44a9-b77c-5c9591957e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:47.006276 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee3fef-250a-44a9-b77c-5c9591957e8d admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:47.006674 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee3fef-250a-44a9-b77c-5c9591957e8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:50:47.007051 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee3fef-250a-44a9-b77c-5c9591957e8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:47.008778 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee3fef-250a-44a9-b77c-5c9591957e8d admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:47.024351 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1122/2247] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:50:47.028885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a044f-6c53-4c25-bcdc-c82cd443cdc6 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:47.039577 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a044f-6c53-4c25-bcdc-c82cd443cdc6 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:47.044641 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857d5bb-b092-40a5-bc6f-107581ae1090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:47.045270 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857d5bb-b092-40a5-bc6f-107581ae1090 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:47.045555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857d5bb-b092-40a5-bc6f-107581ae1090 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:47.045832 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6857d5bb-b092-40a5-bc6f-107581ae1090 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:47.046540 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857d5bb-b092-40a5-bc6f-107581ae1090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:47.048585 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6857d5bb-b092-40a5-bc6f-107581ae1090 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:47.080358 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1126/2248] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:47 2022] POST /identity/v3/projects => generated 387 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:47.085619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee3fef-250a-44a9-b77c-5c9591957e8d admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:47.097249 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee3fef-250a-44a9-b77c-5c9591957e8d admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:47.143895 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:47.161352 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023889f-5f58-4c46-9166-e2b5254d1cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:47.161967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023889f-5f58-4c46-9166-e2b5254d1cac admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:47.162860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023889f-5f58-4c46-9166-e2b5254d1cac admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:47.163147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3023889f-5f58-4c46-9166-e2b5254d1cac admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:47.163812 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023889f-5f58-4c46-9166-e2b5254d1cac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:47.165734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3023889f-5f58-4c46-9166-e2b5254d1cac admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:47.190425 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1123/2249] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:47 2022] POST /identity/v3/users => generated 294 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:47.195044 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857d5bb-b092-40a5-bc6f-107581ae1090 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:47.207791 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6857d5bb-b092-40a5-bc6f-107581ae1090 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:47.213083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627762b-8982-408d-ad7d-e25840a75b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:47.213710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627762b-8982-408d-ad7d-e25840a75b58 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:47.213997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627762b-8982-408d-ad7d-e25840a75b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:47.214276 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627762b-8982-408d-ad7d-e25840a75b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:47.215017 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627762b-8982-408d-ad7d-e25840a75b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:47.216998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e627762b-8982-408d-ad7d-e25840a75b58 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:47.228625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1127/2250] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:47.232928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023889f-5f58-4c46-9166-e2b5254d1cac admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:47.246463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3023889f-5f58-4c46-9166-e2b5254d1cac admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:47.251105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38665405-5afc-4fdd-982c-8f3ac93b04b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:47.251729 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38665405-5afc-4fdd-982c-8f3ac93b04b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:47.252018 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38665405-5afc-4fdd-982c-8f3ac93b04b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:47.252297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38665405-5afc-4fdd-982c-8f3ac93b04b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:47.253029 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38665405-5afc-4fdd-982c-8f3ac93b04b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:47.254663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38665405-5afc-4fdd-982c-8f3ac93b04b7 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:47.265436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1124/2251] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:47.269565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627762b-8982-408d-ad7d-e25840a75b58 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:47.279916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627762b-8982-408d-ad7d-e25840a75b58 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:47.284705 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86606f7a-7520-466b-aed6-137fd13b27db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:47.285381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86606f7a-7520-466b-aed6-137fd13b27db admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:47.285667 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86606f7a-7520-466b-aed6-137fd13b27db admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:47.285948 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86606f7a-7520-466b-aed6-137fd13b27db admin admin] PATH_INFO: `/v3/projects/00886e385db74c11a43f2389ec49fb51/users/9adab331020347f58cf0430121204205/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:47.301542 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86606f7a-7520-466b-aed6-137fd13b27db admin admin] RBAC: Authorizing `identity:create_grant(project_id=00886e385db74c11a43f2389ec49fb51, user_id=9adab331020347f58cf0430121204205, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:47.304224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86606f7a-7520-466b-aed6-137fd13b27db admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:47.319531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1128/2252] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:47 2022] PUT /identity/v3/projects/00886e385db74c11a43f2389ec49fb51/users/9adab331020347f58cf0430121204205/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:47.329949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02034b1-5cfc-461c-869d-23834cae7ab0 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:47.330241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02034b1-5cfc-461c-869d-23834cae7ab0 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:47.330551 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02034b1-5cfc-461c-869d-23834cae7ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:47.360747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-d02034b1-5cfc-461c-869d-23834cae7ab0 None None] MFA Rules not processed for user `9adab331020347f58cf0430121204205`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:47.362278 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d02034b1-5cfc-461c-869d-23834cae7ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:47.437189 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1125/2253] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:50:47.446511 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86606f7a-7520-466b-aed6-137fd13b27db admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:47.499533 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:47.510595 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86606f7a-7520-466b-aed6-137fd13b27db admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:47.516336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff497a-afba-49d4-839a-5d38156396a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:47.517098 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff497a-afba-49d4-839a-5d38156396a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:47.517547 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff497a-afba-49d4-839a-5d38156396a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:47.517825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff497a-afba-49d4-839a-5d38156396a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:47.518520 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff497a-afba-49d4-839a-5d38156396a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:47.520613 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ff497a-afba-49d4-839a-5d38156396a3 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:47.551693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1129/2254] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:47 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:47.552926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02034b1-5cfc-461c-869d-23834cae7ab0 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:47.563598 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02034b1-5cfc-461c-869d-23834cae7ab0 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:47.645340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1699b-b775-48bc-a841-ca6912eb0d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:47.646089 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1699b-b775-48bc-a841-ca6912eb0d40 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:47.647175 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1699b-b775-48bc-a841-ca6912eb0d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:47.647615 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1699b-b775-48bc-a841-ca6912eb0d40 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:47.648385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1699b-b775-48bc-a841-ca6912eb0d40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:47.654106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1699b-b775-48bc-a841-ca6912eb0d40 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:47.675899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1126/2255] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:47 2022] POST /identity/v3/users => generated 300 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:47.680674 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff497a-afba-49d4-839a-5d38156396a3 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:47.692464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff497a-afba-49d4-839a-5d38156396a3 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:47.697850 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0243dd2-b0ed-4bcf-93b5-0ee9e6678be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:47.698508 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0243dd2-b0ed-4bcf-93b5-0ee9e6678be5 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:47.698995 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0243dd2-b0ed-4bcf-93b5-0ee9e6678be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:47.699284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0243dd2-b0ed-4bcf-93b5-0ee9e6678be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:47.699989 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0243dd2-b0ed-4bcf-93b5-0ee9e6678be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:47.701590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0243dd2-b0ed-4bcf-93b5-0ee9e6678be5 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:47.713643 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1130/2256] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:47.717958 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1699b-b775-48bc-a841-ca6912eb0d40 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:47.729429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1699b-b775-48bc-a841-ca6912eb0d40 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:47.734169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c886d-46e7-4a43-9289-18dd3992bc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:47.734872 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c886d-46e7-4a43-9289-18dd3992bc37 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:47.735159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c886d-46e7-4a43-9289-18dd3992bc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:47.735439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497c886d-46e7-4a43-9289-18dd3992bc37 admin admin] PATH_INFO: `/v3/projects/4ddc99701e2c4aab85fab0192058c217/users/05f908283dcb4b1a823b5f1664a7166c/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:47.753375 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c886d-46e7-4a43-9289-18dd3992bc37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ddc99701e2c4aab85fab0192058c217, user_id=05f908283dcb4b1a823b5f1664a7166c, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:47.756886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497c886d-46e7-4a43-9289-18dd3992bc37 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:47.773079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1127/2257] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:47 2022] PUT /identity/v3/projects/4ddc99701e2c4aab85fab0192058c217/users/05f908283dcb4b1a823b5f1664a7166c/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:47.778024 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0243dd2-b0ed-4bcf-93b5-0ee9e6678be5 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:47.789586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0243dd2-b0ed-4bcf-93b5-0ee9e6678be5 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:47.854766 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec410a6-eae4-4af7-8c55-aba27901199f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:47.855782 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec410a6-eae4-4af7-8c55-aba27901199f admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:47.856246 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec410a6-eae4-4af7-8c55-aba27901199f admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:47.856732 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec410a6-eae4-4af7-8c55-aba27901199f admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:47.857566 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec410a6-eae4-4af7-8c55-aba27901199f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:47.859554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec410a6-eae4-4af7-8c55-aba27901199f admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:47.870817 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1131/2258] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:47.874645 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c886d-46e7-4a43-9289-18dd3992bc37 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:47.886523 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497c886d-46e7-4a43-9289-18dd3992bc37 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:47.891896 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc09525-f924-4d7a-8819-7f03efbb2308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:47.892705 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc09525-f924-4d7a-8819-7f03efbb2308 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:47.892992 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc09525-f924-4d7a-8819-7f03efbb2308 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:47.893274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc09525-f924-4d7a-8819-7f03efbb2308 admin admin] PATH_INFO: `/v3/projects/4ddc99701e2c4aab85fab0192058c217/users/05f908283dcb4b1a823b5f1664a7166c/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:47.895496 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc09525-f924-4d7a-8819-7f03efbb2308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ddc99701e2c4aab85fab0192058c217, user_id=05f908283dcb4b1a823b5f1664a7166c, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:47.898153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc09525-f924-4d7a-8819-7f03efbb2308 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:47.912933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1128/2259] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:47 2022] PUT /identity/v3/projects/4ddc99701e2c4aab85fab0192058c217/users/05f908283dcb4b1a823b5f1664a7166c/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:47.924282 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40151cd6-710d-44df-a1d5-f7269f4c2be7 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:47.924670 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40151cd6-710d-44df-a1d5-f7269f4c2be7 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:47.925019 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40151cd6-710d-44df-a1d5-f7269f4c2be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:47.960200 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-40151cd6-710d-44df-a1d5-f7269f4c2be7 None None] MFA Rules not processed for user `05f908283dcb4b1a823b5f1664a7166c`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:47.961870 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-40151cd6-710d-44df-a1d5-f7269f4c2be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:48.060649 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1132/2260] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:48.073065 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc09525-f924-4d7a-8819-7f03efbb2308 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:48.074608 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-dbc09525-f924-4d7a-8819-7f03efbb2308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:48.082070 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:48.147921 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc09525-f924-4d7a-8819-7f03efbb2308 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:48.152826 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bff638-4717-45fc-9501-c18c2858275c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:48.154053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bff638-4717-45fc-9501-c18c2858275c service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:48.154053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bff638-4717-45fc-9501-c18c2858275c service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:48.154298 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bff638-4717-45fc-9501-c18c2858275c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:48.166427 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bff638-4717-45fc-9501-c18c2858275c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:48.168752 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bff638-4717-45fc-9501-c18c2858275c service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:48.180549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1129/2261] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:48.334710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40151cd6-710d-44df-a1d5-f7269f4c2be7 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:48.388463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:48.404546 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40151cd6-710d-44df-a1d5-f7269f4c2be7 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:48.410305 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d223a-1d1a-4f32-b6e8-bf9e2eaeb0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:48.411175 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d223a-1d1a-4f32-b6e8-bf9e2eaeb0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:48.411624 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d223a-1d1a-4f32-b6e8-bf9e2eaeb0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:48.411947 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d223a-1d1a-4f32-b6e8-bf9e2eaeb0b8 admin admin] PATH_INFO: `/v3/users/9adab331020347f58cf0430121204205` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:48.416724 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d223a-1d1a-4f32-b6e8-bf9e2eaeb0b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9adab331020347f58cf0430121204205)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:48.420196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d223a-1d1a-4f32-b6e8-bf9e2eaeb0b8 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:48.471283 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-eb2d223a-1d1a-4f32-b6e8-bf9e2eaeb0b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9adab331020347f58cf0430121204205'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:48.471946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-eb2d223a-1d1a-4f32-b6e8-bf9e2eaeb0b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9adab331020347f58cf0430121204205'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:48.487487 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-eb2d223a-1d1a-4f32-b6e8-bf9e2eaeb0b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9adab331020347f58cf0430121204205'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:48.494298 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-eb2d223a-1d1a-4f32-b6e8-bf9e2eaeb0b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9adab331020347f58cf0430121204205'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:48.513881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-eb2d223a-1d1a-4f32-b6e8-bf9e2eaeb0b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9adab331020347f58cf0430121204205'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:48.521277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1133/2262] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:48 2022] DELETE /identity/v3/users/9adab331020347f58cf0430121204205 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:48.526502 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360c6b1-22ff-48dc-b38e-43d9ad78bd5a None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:48.527139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360c6b1-22ff-48dc-b38e-43d9ad78bd5a None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:48.527461 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7360c6b1-22ff-48dc-b38e-43d9ad78bd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:48.552318 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-7360c6b1-22ff-48dc-b38e-43d9ad78bd5a None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:48.553559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-7360c6b1-22ff-48dc-b38e-43d9ad78bd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:48.618398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1130/2263] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:48.628267 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d223a-1d1a-4f32-b6e8-bf9e2eaeb0b8 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:48.629709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-eb2d223a-1d1a-4f32-b6e8-bf9e2eaeb0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:48.697373 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d223a-1d1a-4f32-b6e8-bf9e2eaeb0b8 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:48.701134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef870a-0c59-4524-8458-8a1a0ebfe07a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:48.701953 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef870a-0c59-4524-8458-8a1a0ebfe07a service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:48.702317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef870a-0c59-4524-8458-8a1a0ebfe07a service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:48.702565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef870a-0c59-4524-8458-8a1a0ebfe07a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:48.713905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef870a-0c59-4524-8458-8a1a0ebfe07a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:48.715595 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef870a-0c59-4524-8458-8a1a0ebfe07a service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:48.726509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1134/2264] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:49.024331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360c6b1-22ff-48dc-b38e-43d9ad78bd5a None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:49.025994 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-7360c6b1-22ff-48dc-b38e-43d9ad78bd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:49.038373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7360c6b1-22ff-48dc-b38e-43d9ad78bd5a None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:49.043808 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002d15c-23ce-45e1-8ec4-83ac5e9c2693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:49.044584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002d15c-23ce-45e1-8ec4-83ac5e9c2693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:49.044936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002d15c-23ce-45e1-8ec4-83ac5e9c2693 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:49.045218 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d002d15c-23ce-45e1-8ec4-83ac5e9c2693 admin admin] PATH_INFO: `/v3/projects/00886e385db74c11a43f2389ec49fb51` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:49.046443 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002d15c-23ce-45e1-8ec4-83ac5e9c2693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00886e385db74c11a43f2389ec49fb51)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:49.048462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d002d15c-23ce-45e1-8ec4-83ac5e9c2693 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:49.097568 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d002d15c-23ce-45e1-8ec4-83ac5e9c2693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00886e385db74c11a43f2389ec49fb51', 'request_id': 'req-d002d15c-23ce-45e1-8ec4-83ac5e9c2693'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:49.103615 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d002d15c-23ce-45e1-8ec4-83ac5e9c2693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00886e385db74c11a43f2389ec49fb51', 'request_id': 'req-d002d15c-23ce-45e1-8ec4-83ac5e9c2693'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:49.109516 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d002d15c-23ce-45e1-8ec4-83ac5e9c2693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00886e385db74c11a43f2389ec49fb51', 'request_id': 'req-d002d15c-23ce-45e1-8ec4-83ac5e9c2693'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:49.121599 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d002d15c-23ce-45e1-8ec4-83ac5e9c2693 admin admin] The token cache is being invalidate because project 00886e385db74c11a43f2389ec49fb51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:49.121827 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d002d15c-23ce-45e1-8ec4-83ac5e9c2693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:49.122508 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d002d15c-23ce-45e1-8ec4-83ac5e9c2693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:49.124024 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1131/2265] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:49 2022] DELETE /identity/v3/projects/00886e385db74c11a43f2389ec49fb51 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:49.128244 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef870a-0c59-4524-8458-8a1a0ebfe07a service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:49.138203 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef870a-0c59-4524-8458-8a1a0ebfe07a service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:49.197325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dbd73b-ea0f-4abf-98e8-842c79eb0ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:49.197981 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbd73b-ea0f-4abf-98e8-842c79eb0ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:49.198296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbd73b-ea0f-4abf-98e8-842c79eb0ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:49.198610 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dbd73b-ea0f-4abf-98e8-842c79eb0ddf admin admin] PATH_INFO: `/v3/users/05f908283dcb4b1a823b5f1664a7166c` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:49.199806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbd73b-ea0f-4abf-98e8-842c79eb0ddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=05f908283dcb4b1a823b5f1664a7166c)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:49.201792 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dbd73b-ea0f-4abf-98e8-842c79eb0ddf admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:49.217080 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:49.256869 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-91dbd73b-ea0f-4abf-98e8-842c79eb0ddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05f908283dcb4b1a823b5f1664a7166c'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:49.257916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-91dbd73b-ea0f-4abf-98e8-842c79eb0ddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05f908283dcb4b1a823b5f1664a7166c'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:49.277358 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-91dbd73b-ea0f-4abf-98e8-842c79eb0ddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05f908283dcb4b1a823b5f1664a7166c'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:49.291661 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-91dbd73b-ea0f-4abf-98e8-842c79eb0ddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05f908283dcb4b1a823b5f1664a7166c'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:49.301839 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-91dbd73b-ea0f-4abf-98e8-842c79eb0ddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05f908283dcb4b1a823b5f1664a7166c'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:49.315534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1135/2266] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:49 2022] DELETE /identity/v3/users/05f908283dcb4b1a823b5f1664a7166c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:49.687515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002d15c-23ce-45e1-8ec4-83ac5e9c2693 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:49.688967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d002d15c-23ce-45e1-8ec4-83ac5e9c2693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:49.703898 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d002d15c-23ce-45e1-8ec4-83ac5e9c2693 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:49.737665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:49.767959 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92969d1-46da-48d8-863f-7585a121641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:49.768846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92969d1-46da-48d8-863f-7585a121641a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:49.769211 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92969d1-46da-48d8-863f-7585a121641a admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:49.769439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92969d1-46da-48d8-863f-7585a121641a admin admin] PATH_INFO: `/v3/projects/4ddc99701e2c4aab85fab0192058c217` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:49.770782 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92969d1-46da-48d8-863f-7585a121641a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ddc99701e2c4aab85fab0192058c217)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:49.773146 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92969d1-46da-48d8-863f-7585a121641a admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:49.818618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d92969d1-46da-48d8-863f-7585a121641a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ddc99701e2c4aab85fab0192058c217', 'request_id': 'req-d92969d1-46da-48d8-863f-7585a121641a'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:49.824556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d92969d1-46da-48d8-863f-7585a121641a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ddc99701e2c4aab85fab0192058c217', 'request_id': 'req-d92969d1-46da-48d8-863f-7585a121641a'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:49.830044 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d92969d1-46da-48d8-863f-7585a121641a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ddc99701e2c4aab85fab0192058c217', 'request_id': 'req-d92969d1-46da-48d8-863f-7585a121641a'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:49.843155 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d92969d1-46da-48d8-863f-7585a121641a admin admin] The token cache is being invalidate because project 4ddc99701e2c4aab85fab0192058c217 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:49.843447 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d92969d1-46da-48d8-863f-7585a121641a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:49.844075 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d92969d1-46da-48d8-863f-7585a121641a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:49.845592 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1132/2267] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:49 2022] DELETE /identity/v3/projects/4ddc99701e2c4aab85fab0192058c217 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:49.850906 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3636def-bf47-4a41-86a5-a8ffb72bfa6f None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:49.851349 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3636def-bf47-4a41-86a5-a8ffb72bfa6f None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:49.851456 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3636def-bf47-4a41-86a5-a8ffb72bfa6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:49.872234 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-e3636def-bf47-4a41-86a5-a8ffb72bfa6f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:49.873419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e3636def-bf47-4a41-86a5-a8ffb72bfa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:49.931188 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1136/2268] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:49.938745 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea03ebf-23a5-4e66-829b-42ffd8a53bc7 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:49.939040 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea03ebf-23a5-4e66-829b-42ffd8a53bc7 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:49.939323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea03ebf-23a5-4e66-829b-42ffd8a53bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:49.958545 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-7ea03ebf-23a5-4e66-829b-42ffd8a53bc7 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:49.960266 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-7ea03ebf-23a5-4e66-829b-42ffd8a53bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:49.968174 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1133/2269] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:49.972506 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3636def-bf47-4a41-86a5-a8ffb72bfa6f None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:49.983610 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3636def-bf47-4a41-86a5-a8ffb72bfa6f None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:49.988478 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef7e20-73ac-41c9-aac3-25d41f3ba05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:49.989164 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef7e20-73ac-41c9-aac3-25d41f3ba05d admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:49.989457 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef7e20-73ac-41c9-aac3-25d41f3ba05d admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:49.989739 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ef7e20-73ac-41c9-aac3-25d41f3ba05d admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:49.990537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef7e20-73ac-41c9-aac3-25d41f3ba05d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:50:49.990915 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef7e20-73ac-41c9-aac3-25d41f3ba05d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:49.992252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea03ebf-23a5-4e66-829b-42ffd8a53bc7 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:49.992529 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ef7e20-73ac-41c9-aac3-25d41f3ba05d admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:49.993636 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-7ea03ebf-23a5-4e66-829b-42ffd8a53bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:50.008264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1137/2270] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:50:50.008417 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea03ebf-23a5-4e66-829b-42ffd8a53bc7 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:50.009198 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef7e20-73ac-41c9-aac3-25d41f3ba05d admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:50.010332 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f0533-4fb3-41eb-bb73-406d940cc618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:50.011017 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f0533-4fb3-41eb-bb73-406d940cc618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:50.011307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f0533-4fb3-41eb-bb73-406d940cc618 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:50.011589 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f0533-4fb3-41eb-bb73-406d940cc618 admin admin] PATH_INFO: `/v3/users/cfb6e119637f4d0197c5d976fee00ad8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:50.012769 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f0533-4fb3-41eb-bb73-406d940cc618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb6e119637f4d0197c5d976fee00ad8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:50.014754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8f0533-4fb3-41eb-bb73-406d940cc618 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:50.019299 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ef7e20-73ac-41c9-aac3-25d41f3ba05d admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:50.024450 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdb177-3403-4c67-bd81-51350b012c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:50.025047 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdb177-3403-4c67-bd81-51350b012c2a admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:50.025336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdb177-3403-4c67-bd81-51350b012c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:50.025619 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdb177-3403-4c67-bd81-51350b012c2a admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:50.026282 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdb177-3403-4c67-bd81-51350b012c2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:50.028181 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdb177-3403-4c67-bd81-51350b012c2a admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:50.056101 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1138/2271] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:50 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:50.060338 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdb177-3403-4c67-bd81-51350b012c2a admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:50.062965 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-fe8f0533-4fb3-41eb-bb73-406d940cc618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb6e119637f4d0197c5d976fee00ad8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:50.063619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-fe8f0533-4fb3-41eb-bb73-406d940cc618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb6e119637f4d0197c5d976fee00ad8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:50.070508 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-fe8f0533-4fb3-41eb-bb73-406d940cc618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb6e119637f4d0197c5d976fee00ad8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:50.083091 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-fe8f0533-4fb3-41eb-bb73-406d940cc618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb6e119637f4d0197c5d976fee00ad8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:50.083765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-fe8f0533-4fb3-41eb-bb73-406d940cc618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb6e119637f4d0197c5d976fee00ad8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:50.103736 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1134/2272] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:49 2022] DELETE /identity/v3/users/cfb6e119637f4d0197c5d976fee00ad8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:50.108299 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bc5f9-1e1e-4aa6-a368-37100cdade09 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:50.108590 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bc5f9-1e1e-4aa6-a368-37100cdade09 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:50.108873 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89bc5f9-1e1e-4aa6-a368-37100cdade09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:50.128349 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-a89bc5f9-1e1e-4aa6-a368-37100cdade09 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:50.129550 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a89bc5f9-1e1e-4aa6-a368-37100cdade09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:50.136263 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:50.141878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdb177-3403-4c67-bd81-51350b012c2a admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:50.150265 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:50.190583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1135/2273] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:50.200526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b43e5-4ecc-4c0c-9dec-c85827b8d4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:50.200743 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bc5f9-1e1e-4aa6-a368-37100cdade09 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:50.201160 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b43e5-4ecc-4c0c-9dec-c85827b8d4ba admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:50.201445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b43e5-4ecc-4c0c-9dec-c85827b8d4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:50.201750 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b43e5-4ecc-4c0c-9dec-c85827b8d4ba admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:50.202115 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a89bc5f9-1e1e-4aa6-a368-37100cdade09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:50.202441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b43e5-4ecc-4c0c-9dec-c85827b8d4ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:50.204423 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b43e5-4ecc-4c0c-9dec-c85827b8d4ba admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:50.227213 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1139/2274] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:50 2022] POST /identity/v3/users => generated 293 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:50.230868 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b43e5-4ecc-4c0c-9dec-c85827b8d4ba admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:50.232536 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-315b43e5-4ecc-4c0c-9dec-c85827b8d4ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:50.244359 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b43e5-4ecc-4c0c-9dec-c85827b8d4ba admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:50.249279 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928e842-c080-4051-a077-2a8d11a33db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:50.249917 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928e842-c080-4051-a077-2a8d11a33db2 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:50.250199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928e842-c080-4051-a077-2a8d11a33db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:50.250513 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2928e842-c080-4051-a077-2a8d11a33db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:50.251203 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928e842-c080-4051-a077-2a8d11a33db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:50.252782 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2928e842-c080-4051-a077-2a8d11a33db2 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:50.261172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89bc5f9-1e1e-4aa6-a368-37100cdade09 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:50.262740 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1140/2275] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:50.265054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d2cf9-e1f3-4376-aca0-8cb69c4b831b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:50.265727 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d2cf9-e1f3-4376-aca0-8cb69c4b831b service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:50.266043 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d2cf9-e1f3-4376-aca0-8cb69c4b831b service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:50.266320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928e842-c080-4051-a077-2a8d11a33db2 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:50.266481 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d2cf9-e1f3-4376-aca0-8cb69c4b831b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:50.275953 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d2cf9-e1f3-4376-aca0-8cb69c4b831b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:50.276110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2928e842-c080-4051-a077-2a8d11a33db2 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:50.277447 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d2cf9-e1f3-4376-aca0-8cb69c4b831b service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:50.280510 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6102352-d919-46fe-847a-7ec61bead5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:50.281119 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6102352-d919-46fe-847a-7ec61bead5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:50.281400 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6102352-d919-46fe-847a-7ec61bead5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:50.281671 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6102352-d919-46fe-847a-7ec61bead5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:50.282334 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6102352-d919-46fe-847a-7ec61bead5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:50.283885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6102352-d919-46fe-847a-7ec61bead5c5 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:50.287876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1136/2276] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:50:50.297813 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1141/2277] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:50.299113 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d2cf9-e1f3-4376-aca0-8cb69c4b831b service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:50.308899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d2cf9-e1f3-4376-aca0-8cb69c4b831b service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:50.314549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc53bfe-6068-47e6-aec9-935e4ef22ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:50.315291 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc53bfe-6068-47e6-aec9-935e4ef22ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:50.315651 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc53bfe-6068-47e6-aec9-935e4ef22ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:50.316002 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc53bfe-6068-47e6-aec9-935e4ef22ab8 admin admin] PATH_INFO: `/v3/projects/4fefe125e5ec4578a02007024dd01060/users/8a1ef14361194c789137a000ba3118e8/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:50.332018 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc53bfe-6068-47e6-aec9-935e4ef22ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fefe125e5ec4578a02007024dd01060, user_id=8a1ef14361194c789137a000ba3118e8, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:50.335854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc53bfe-6068-47e6-aec9-935e4ef22ab8 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:50.352680 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1137/2278] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:50 2022] PUT /identity/v3/projects/4fefe125e5ec4578a02007024dd01060/users/8a1ef14361194c789137a000ba3118e8/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:50.363118 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb677498-d06a-475a-98d3-764772bd35d8 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:50.363495 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb677498-d06a-475a-98d3-764772bd35d8 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:50.363802 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb677498-d06a-475a-98d3-764772bd35d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:50.392574 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-bb677498-d06a-475a-98d3-764772bd35d8 None None] MFA Rules not processed for user `8a1ef14361194c789137a000ba3118e8`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:50.393783 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-bb677498-d06a-475a-98d3-764772bd35d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:50.488258 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1142/2279] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:50.492923 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc53bfe-6068-47e6-aec9-935e4ef22ab8 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:50.576159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc53bfe-6068-47e6-aec9-935e4ef22ab8 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:50.584352 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1acb0a-f42e-4aee-8c8e-a2fdcc3d572c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:50.585015 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1acb0a-f42e-4aee-8c8e-a2fdcc3d572c admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:50.585306 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1acb0a-f42e-4aee-8c8e-a2fdcc3d572c admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:50.585584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1acb0a-f42e-4aee-8c8e-a2fdcc3d572c admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:50.586253 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1acb0a-f42e-4aee-8c8e-a2fdcc3d572c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:50.588207 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1acb0a-f42e-4aee-8c8e-a2fdcc3d572c admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:50.611656 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb677498-d06a-475a-98d3-764772bd35d8 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:50.613701 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-bb677498-d06a-475a-98d3-764772bd35d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:50.629489 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1138/2280] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:50 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:50.632917 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1acb0a-f42e-4aee-8c8e-a2fdcc3d572c admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:50.654840 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb677498-d06a-475a-98d3-764772bd35d8 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:50.680581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:50.723754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1acb0a-f42e-4aee-8c8e-a2fdcc3d572c admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:50.732219 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9508d-af47-40a1-a781-3701444d16a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:50.732430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f28487-fe45-4e85-9414-291b90f10f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:50.732915 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9508d-af47-40a1-a781-3701444d16a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:50.733099 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f28487-fe45-4e85-9414-291b90f10f91 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:50.733206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9508d-af47-40a1-a781-3701444d16a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:50.733396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f28487-fe45-4e85-9414-291b90f10f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:50.733505 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9508d-af47-40a1-a781-3701444d16a6 admin admin] PATH_INFO: `/v3/projects/198900dd07e84fb2a9df84551cba3bbd` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:50.733679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f28487-fe45-4e85-9414-291b90f10f91 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:50.734977 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f28487-fe45-4e85-9414-291b90f10f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:50.735135 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9508d-af47-40a1-a781-3701444d16a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=198900dd07e84fb2a9df84551cba3bbd)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:50.736934 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9508d-af47-40a1-a781-3701444d16a6 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:50.738538 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:50.740284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f28487-fe45-4e85-9414-291b90f10f91 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:50.777262 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1139/2281] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:50 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:50.778692 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f28487-fe45-4e85-9414-291b90f10f91 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:50.791117 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f28487-fe45-4e85-9414-291b90f10f91 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:50.800897 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1d5bb-c4b3-4781-9ea6-d4a71b2db589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:50.801999 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1d5bb-c4b3-4781-9ea6-d4a71b2db589 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:50.802742 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1d5bb-c4b3-4781-9ea6-d4a71b2db589 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:50.803912 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1d5bb-c4b3-4781-9ea6-d4a71b2db589 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:50.804648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1d5bb-c4b3-4781-9ea6-d4a71b2db589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:50.807001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1d5bb-c4b3-4781-9ea6-d4a71b2db589 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:50.824205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1140/2282] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:50.824406 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-d7b9508d-af47-40a1-a781-3701444d16a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '198900dd07e84fb2a9df84551cba3bbd', 'request_id': 'req-d7b9508d-af47-40a1-a781-3701444d16a6'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:50.828315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1d5bb-c4b3-4781-9ea6-d4a71b2db589 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:50.831613 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-d7b9508d-af47-40a1-a781-3701444d16a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '198900dd07e84fb2a9df84551cba3bbd', 'request_id': 'req-d7b9508d-af47-40a1-a781-3701444d16a6'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:50.840180 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1d5bb-c4b3-4781-9ea6-d4a71b2db589 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:50.841969 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-d7b9508d-af47-40a1-a781-3701444d16a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '198900dd07e84fb2a9df84551cba3bbd', 'request_id': 'req-d7b9508d-af47-40a1-a781-3701444d16a6'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:50.854277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-d7b9508d-af47-40a1-a781-3701444d16a6 admin admin] The token cache is being invalidate because project 198900dd07e84fb2a9df84551cba3bbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:50.855072 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-d7b9508d-af47-40a1-a781-3701444d16a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:50.855329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-d7b9508d-af47-40a1-a781-3701444d16a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:50.856867 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1143/2283] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:50 2022] DELETE /identity/v3/projects/198900dd07e84fb2a9df84551cba3bbd => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:50.918437 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a53c0-6995-4e70-9456-93d9d2661270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:50.919102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a53c0-6995-4e70-9456-93d9d2661270 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:50.919454 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a53c0-6995-4e70-9456-93d9d2661270 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:50.919804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a53c0-6995-4e70-9456-93d9d2661270 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:50.920585 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a53c0-6995-4e70-9456-93d9d2661270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:50.922540 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a53c0-6995-4e70-9456-93d9d2661270 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:50.942623 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1141/2284] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:50:50.942742 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9508d-af47-40a1-a781-3701444d16a6 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:50.942742 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d7b9508d-af47-40a1-a781-3701444d16a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:50.956806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9508d-af47-40a1-a781-3701444d16a6 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:50.964454 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b02abd-0a41-4709-84a9-47084a5fd4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:50.965557 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b02abd-0a41-4709-84a9-47084a5fd4ae admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:50.966008 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b02abd-0a41-4709-84a9-47084a5fd4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:50.966625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b02abd-0a41-4709-84a9-47084a5fd4ae admin admin] PATH_INFO: `/v3/projects/70c8f7c4ee7441ff8d5b670eadea74bf/users/96e4ebff7b4e44619f9829b3e51cbe83/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:50.988046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b02abd-0a41-4709-84a9-47084a5fd4ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c8f7c4ee7441ff8d5b670eadea74bf, user_id=96e4ebff7b4e44619f9829b3e51cbe83, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:50.992161 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b02abd-0a41-4709-84a9-47084a5fd4ae admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:51.023029 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1144/2285] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:50 2022] PUT /identity/v3/projects/70c8f7c4ee7441ff8d5b670eadea74bf/users/96e4ebff7b4e44619f9829b3e51cbe83/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:51.035924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ad36d-1c14-4afd-80a7-c09892f55696 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:51.036322 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ad36d-1c14-4afd-80a7-c09892f55696 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:51.036703 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ad36d-1c14-4afd-80a7-c09892f55696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:51.070200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-997ad36d-1c14-4afd-80a7-c09892f55696 None None] MFA Rules not processed for user `96e4ebff7b4e44619f9829b3e51cbe83`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:51.071602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-997ad36d-1c14-4afd-80a7-c09892f55696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:51.137920 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1142/2286] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:51.142472 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b02abd-0a41-4709-84a9-47084a5fd4ae admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:51.203306 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b02abd-0a41-4709-84a9-47084a5fd4ae admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:51.208580 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acdc0b-5fb5-4884-bf92-4869c264b721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:51.209743 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acdc0b-5fb5-4884-bf92-4869c264b721 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:51.210029 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acdc0b-5fb5-4884-bf92-4869c264b721 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:51.210308 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42acdc0b-5fb5-4884-bf92-4869c264b721 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:51.211005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acdc0b-5fb5-4884-bf92-4869c264b721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:51.212997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42acdc0b-5fb5-4884-bf92-4869c264b721 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:51.238577 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1145/2287] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:50:51 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:50:51.242734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ad36d-1c14-4afd-80a7-c09892f55696 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:51.253370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ad36d-1c14-4afd-80a7-c09892f55696 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:51.285446 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:51.310760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165757f8-117e-4e1b-b393-edcffe65130b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:51.311378 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165757f8-117e-4e1b-b393-edcffe65130b admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:51.311664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165757f8-117e-4e1b-b393-edcffe65130b admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:51.311942 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165757f8-117e-4e1b-b393-edcffe65130b admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:51.312597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165757f8-117e-4e1b-b393-edcffe65130b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:51.314537 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165757f8-117e-4e1b-b393-edcffe65130b admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:51.336108 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1143/2288] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:50:51 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:50:51.340158 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acdc0b-5fb5-4884-bf92-4869c264b721 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:51.350564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42acdc0b-5fb5-4884-bf92-4869c264b721 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:51.355315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fcc27-6232-4e7e-9a76-1b21dd68d69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:51.355928 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fcc27-6232-4e7e-9a76-1b21dd68d69d admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:51.356216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fcc27-6232-4e7e-9a76-1b21dd68d69d admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:51.356494 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6fcc27-6232-4e7e-9a76-1b21dd68d69d admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:51.357188 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fcc27-6232-4e7e-9a76-1b21dd68d69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:51.358854 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6fcc27-6232-4e7e-9a76-1b21dd68d69d admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:51.369241 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1146/2289] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:51.373112 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165757f8-117e-4e1b-b393-edcffe65130b admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:51.383369 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165757f8-117e-4e1b-b393-edcffe65130b admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:51.387985 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b10e06-016b-4e61-a301-b73da4ea40e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:51.388688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b10e06-016b-4e61-a301-b73da4ea40e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:51.388974 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b10e06-016b-4e61-a301-b73da4ea40e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:51.389252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b10e06-016b-4e61-a301-b73da4ea40e4 admin admin] PATH_INFO: `/v3/projects/d7382741654e4ee48fe41596507c5731/users/ded0b506a02b49f1af2eb05492de7085/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:51.404164 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b10e06-016b-4e61-a301-b73da4ea40e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7382741654e4ee48fe41596507c5731, user_id=ded0b506a02b49f1af2eb05492de7085, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:51.406860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b10e06-016b-4e61-a301-b73da4ea40e4 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:51.421433 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1144/2290] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:51 2022] PUT /identity/v3/projects/d7382741654e4ee48fe41596507c5731/users/ded0b506a02b49f1af2eb05492de7085/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:51.425461 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fcc27-6232-4e7e-9a76-1b21dd68d69d admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:51.435986 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6fcc27-6232-4e7e-9a76-1b21dd68d69d admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:51.473827 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:51.494053 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeceb4b-1021-4c2a-9ade-c9a4cca46859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:51.494807 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeceb4b-1021-4c2a-9ade-c9a4cca46859 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:51.495182 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeceb4b-1021-4c2a-9ade-c9a4cca46859 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:51.495533 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeceb4b-1021-4c2a-9ade-c9a4cca46859 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:51.496302 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeceb4b-1021-4c2a-9ade-c9a4cca46859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:51.497999 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeceb4b-1021-4c2a-9ade-c9a4cca46859 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:51.509130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1147/2291] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:50:51 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:50:51.513241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b10e06-016b-4e61-a301-b73da4ea40e4 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:51.533775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b10e06-016b-4e61-a301-b73da4ea40e4 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:51.540121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65ef4f-f8fe-4bd6-aedc-f0d05cab6199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:51.540913 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65ef4f-f8fe-4bd6-aedc-f0d05cab6199 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:51.541421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65ef4f-f8fe-4bd6-aedc-f0d05cab6199 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:51.541776 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c65ef4f-f8fe-4bd6-aedc-f0d05cab6199 admin admin] PATH_INFO: `/v3/projects/d7382741654e4ee48fe41596507c5731/users/ded0b506a02b49f1af2eb05492de7085/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:51.543920 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65ef4f-f8fe-4bd6-aedc-f0d05cab6199 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7382741654e4ee48fe41596507c5731, user_id=ded0b506a02b49f1af2eb05492de7085, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:51.546788 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c65ef4f-f8fe-4bd6-aedc-f0d05cab6199 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:51.558015 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1145/2292] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:50:51 2022] PUT /identity/v3/projects/d7382741654e4ee48fe41596507c5731/users/ded0b506a02b49f1af2eb05492de7085/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:51.568045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cac1c-511f-4183-b062-31aa9750f8c6 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:51.568936 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cac1c-511f-4183-b062-31aa9750f8c6 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:51.569237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7cac1c-511f-4183-b062-31aa9750f8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:51.598266 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-ac7cac1c-511f-4183-b062-31aa9750f8c6 None None] MFA Rules not processed for user `ded0b506a02b49f1af2eb05492de7085`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:51.599622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ac7cac1c-511f-4183-b062-31aa9750f8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:51.678613 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1148/2293] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:51 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:51.690740 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65ef4f-f8fe-4bd6-aedc-f0d05cab6199 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:51.692437 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-3c65ef4f-f8fe-4bd6-aedc-f0d05cab6199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:51.753940 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c65ef4f-f8fe-4bd6-aedc-f0d05cab6199 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:51.758283 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e3741-273d-4ec6-a82b-e3415509e412 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:51.758951 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e3741-273d-4ec6-a82b-e3415509e412 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:51.759235 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e3741-273d-4ec6-a82b-e3415509e412 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:51.759511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e3741-273d-4ec6-a82b-e3415509e412 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:51.768598 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e3741-273d-4ec6-a82b-e3415509e412 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:51.770027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e3741-273d-4ec6-a82b-e3415509e412 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:51.779526 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1146/2294] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:52.382368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cac1c-511f-4183-b062-31aa9750f8c6 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:52.383793 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ac7cac1c-511f-4183-b062-31aa9750f8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:52.397232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7cac1c-511f-4183-b062-31aa9750f8c6 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:52.401088 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028c63f-9cf3-489a-90f6-d4f74d8c6e1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:52.401709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028c63f-9cf3-489a-90f6-d4f74d8c6e1b service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:52.401996 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028c63f-9cf3-489a-90f6-d4f74d8c6e1b service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:52.402276 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8028c63f-9cf3-489a-90f6-d4f74d8c6e1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:52.404224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8028c63f-9cf3-489a-90f6-d4f74d8c6e1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:52.467395 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028c63f-9cf3-489a-90f6-d4f74d8c6e1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:52.468839 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8028c63f-9cf3-489a-90f6-d4f74d8c6e1b service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:52.479180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1149/2295] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:56.530661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e3741-273d-4ec6-a82b-e3415509e412 service cinder] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:56.539966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e3741-273d-4ec6-a82b-e3415509e412 service cinder] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:56.543726 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278c2ed-a9ec-404d-8144-6cba7bb68b61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:56.544336 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278c2ed-a9ec-404d-8144-6cba7bb68b61 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:56.544622 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278c2ed-a9ec-404d-8144-6cba7bb68b61 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:56.544924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278c2ed-a9ec-404d-8144-6cba7bb68b61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:56.622304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278c2ed-a9ec-404d-8144-6cba7bb68b61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:56.624053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9278c2ed-a9ec-404d-8144-6cba7bb68b61 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:56.635912 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1147/2296] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:50:58.849706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028c63f-9cf3-489a-90f6-d4f74d8c6e1b service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:58.851185 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8028c63f-9cf3-489a-90f6-d4f74d8c6e1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:58.920359 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278c2ed-a9ec-404d-8144-6cba7bb68b61 service cinder] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:58.933169 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8028c63f-9cf3-489a-90f6-d4f74d8c6e1b service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:58.938063 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3813db-a999-46a1-a79a-3668ac216501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:58.938815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3813db-a999-46a1-a79a-3668ac216501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:58.939096 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3813db-a999-46a1-a79a-3668ac216501 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:58.939370 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3813db-a999-46a1-a79a-3668ac216501 admin admin] PATH_INFO: `/v3/users/b3fb7d0ea372494abe19bb7d2710acf8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:58.940535 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3813db-a999-46a1-a79a-3668ac216501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3fb7d0ea372494abe19bb7d2710acf8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:58.942736 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3813db-a999-46a1-a79a-3668ac216501 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:58.944913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:58.953383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:58.988408 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278c2ed-a9ec-404d-8144-6cba7bb68b61 service cinder] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:58.992892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ad3813db-a999-46a1-a79a-3668ac216501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3fb7d0ea372494abe19bb7d2710acf8'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:58.993550 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ad3813db-a999-46a1-a79a-3668ac216501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3fb7d0ea372494abe19bb7d2710acf8'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:58.993679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e8458-1f1d-4a2a-8af2-d2b08703bf35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:58.994316 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e8458-1f1d-4a2a-8af2-d2b08703bf35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:58.994651 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e8458-1f1d-4a2a-8af2-d2b08703bf35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:58.994931 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e8458-1f1d-4a2a-8af2-d2b08703bf35 admin admin] PATH_INFO: `/v3/users/8a1ef14361194c789137a000ba3118e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:58.996120 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e8458-1f1d-4a2a-8af2-d2b08703bf35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a1ef14361194c789137a000ba3118e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:58.998095 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e8458-1f1d-4a2a-8af2-d2b08703bf35 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:59.005334 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ad3813db-a999-46a1-a79a-3668ac216501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3fb7d0ea372494abe19bb7d2710acf8'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.012959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ad3813db-a999-46a1-a79a-3668ac216501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3fb7d0ea372494abe19bb7d2710acf8'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.022101 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ad3813db-a999-46a1-a79a-3668ac216501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3fb7d0ea372494abe19bb7d2710acf8'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.028304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1150/2297] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:58 2022] DELETE /identity/v3/users/b3fb7d0ea372494abe19bb7d2710acf8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:59.045631 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-796e8458-1f1d-4a2a-8af2-d2b08703bf35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a1ef14361194c789137a000ba3118e8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.046276 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-796e8458-1f1d-4a2a-8af2-d2b08703bf35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a1ef14361194c789137a000ba3118e8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.055245 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-796e8458-1f1d-4a2a-8af2-d2b08703bf35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a1ef14361194c789137a000ba3118e8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.067313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-796e8458-1f1d-4a2a-8af2-d2b08703bf35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a1ef14361194c789137a000ba3118e8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.067958 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-796e8458-1f1d-4a2a-8af2-d2b08703bf35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a1ef14361194c789137a000ba3118e8'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.080951 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1148/2298] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:58 2022] DELETE /identity/v3/users/8a1ef14361194c789137a000ba3118e8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:59.085627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81390dc6-f54f-4bb4-876d-b278737a691e None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:59.085913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81390dc6-f54f-4bb4-876d-b278737a691e None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:59.086186 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81390dc6-f54f-4bb4-876d-b278737a691e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:59.106368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-81390dc6-f54f-4bb4-876d-b278737a691e None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:59.107568 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-81390dc6-f54f-4bb4-876d-b278737a691e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:59.177280 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1151/2299] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:50:59.188380 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e8458-1f1d-4a2a-8af2-d2b08703bf35 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:59.189977 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-796e8458-1f1d-4a2a-8af2-d2b08703bf35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:59.212051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81390dc6-f54f-4bb4-876d-b278737a691e None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:59.213492 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-81390dc6-f54f-4bb4-876d-b278737a691e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:59.227949 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81390dc6-f54f-4bb4-876d-b278737a691e None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:59.235366 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c1e6e-4626-4827-a806-4c5f8a5137f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:59.236350 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c1e6e-4626-4827-a806-4c5f8a5137f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:59.237073 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c1e6e-4626-4827-a806-4c5f8a5137f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:59.237356 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c1e6e-4626-4827-a806-4c5f8a5137f6 admin admin] PATH_INFO: `/v3/projects/032cc2d3fea44ade860219e360d4397c` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:59.238956 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c1e6e-4626-4827-a806-4c5f8a5137f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=032cc2d3fea44ade860219e360d4397c)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:59.242405 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c1e6e-4626-4827-a806-4c5f8a5137f6 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:59.254446 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e8458-1f1d-4a2a-8af2-d2b08703bf35 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:59.259764 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c00ce-079c-4972-a919-25e99a579315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:59.260381 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c00ce-079c-4972-a919-25e99a579315 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:59.260685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c00ce-079c-4972-a919-25e99a579315 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:59.260942 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c00ce-079c-4972-a919-25e99a579315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:59.271353 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c00ce-079c-4972-a919-25e99a579315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:59.272937 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57c00ce-079c-4972-a919-25e99a579315 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:59.282986 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1149/2300] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:50:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:50:59.289555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-929c1e6e-4626-4827-a806-4c5f8a5137f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '032cc2d3fea44ade860219e360d4397c', 'request_id': 'req-929c1e6e-4626-4827-a806-4c5f8a5137f6'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.295054 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-929c1e6e-4626-4827-a806-4c5f8a5137f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '032cc2d3fea44ade860219e360d4397c', 'request_id': 'req-929c1e6e-4626-4827-a806-4c5f8a5137f6'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.303519 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-929c1e6e-4626-4827-a806-4c5f8a5137f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '032cc2d3fea44ade860219e360d4397c', 'request_id': 'req-929c1e6e-4626-4827-a806-4c5f8a5137f6'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.314918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-929c1e6e-4626-4827-a806-4c5f8a5137f6 admin admin] The token cache is being invalidate because project 032cc2d3fea44ade860219e360d4397c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:59.315208 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-929c1e6e-4626-4827-a806-4c5f8a5137f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.315863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-929c1e6e-4626-4827-a806-4c5f8a5137f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.317388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1152/2301] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:59 2022] DELETE /identity/v3/projects/032cc2d3fea44ade860219e360d4397c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:59.321769 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c00ce-079c-4972-a919-25e99a579315 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:59.331750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c00ce-079c-4972-a919-25e99a579315 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:59.387360 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:59.400069 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a9bbe-8c11-455b-bef9-e00bdae9bdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:59.400749 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a9bbe-8c11-455b-bef9-e00bdae9bdbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:59.401028 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a9bbe-8c11-455b-bef9-e00bdae9bdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:59.401328 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a9bbe-8c11-455b-bef9-e00bdae9bdbc admin admin] PATH_INFO: `/v3/users/ab5ea1fce13d4a11b44e7543b65dc26b` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:59.402732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a9bbe-8c11-455b-bef9-e00bdae9bdbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab5ea1fce13d4a11b44e7543b65dc26b)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:59.404653 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a9bbe-8c11-455b-bef9-e00bdae9bdbc admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:59.453825 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-5d9a9bbe-8c11-455b-bef9-e00bdae9bdbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab5ea1fce13d4a11b44e7543b65dc26b'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.454533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-5d9a9bbe-8c11-455b-bef9-e00bdae9bdbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab5ea1fce13d4a11b44e7543b65dc26b'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.462763 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-5d9a9bbe-8c11-455b-bef9-e00bdae9bdbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab5ea1fce13d4a11b44e7543b65dc26b'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.476878 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-5d9a9bbe-8c11-455b-bef9-e00bdae9bdbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab5ea1fce13d4a11b44e7543b65dc26b'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.477652 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-5d9a9bbe-8c11-455b-bef9-e00bdae9bdbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab5ea1fce13d4a11b44e7543b65dc26b'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.499064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1150/2302] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:59 2022] DELETE /identity/v3/users/ab5ea1fce13d4a11b44e7543b65dc26b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:59.580530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c1e6e-4626-4827-a806-4c5f8a5137f6 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:59.582780 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-929c1e6e-4626-4827-a806-4c5f8a5137f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:59.592939 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:59.602873 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c1e6e-4626-4827-a806-4c5f8a5137f6 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:59.672015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b6d4b-f39d-4ff4-ae74-0aa154cb7dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:59.672716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b6d4b-f39d-4ff4-ae74-0aa154cb7dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:59.673027 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b6d4b-f39d-4ff4-ae74-0aa154cb7dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:59.673336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236b6d4b-f39d-4ff4-ae74-0aa154cb7dc9 admin admin] PATH_INFO: `/v3/projects/4fefe125e5ec4578a02007024dd01060` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:59.674593 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b6d4b-f39d-4ff4-ae74-0aa154cb7dc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fefe125e5ec4578a02007024dd01060)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:59.676512 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236b6d4b-f39d-4ff4-ae74-0aa154cb7dc9 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:59.731474 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a9bbe-8c11-455b-bef9-e00bdae9bdbc admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:59.732957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5d9a9bbe-8c11-455b-bef9-e00bdae9bdbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:59.733210 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-236b6d4b-f39d-4ff4-ae74-0aa154cb7dc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fefe125e5ec4578a02007024dd01060', 'request_id': 'req-236b6d4b-f39d-4ff4-ae74-0aa154cb7dc9'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.741410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-236b6d4b-f39d-4ff4-ae74-0aa154cb7dc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fefe125e5ec4578a02007024dd01060', 'request_id': 'req-236b6d4b-f39d-4ff4-ae74-0aa154cb7dc9'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.749271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a9bbe-8c11-455b-bef9-e00bdae9bdbc admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:59.766936 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-236b6d4b-f39d-4ff4-ae74-0aa154cb7dc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fefe125e5ec4578a02007024dd01060', 'request_id': 'req-236b6d4b-f39d-4ff4-ae74-0aa154cb7dc9'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.784436 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-236b6d4b-f39d-4ff4-ae74-0aa154cb7dc9 admin admin] The token cache is being invalidate because project 4fefe125e5ec4578a02007024dd01060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:59.784815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-236b6d4b-f39d-4ff4-ae74-0aa154cb7dc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.785585 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-236b6d4b-f39d-4ff4-ae74-0aa154cb7dc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.788623 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1153/2303] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:59 2022] DELETE /identity/v3/projects/4fefe125e5ec4578a02007024dd01060 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:50:59.806175 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b6d4b-f39d-4ff4-ae74-0aa154cb7dc9 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:50:59.808940 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-236b6d4b-f39d-4ff4-ae74-0aa154cb7dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:59.826831 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b3acc-cc71-42f7-8363-52bf8a7eee8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:59.827482 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b3acc-cc71-42f7-8363-52bf8a7eee8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:59.827811 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b3acc-cc71-42f7-8363-52bf8a7eee8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:59.828088 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b3acc-cc71-42f7-8363-52bf8a7eee8d admin admin] PATH_INFO: `/v3/projects/db9f2230ed8e428e9a0de71a40f0ebd6` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:59.829313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b3acc-cc71-42f7-8363-52bf8a7eee8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=db9f2230ed8e428e9a0de71a40f0ebd6)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:59.831308 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b3acc-cc71-42f7-8363-52bf8a7eee8d admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:50:59.882231 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236b6d4b-f39d-4ff4-ae74-0aa154cb7dc9 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:50:59.882827 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-662b3acc-cc71-42f7-8363-52bf8a7eee8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db9f2230ed8e428e9a0de71a40f0ebd6', 'request_id': 'req-662b3acc-cc71-42f7-8363-52bf8a7eee8d'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.889674 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-662b3acc-cc71-42f7-8363-52bf8a7eee8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db9f2230ed8e428e9a0de71a40f0ebd6', 'request_id': 'req-662b3acc-cc71-42f7-8363-52bf8a7eee8d'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.897588 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-662b3acc-cc71-42f7-8363-52bf8a7eee8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db9f2230ed8e428e9a0de71a40f0ebd6', 'request_id': 'req-662b3acc-cc71-42f7-8363-52bf8a7eee8d'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.909916 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:59.915839 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-662b3acc-cc71-42f7-8363-52bf8a7eee8d admin admin] The token cache is being invalidate because project db9f2230ed8e428e9a0de71a40f0ebd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:50:59.916138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-662b3acc-cc71-42f7-8363-52bf8a7eee8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.917165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-662b3acc-cc71-42f7-8363-52bf8a7eee8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:50:59.918841 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1151/2304] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:50:59 2022] DELETE /identity/v3/projects/db9f2230ed8e428e9a0de71a40f0ebd6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:50:59.923863 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357942fe-57a6-4532-881f-2ac2f05bb044 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:59.924391 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357942fe-57a6-4532-881f-2ac2f05bb044 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:59.924732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357942fe-57a6-4532-881f-2ac2f05bb044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:59.939719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:50:59.950439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-357942fe-57a6-4532-881f-2ac2f05bb044 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:50:59.951691 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-357942fe-57a6-4532-881f-2ac2f05bb044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:50:59.965647 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69b0c8-9d42-46f3-b0d0-f0e222c17fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:50:59.966408 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69b0c8-9d42-46f3-b0d0-f0e222c17fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:50:59.966700 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69b0c8-9d42-46f3-b0d0-f0e222c17fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:50:59.967573 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69b0c8-9d42-46f3-b0d0-f0e222c17fe5 admin admin] PATH_INFO: `/v3/users/96e4ebff7b4e44619f9829b3e51cbe83` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:50:59.968787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69b0c8-9d42-46f3-b0d0-f0e222c17fe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96e4ebff7b4e44619f9829b3e51cbe83)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:50:59.970783 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69b0c8-9d42-46f3-b0d0-f0e222c17fe5 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:00.041765 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ac69b0c8-9d42-46f3-b0d0-f0e222c17fe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96e4ebff7b4e44619f9829b3e51cbe83'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:00.042652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ac69b0c8-9d42-46f3-b0d0-f0e222c17fe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96e4ebff7b4e44619f9829b3e51cbe83'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:00.043431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1152/2305] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:50:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:51:00.044865 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5a9e3-49fb-4fff-9dd3-3c840cf45e6b None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:00.045155 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5a9e3-49fb-4fff-9dd3-3c840cf45e6b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:00.045434 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c5a9e3-49fb-4fff-9dd3-3c840cf45e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:00.057965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ac69b0c8-9d42-46f3-b0d0-f0e222c17fe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96e4ebff7b4e44619f9829b3e51cbe83'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:00.065577 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ac69b0c8-9d42-46f3-b0d0-f0e222c17fe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96e4ebff7b4e44619f9829b3e51cbe83'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:00.067067 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-56c5a9e3-49fb-4fff-9dd3-3c840cf45e6b None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:00.069147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-56c5a9e3-49fb-4fff-9dd3-3c840cf45e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:00.078677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ac69b0c8-9d42-46f3-b0d0-f0e222c17fe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96e4ebff7b4e44619f9829b3e51cbe83'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:00.086488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1153/2306] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:00.087518 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5a9e3-49fb-4fff-9dd3-3c840cf45e6b None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:00.089395 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1154/2307] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:50:59 2022] DELETE /identity/v3/users/96e4ebff7b4e44619f9829b3e51cbe83 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:51:00.100090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c5a9e3-49fb-4fff-9dd3-3c840cf45e6b None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:00.170039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f4752-c87a-40ff-917f-533945c64e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:00.170703 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f4752-c87a-40ff-917f-533945c64e0d admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:00.170994 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f4752-c87a-40ff-917f-533945c64e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:00.171318 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f4752-c87a-40ff-917f-533945c64e0d admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:00.172152 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f4752-c87a-40ff-917f-533945c64e0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:51:00.172465 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f4752-c87a-40ff-917f-533945c64e0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:00.174161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f4752-c87a-40ff-917f-533945c64e0d admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:00.190294 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1154/2308] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:51:00.191546 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69b0c8-9d42-46f3-b0d0-f0e222c17fe5 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:00.193054 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ac69b0c8-9d42-46f3-b0d0-f0e222c17fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:00.206074 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69b0c8-9d42-46f3-b0d0-f0e222c17fe5 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:00.211948 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683c540-3039-459e-b9c9-07147219f9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:00.212756 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683c540-3039-459e-b9c9-07147219f9c3 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:00.213048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683c540-3039-459e-b9c9-07147219f9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:00.213355 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683c540-3039-459e-b9c9-07147219f9c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:00.214028 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683c540-3039-459e-b9c9-07147219f9c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:00.216012 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683c540-3039-459e-b9c9-07147219f9c3 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:00.244352 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1155/2309] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:51:00 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:51:00.248485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f4752-c87a-40ff-917f-533945c64e0d admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:00.259195 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f4752-c87a-40ff-917f-533945c64e0d admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:00.325495 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6968d-bea9-4958-b467-8cbc13851bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:00.326441 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6968d-bea9-4958-b467-8cbc13851bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:00.326735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6968d-bea9-4958-b467-8cbc13851bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:00.327018 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6968d-bea9-4958-b467-8cbc13851bb3 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:00.327716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6968d-bea9-4958-b467-8cbc13851bb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:00.329964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6968d-bea9-4958-b467-8cbc13851bb3 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:00.354864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1155/2310] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:51:00 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:51:00.359484 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683c540-3039-459e-b9c9-07147219f9c3 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:00.372875 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683c540-3039-459e-b9c9-07147219f9c3 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:00.377731 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2346dd-f899-4b70-9251-dc70e245b3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:00.378361 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2346dd-f899-4b70-9251-dc70e245b3fc admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:00.378667 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2346dd-f899-4b70-9251-dc70e245b3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:00.378943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2346dd-f899-4b70-9251-dc70e245b3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:00.379644 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2346dd-f899-4b70-9251-dc70e245b3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:00.381309 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2346dd-f899-4b70-9251-dc70e245b3fc admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:00.398694 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1156/2311] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:51:00.398922 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6968d-bea9-4958-b467-8cbc13851bb3 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:00.410610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6968d-bea9-4958-b467-8cbc13851bb3 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:00.419623 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac17db-072b-4600-89bb-17f7bcf6386a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:00.420688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac17db-072b-4600-89bb-17f7bcf6386a admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:00.420688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac17db-072b-4600-89bb-17f7bcf6386a admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:00.421098 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ac17db-072b-4600-89bb-17f7bcf6386a admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:00.421830 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac17db-072b-4600-89bb-17f7bcf6386a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:00.423649 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ac17db-072b-4600-89bb-17f7bcf6386a admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:00.435303 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1156/2312] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:51:00.439777 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2346dd-f899-4b70-9251-dc70e245b3fc admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:00.452798 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2346dd-f899-4b70-9251-dc70e245b3fc admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:00.457876 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5b2aa8-aaa0-4f4d-b845-3315bbb18ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:00.459091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b2aa8-aaa0-4f4d-b845-3315bbb18ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:00.459380 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b2aa8-aaa0-4f4d-b845-3315bbb18ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:00.459654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5b2aa8-aaa0-4f4d-b845-3315bbb18ecb admin admin] PATH_INFO: `/v3/projects/89946c2112d2425498165b20dea49426/users/ffbcf30aa9ee4f599f79c3de0065c49c/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:00.469826 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac17db-072b-4600-89bb-17f7bcf6386a admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:00.471645 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-75ac17db-072b-4600-89bb-17f7bcf6386a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:00.478110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b2aa8-aaa0-4f4d-b845-3315bbb18ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=89946c2112d2425498165b20dea49426, user_id=ffbcf30aa9ee4f599f79c3de0065c49c, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:00.481257 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5b2aa8-aaa0-4f4d-b845-3315bbb18ecb admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:00.490240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ac17db-072b-4600-89bb-17f7bcf6386a admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:00.496786 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0011b5-e576-4242-a89b-1ac0df1752af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:00.497878 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0011b5-e576-4242-a89b-1ac0df1752af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:00.498225 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0011b5-e576-4242-a89b-1ac0df1752af admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:00.498549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0011b5-e576-4242-a89b-1ac0df1752af admin admin] PATH_INFO: `/v3/projects/70c8f7c4ee7441ff8d5b670eadea74bf` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:00.500386 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0011b5-e576-4242-a89b-1ac0df1752af admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c8f7c4ee7441ff8d5b670eadea74bf)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:00.502719 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0011b5-e576-4242-a89b-1ac0df1752af admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:00.504689 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:00.514707 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1157/2313] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:51:00 2022] PUT /identity/v3/projects/89946c2112d2425498165b20dea49426/users/ffbcf30aa9ee4f599f79c3de0065c49c/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:00.525437 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becba3d5-68b5-4285-b708-e5b94dabf5e7 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:00.525726 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becba3d5-68b5-4285-b708-e5b94dabf5e7 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:00.526044 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becba3d5-68b5-4285-b708-e5b94dabf5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:00.556533 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-becba3d5-68b5-4285-b708-e5b94dabf5e7 None None] MFA Rules not processed for user `ffbcf30aa9ee4f599f79c3de0065c49c`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:00.558794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-becba3d5-68b5-4285-b708-e5b94dabf5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:00.568272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-ef0011b5-e576-4242-a89b-1ac0df1752af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c8f7c4ee7441ff8d5b670eadea74bf', 'request_id': 'req-ef0011b5-e576-4242-a89b-1ac0df1752af'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:00.575880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-ef0011b5-e576-4242-a89b-1ac0df1752af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c8f7c4ee7441ff8d5b670eadea74bf', 'request_id': 'req-ef0011b5-e576-4242-a89b-1ac0df1752af'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:00.584904 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-ef0011b5-e576-4242-a89b-1ac0df1752af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c8f7c4ee7441ff8d5b670eadea74bf', 'request_id': 'req-ef0011b5-e576-4242-a89b-1ac0df1752af'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:00.600130 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-ef0011b5-e576-4242-a89b-1ac0df1752af admin admin] The token cache is being invalidate because project 70c8f7c4ee7441ff8d5b670eadea74bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:51:00.600781 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-ef0011b5-e576-4242-a89b-1ac0df1752af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:00.601640 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-ef0011b5-e576-4242-a89b-1ac0df1752af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:00.603881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1157/2314] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:51:00 2022] DELETE /identity/v3/projects/70c8f7c4ee7441ff8d5b670eadea74bf => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:51:00.607482 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0011b5-e576-4242-a89b-1ac0df1752af admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:00.609684 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ef0011b5-e576-4242-a89b-1ac0df1752af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:00.624339 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:00.649716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1158/2315] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:00.654007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becba3d5-68b5-4285-b708-e5b94dabf5e7 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:00.655540 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-becba3d5-68b5-4285-b708-e5b94dabf5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:00.689248 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0011b5-e576-4242-a89b-1ac0df1752af admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:00.696090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15153502-25a9-4892-9006-e812c0a0a487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:00.696090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15153502-25a9-4892-9006-e812c0a0a487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:00.696377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15153502-25a9-4892-9006-e812c0a0a487 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:00.696677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15153502-25a9-4892-9006-e812c0a0a487 admin admin] PATH_INFO: `/v3/users/ded0b506a02b49f1af2eb05492de7085` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:00.697943 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15153502-25a9-4892-9006-e812c0a0a487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ded0b506a02b49f1af2eb05492de7085)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:00.699905 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15153502-25a9-4892-9006-e812c0a0a487 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:00.733858 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becba3d5-68b5-4285-b708-e5b94dabf5e7 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:00.739441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589df1a-e1ea-43c4-8393-875b61ed4d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:00.740178 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589df1a-e1ea-43c4-8393-875b61ed4d2f admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:00.740476 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589df1a-e1ea-43c4-8393-875b61ed4d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:00.740762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589df1a-e1ea-43c4-8393-875b61ed4d2f admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:00.741442 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589df1a-e1ea-43c4-8393-875b61ed4d2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:00.743500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589df1a-e1ea-43c4-8393-875b61ed4d2f admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:00.762604 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-15153502-25a9-4892-9006-e812c0a0a487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ded0b506a02b49f1af2eb05492de7085'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:00.763319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-15153502-25a9-4892-9006-e812c0a0a487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ded0b506a02b49f1af2eb05492de7085'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:00.772912 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-15153502-25a9-4892-9006-e812c0a0a487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ded0b506a02b49f1af2eb05492de7085'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:00.779218 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1159/2316] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:51:00 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:51:00.783425 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589df1a-e1ea-43c4-8393-875b61ed4d2f admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:00.786330 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-15153502-25a9-4892-9006-e812c0a0a487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ded0b506a02b49f1af2eb05492de7085'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:00.787651 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-15153502-25a9-4892-9006-e812c0a0a487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ded0b506a02b49f1af2eb05492de7085'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:00.801369 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1158/2317] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:51:00 2022] DELETE /identity/v3/users/ded0b506a02b49f1af2eb05492de7085 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:00.872432 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589df1a-e1ea-43c4-8393-875b61ed4d2f admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:00.945608 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d5630-bda0-4f87-ae4a-a9c1b70ac751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:00.946291 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d5630-bda0-4f87-ae4a-a9c1b70ac751 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:00.946565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d5630-bda0-4f87-ae4a-a9c1b70ac751 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:00.946815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d5630-bda0-4f87-ae4a-a9c1b70ac751 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:00.947484 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d5630-bda0-4f87-ae4a-a9c1b70ac751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:00.949579 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77d5630-bda0-4f87-ae4a-a9c1b70ac751 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:00.976062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1160/2318] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:51:00 2022] POST /identity/v3/users => generated 298 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:51:00.977539 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15153502-25a9-4892-9006-e812c0a0a487 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:00.979523 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-15153502-25a9-4892-9006-e812c0a0a487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:00.995815 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15153502-25a9-4892-9006-e812c0a0a487 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:01.002266 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962b722-3eac-43fa-9df8-f3eae6ad9300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:01.002935 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962b722-3eac-43fa-9df8-f3eae6ad9300 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:01.003629 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962b722-3eac-43fa-9df8-f3eae6ad9300 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:01.003629 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962b722-3eac-43fa-9df8-f3eae6ad9300 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:01.004194 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962b722-3eac-43fa-9df8-f3eae6ad9300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:01.006376 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962b722-3eac-43fa-9df8-f3eae6ad9300 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:01.008790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:01.022662 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1159/2319] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:51:01.024355 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d5630-bda0-4f87-ae4a-a9c1b70ac751 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:01.038770 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d5630-bda0-4f87-ae4a-a9c1b70ac751 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:01.043539 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36672dd-9de6-499a-9079-41bc8c7d4149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:01.044226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36672dd-9de6-499a-9079-41bc8c7d4149 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:01.044511 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36672dd-9de6-499a-9079-41bc8c7d4149 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:01.044866 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36672dd-9de6-499a-9079-41bc8c7d4149 admin admin] PATH_INFO: `/v3/projects/87dab24da23242de849a784ce365f1fe/users/20cb7814a8574420b09709a9b6ea7fa7/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:01.059635 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:01.063151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36672dd-9de6-499a-9079-41bc8c7d4149 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87dab24da23242de849a784ce365f1fe, user_id=20cb7814a8574420b09709a9b6ea7fa7, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:01.066244 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36672dd-9de6-499a-9079-41bc8c7d4149 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:01.085550 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1161/2320] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:51:01 2022] PUT /identity/v3/projects/87dab24da23242de849a784ce365f1fe/users/20cb7814a8574420b09709a9b6ea7fa7/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:01.089308 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962b722-3eac-43fa-9df8-f3eae6ad9300 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:01.105089 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962b722-3eac-43fa-9df8-f3eae6ad9300 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:01.170740 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79880a24-da4d-47d1-b200-189fae31d5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:01.171484 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79880a24-da4d-47d1-b200-189fae31d5b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:01.171839 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79880a24-da4d-47d1-b200-189fae31d5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:01.172189 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79880a24-da4d-47d1-b200-189fae31d5b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:01.173057 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79880a24-da4d-47d1-b200-189fae31d5b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:01.174733 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79880a24-da4d-47d1-b200-189fae31d5b5 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:01.187916 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1160/2321] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:51:01.192101 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36672dd-9de6-499a-9079-41bc8c7d4149 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:01.205680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36672dd-9de6-499a-9079-41bc8c7d4149 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:01.212024 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798b03d0-8c5a-4268-9a13-f6149c211286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:01.212769 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b03d0-8c5a-4268-9a13-f6149c211286 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:01.213146 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b03d0-8c5a-4268-9a13-f6149c211286 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:01.213542 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798b03d0-8c5a-4268-9a13-f6149c211286 admin admin] PATH_INFO: `/v3/projects/87dab24da23242de849a784ce365f1fe/users/20cb7814a8574420b09709a9b6ea7fa7/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:01.215830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b03d0-8c5a-4268-9a13-f6149c211286 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87dab24da23242de849a784ce365f1fe, user_id=20cb7814a8574420b09709a9b6ea7fa7, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:01.218970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798b03d0-8c5a-4268-9a13-f6149c211286 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:01.227302 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79880a24-da4d-47d1-b200-189fae31d5b5 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:01.229280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-79880a24-da4d-47d1-b200-189fae31d5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:01.237267 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1162/2322] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:51:01 2022] PUT /identity/v3/projects/87dab24da23242de849a784ce365f1fe/users/20cb7814a8574420b09709a9b6ea7fa7/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:51:01.248767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b899f-9ffb-4c57-b8d5-a63498097b06 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:01.249080 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b899f-9ffb-4c57-b8d5-a63498097b06 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:01.250389 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303b899f-9ffb-4c57-b8d5-a63498097b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:01.257496 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79880a24-da4d-47d1-b200-189fae31d5b5 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:01.291354 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-303b899f-9ffb-4c57-b8d5-a63498097b06 None None] MFA Rules not processed for user `20cb7814a8574420b09709a9b6ea7fa7`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:01.292897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-303b899f-9ffb-4c57-b8d5-a63498097b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:01.316281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85ef107-a3fd-439d-a9d4-76c9a44ed88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:01.316926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ef107-a3fd-439d-a9d4-76c9a44ed88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:01.317206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ef107-a3fd-439d-a9d4-76c9a44ed88d admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:01.317481 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ef107-a3fd-439d-a9d4-76c9a44ed88d admin admin] PATH_INFO: `/v3/projects/d7382741654e4ee48fe41596507c5731` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:01.319196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ef107-a3fd-439d-a9d4-76c9a44ed88d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7382741654e4ee48fe41596507c5731)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:01.321088 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85ef107-a3fd-439d-a9d4-76c9a44ed88d admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:01.362786 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1163/2323] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:51:01.369207 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f85ef107-a3fd-439d-a9d4-76c9a44ed88d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7382741654e4ee48fe41596507c5731', 'request_id': 'req-f85ef107-a3fd-439d-a9d4-76c9a44ed88d'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:01.373896 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b899f-9ffb-4c57-b8d5-a63498097b06 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:01.375296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-303b899f-9ffb-4c57-b8d5-a63498097b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:01.375413 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f85ef107-a3fd-439d-a9d4-76c9a44ed88d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7382741654e4ee48fe41596507c5731', 'request_id': 'req-f85ef107-a3fd-439d-a9d4-76c9a44ed88d'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:01.381727 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f85ef107-a3fd-439d-a9d4-76c9a44ed88d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7382741654e4ee48fe41596507c5731', 'request_id': 'req-f85ef107-a3fd-439d-a9d4-76c9a44ed88d'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:01.397184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f85ef107-a3fd-439d-a9d4-76c9a44ed88d admin admin] The token cache is being invalidate because project d7382741654e4ee48fe41596507c5731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:51:01.397773 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f85ef107-a3fd-439d-a9d4-76c9a44ed88d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:01.398480 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f85ef107-a3fd-439d-a9d4-76c9a44ed88d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:01.400294 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1161/2324] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:51:01 2022] DELETE /identity/v3/projects/d7382741654e4ee48fe41596507c5731 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:51:01.406125 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728b5d4-156f-480b-8f50-3160f35196c9 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:01.406514 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728b5d4-156f-480b-8f50-3160f35196c9 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:01.406803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728b5d4-156f-480b-8f50-3160f35196c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:01.429448 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-e728b5d4-156f-480b-8f50-3160f35196c9 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:01.430750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e728b5d4-156f-480b-8f50-3160f35196c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:01.436572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303b899f-9ffb-4c57-b8d5-a63498097b06 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:01.450630 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:01.492620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475aabf-33e1-4d8e-a6c9-d6db6dbbbf29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:01.493323 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475aabf-33e1-4d8e-a6c9-d6db6dbbbf29 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:01.493622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475aabf-33e1-4d8e-a6c9-d6db6dbbbf29 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:01.493903 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475aabf-33e1-4d8e-a6c9-d6db6dbbbf29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:01.495973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d475aabf-33e1-4d8e-a6c9-d6db6dbbbf29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:01.506156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1162/2325] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:51:01.507572 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4502829-1de3-45f7-a1f3-336910f76735 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:01.507868 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4502829-1de3-45f7-a1f3-336910f76735 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:01.508190 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4502829-1de3-45f7-a1f3-336910f76735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:01.530121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-b4502829-1de3-45f7-a1f3-336910f76735 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:01.531559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-b4502829-1de3-45f7-a1f3-336910f76735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:01.543761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1163/2326] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:51:01.548000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4502829-1de3-45f7-a1f3-336910f76735 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:01.551345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:01.560033 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4502829-1de3-45f7-a1f3-336910f76735 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:01.566000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e79ac6-a4a8-4c17-9df6-3413da13f015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:01.566676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e79ac6-a4a8-4c17-9df6-3413da13f015 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:01.566959 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e79ac6-a4a8-4c17-9df6-3413da13f015 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:01.567232 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e79ac6-a4a8-4c17-9df6-3413da13f015 admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:01.567966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e79ac6-a4a8-4c17-9df6-3413da13f015 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:51:01.568276 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e79ac6-a4a8-4c17-9df6-3413da13f015 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:01.569867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e79ac6-a4a8-4c17-9df6-3413da13f015 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:01.589684 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1164/2327] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:51:01.591351 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e79ac6-a4a8-4c17-9df6-3413da13f015 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:01.596473 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475aabf-33e1-4d8e-a6c9-d6db6dbbbf29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:01.602408 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d475aabf-33e1-4d8e-a6c9-d6db6dbbbf29 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:01.603904 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e79ac6-a4a8-4c17-9df6-3413da13f015 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:01.609462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736521d-b9ce-4f3b-94f8-5952ea2d471b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:01.610093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736521d-b9ce-4f3b-94f8-5952ea2d471b admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:01.610399 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736521d-b9ce-4f3b-94f8-5952ea2d471b admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:01.610790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a736521d-b9ce-4f3b-94f8-5952ea2d471b admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:01.611344 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736521d-b9ce-4f3b-94f8-5952ea2d471b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:01.611738 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1164/2328] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:51:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:51:01.615917 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a736521d-b9ce-4f3b-94f8-5952ea2d471b admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:01.649083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1165/2329] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:51:01 2022] POST /identity/v3/projects => generated 399 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:51:01.653196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475aabf-33e1-4d8e-a6c9-d6db6dbbbf29 service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:01.664571 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475aabf-33e1-4d8e-a6c9-d6db6dbbbf29 service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:01.722385 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f32dce-bb13-421c-b6fc-147e86184675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:01.722999 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f32dce-bb13-421c-b6fc-147e86184675 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:01.723283 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f32dce-bb13-421c-b6fc-147e86184675 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:01.723562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f32dce-bb13-421c-b6fc-147e86184675 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:01.724857 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f32dce-bb13-421c-b6fc-147e86184675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:01.726842 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f32dce-bb13-421c-b6fc-147e86184675 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:01.748718 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1165/2330] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:51:01 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:51:01.752926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736521d-b9ce-4f3b-94f8-5952ea2d471b admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:01.763522 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a736521d-b9ce-4f3b-94f8-5952ea2d471b admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:01.770101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a516f-df51-4a11-bd58-40af5b96969d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:01.770865 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a516f-df51-4a11-bd58-40af5b96969d admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:01.771242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a516f-df51-4a11-bd58-40af5b96969d admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:01.771578 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a516f-df51-4a11-bd58-40af5b96969d admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:01.772286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a516f-df51-4a11-bd58-40af5b96969d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:01.773914 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a516f-df51-4a11-bd58-40af5b96969d admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:01.784109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1166/2331] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:51:01.788758 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f32dce-bb13-421c-b6fc-147e86184675 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:01.799497 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f32dce-bb13-421c-b6fc-147e86184675 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:01.805188 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3b1cd-d82b-400d-bc18-d3d4fcb349ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:01.805811 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3b1cd-d82b-400d-bc18-d3d4fcb349ba admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:01.806097 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3b1cd-d82b-400d-bc18-d3d4fcb349ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:01.806399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3b1cd-d82b-400d-bc18-d3d4fcb349ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:01.807117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3b1cd-d82b-400d-bc18-d3d4fcb349ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:01.808806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba3b1cd-d82b-400d-bc18-d3d4fcb349ba admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:01.819047 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1166/2332] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:51:01.823242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a516f-df51-4a11-bd58-40af5b96969d admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:01.833433 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a516f-df51-4a11-bd58-40af5b96969d admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:01.838446 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0014f5-2137-412a-9e81-761fb7dafe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:01.839116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0014f5-2137-412a-9e81-761fb7dafe25 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:01.839385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0014f5-2137-412a-9e81-761fb7dafe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:01.839660 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0014f5-2137-412a-9e81-761fb7dafe25 admin admin] PATH_INFO: `/v3/projects/32239e24aadf4432acec2b8eefe8ed04/users/f1327adba6d144aca8c727c405b3f6fb/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:01.854530 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0014f5-2137-412a-9e81-761fb7dafe25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32239e24aadf4432acec2b8eefe8ed04, user_id=f1327adba6d144aca8c727c405b3f6fb, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:01.857168 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0014f5-2137-412a-9e81-761fb7dafe25 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:01.870917 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1167/2333] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:51:01 2022] PUT /identity/v3/projects/32239e24aadf4432acec2b8eefe8ed04/users/f1327adba6d144aca8c727c405b3f6fb/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:01.883239 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a163df-6df9-4a6b-b745-92aaf414e8e8 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:01.883537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a163df-6df9-4a6b-b745-92aaf414e8e8 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:01.883827 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a163df-6df9-4a6b-b745-92aaf414e8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:01.917604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-63a163df-6df9-4a6b-b745-92aaf414e8e8 None None] MFA Rules not processed for user `f1327adba6d144aca8c727c405b3f6fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:01.918877 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-63a163df-6df9-4a6b-b745-92aaf414e8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:02.008236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1167/2334] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:02.013161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0014f5-2137-412a-9e81-761fb7dafe25 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:02.075445 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0014f5-2137-412a-9e81-761fb7dafe25 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:02.080097 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bc470-13ee-4974-9d95-37a9a70a3fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:02.080716 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bc470-13ee-4974-9d95-37a9a70a3fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:02.081004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bc470-13ee-4974-9d95-37a9a70a3fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:02.081286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bc470-13ee-4974-9d95-37a9a70a3fb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:02.081963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bc470-13ee-4974-9d95-37a9a70a3fb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:02.085272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bc470-13ee-4974-9d95-37a9a70a3fb0 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:02.115385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1168/2335] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:51:02 2022] POST /identity/v3/projects => generated 401 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:51:02.116340 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a163df-6df9-4a6b-b745-92aaf414e8e8 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:02.127229 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a163df-6df9-4a6b-b745-92aaf414e8e8 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:02.168714 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:02.188753 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c758c12-da03-4618-ab1e-a53ee024be16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:02.189375 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c758c12-da03-4618-ab1e-a53ee024be16 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:02.189659 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c758c12-da03-4618-ab1e-a53ee024be16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:02.189969 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c758c12-da03-4618-ab1e-a53ee024be16 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:02.190670 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c758c12-da03-4618-ab1e-a53ee024be16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:02.192589 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c758c12-da03-4618-ab1e-a53ee024be16 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:02.217558 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1168/2336] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:51:02 2022] POST /identity/v3/users => generated 307 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:51:02.218834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bc470-13ee-4974-9d95-37a9a70a3fb0 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:02.229936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bc470-13ee-4974-9d95-37a9a70a3fb0 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:02.234703 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2582675-94e6-4cc6-a782-57dbd8fa23e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:02.235322 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2582675-94e6-4cc6-a782-57dbd8fa23e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:02.235608 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2582675-94e6-4cc6-a782-57dbd8fa23e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:02.235887 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2582675-94e6-4cc6-a782-57dbd8fa23e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:02.236741 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2582675-94e6-4cc6-a782-57dbd8fa23e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:02.238372 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2582675-94e6-4cc6-a782-57dbd8fa23e5 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:02.252364 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1169/2337] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:51:02.253675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c758c12-da03-4618-ab1e-a53ee024be16 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:02.263737 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c758c12-da03-4618-ab1e-a53ee024be16 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:02.268648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b556856-9983-4953-bb20-c9d4f38b8cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:02.269316 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b556856-9983-4953-bb20-c9d4f38b8cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:02.269603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b556856-9983-4953-bb20-c9d4f38b8cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:02.269886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b556856-9983-4953-bb20-c9d4f38b8cfd admin admin] PATH_INFO: `/v3/projects/860ac46de20f41ab99b6113c98f60a63/users/c32769f1890943b4985a28da6613a372/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:02.285156 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b556856-9983-4953-bb20-c9d4f38b8cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=860ac46de20f41ab99b6113c98f60a63, user_id=c32769f1890943b4985a28da6613a372, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:02.288501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b556856-9983-4953-bb20-c9d4f38b8cfd admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:02.302946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1169/2338] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:51:02 2022] PUT /identity/v3/projects/860ac46de20f41ab99b6113c98f60a63/users/c32769f1890943b4985a28da6613a372/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:02.306383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2582675-94e6-4cc6-a782-57dbd8fa23e5 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:02.316329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2582675-94e6-4cc6-a782-57dbd8fa23e5 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:02.340184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:02.344042 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e1d0c-3f32-43fb-9455-4c5c18196b4f None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:02.344394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e1d0c-3f32-43fb-9455-4c5c18196b4f None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:02.344738 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668e1d0c-3f32-43fb-9455-4c5c18196b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:02.363724 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-668e1d0c-3f32-43fb-9455-4c5c18196b4f None None] MFA Rules not processed for user `5b1e09a2671c433c8562763ca83c4596`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:02.364970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-668e1d0c-3f32-43fb-9455-4c5c18196b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:02.378942 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349eb85f-057a-4019-93c0-7020263d472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:02.379565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eb85f-057a-4019-93c0-7020263d472a admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:02.379850 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eb85f-057a-4019-93c0-7020263d472a admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:02.380159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349eb85f-057a-4019-93c0-7020263d472a admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:02.381402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349eb85f-057a-4019-93c0-7020263d472a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:02.383021 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349eb85f-057a-4019-93c0-7020263d472a admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:02.392850 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1170/2339] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:51:02.397443 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349eb85f-057a-4019-93c0-7020263d472a admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:02.407129 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349eb85f-057a-4019-93c0-7020263d472a admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:02.412391 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361525c5-9880-4865-ab54-0dadccc02088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:02.413131 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361525c5-9880-4865-ab54-0dadccc02088 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:02.413418 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361525c5-9880-4865-ab54-0dadccc02088 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:02.413697 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361525c5-9880-4865-ab54-0dadccc02088 admin admin] PATH_INFO: `/v3/projects/860ac46de20f41ab99b6113c98f60a63/users/c32769f1890943b4985a28da6613a372/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:02.415790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361525c5-9880-4865-ab54-0dadccc02088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=860ac46de20f41ab99b6113c98f60a63, user_id=c32769f1890943b4985a28da6613a372, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:02.418515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361525c5-9880-4865-ab54-0dadccc02088 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:02.424292 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1170/2340] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:51:02.429153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1171/2341] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:51:02 2022] PUT /identity/v3/projects/860ac46de20f41ab99b6113c98f60a63/users/c32769f1890943b4985a28da6613a372/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:51:02.438954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc27c2-f24b-4487-ba0d-73be24131eaf None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:02.439245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc27c2-f24b-4487-ba0d-73be24131eaf None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:02.439526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc27c2-f24b-4487-ba0d-73be24131eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:02.468604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-89bc27c2-f24b-4487-ba0d-73be24131eaf None None] MFA Rules not processed for user `c32769f1890943b4985a28da6613a372`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:02.469837 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-89bc27c2-f24b-4487-ba0d-73be24131eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:02.542204 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1171/2342] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:02 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:02.554032 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361525c5-9880-4865-ab54-0dadccc02088 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:02.555760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-361525c5-9880-4865-ab54-0dadccc02088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:02.620006 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361525c5-9880-4865-ab54-0dadccc02088 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:02.623975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e92b0b-b859-4d37-8a85-e3235d65da13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:02.624675 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e92b0b-b859-4d37-8a85-e3235d65da13 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:02.624959 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e92b0b-b859-4d37-8a85-e3235d65da13 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:02.625239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e92b0b-b859-4d37-8a85-e3235d65da13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:02.635588 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e92b0b-b859-4d37-8a85-e3235d65da13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:02.637021 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e92b0b-b859-4d37-8a85-e3235d65da13 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:02.647603 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1172/2343] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:51:02 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:51:02.724347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc27c2-f24b-4487-ba0d-73be24131eaf None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:02.734352 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc27c2-f24b-4487-ba0d-73be24131eaf None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:02.738220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306e31d-eed4-4a34-b6d8-6d129b370e48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:02.738995 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306e31d-eed4-4a34-b6d8-6d129b370e48 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:02.739348 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306e31d-eed4-4a34-b6d8-6d129b370e48 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:02.739713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306e31d-eed4-4a34-b6d8-6d129b370e48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:02.775215 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:02.800735 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306e31d-eed4-4a34-b6d8-6d129b370e48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:02.802124 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306e31d-eed4-4a34-b6d8-6d129b370e48 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:02.811743 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1172/2344] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:51:02 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:51:05.979606 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e92b0b-b859-4d37-8a85-e3235d65da13 service cinder] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:05.981568 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-85e92b0b-b859-4d37-8a85-e3235d65da13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:05.995998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e92b0b-b859-4d37-8a85-e3235d65da13 service cinder] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:05.999638 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32f45b-c84b-4d79-8a50-121d183c604e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:06.000251 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32f45b-c84b-4d79-8a50-121d183c604e service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:06.000535 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32f45b-c84b-4d79-8a50-121d183c604e service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:06.000808 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32f45b-c84b-4d79-8a50-121d183c604e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:06.002586 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-4e32f45b-c84b-4d79-8a50-121d183c604e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:06.070308 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32f45b-c84b-4d79-8a50-121d183c604e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:06.071799 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32f45b-c84b-4d79-8a50-121d183c604e service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:06.082184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1173/2345] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:51:05 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:51:06.971242 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306e31d-eed4-4a34-b6d8-6d129b370e48 service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:07.041157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306e31d-eed4-4a34-b6d8-6d129b370e48 service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:07.046224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7e210-8276-4204-9833-ccde38483ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:07.047045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7e210-8276-4204-9833-ccde38483ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:07.047426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7e210-8276-4204-9833-ccde38483ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:07.047850 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7e210-8276-4204-9833-ccde38483ffe admin admin] PATH_INFO: `/v3/users/f1327adba6d144aca8c727c405b3f6fb` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:07.049114 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7e210-8276-4204-9833-ccde38483ffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1327adba6d144aca8c727c405b3f6fb)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:07.051131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7e210-8276-4204-9833-ccde38483ffe admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:07.098482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-6fc7e210-8276-4204-9833-ccde38483ffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1327adba6d144aca8c727c405b3f6fb'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:07.099126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-6fc7e210-8276-4204-9833-ccde38483ffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1327adba6d144aca8c727c405b3f6fb'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:07.111281 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-6fc7e210-8276-4204-9833-ccde38483ffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1327adba6d144aca8c727c405b3f6fb'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:07.118169 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-6fc7e210-8276-4204-9833-ccde38483ffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1327adba6d144aca8c727c405b3f6fb'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:07.125113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-6fc7e210-8276-4204-9833-ccde38483ffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1327adba6d144aca8c727c405b3f6fb'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:07.131521 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1173/2346] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:51:06 2022] DELETE /identity/v3/users/f1327adba6d144aca8c727c405b3f6fb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:07.136563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774a074-6f59-43f6-b36e-b93315170605 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:07.137042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774a074-6f59-43f6-b36e-b93315170605 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:07.137155 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774a074-6f59-43f6-b36e-b93315170605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:07.156061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-8774a074-6f59-43f6-b36e-b93315170605 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:07.157261 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8774a074-6f59-43f6-b36e-b93315170605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:07.194569 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:07.216259 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1174/2347] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:07.225694 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7e210-8276-4204-9833-ccde38483ffe admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:07.227085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6fc7e210-8276-4204-9833-ccde38483ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:07.283368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7e210-8276-4204-9833-ccde38483ffe admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:07.287699 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a392ea-ddae-4b76-822f-6591a0aa0991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:07.288762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a392ea-ddae-4b76-822f-6591a0aa0991 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:07.289306 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a392ea-ddae-4b76-822f-6591a0aa0991 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:07.289791 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a392ea-ddae-4b76-822f-6591a0aa0991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:07.298890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:07.301223 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a392ea-ddae-4b76-822f-6591a0aa0991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:07.303496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a392ea-ddae-4b76-822f-6591a0aa0991 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:07.318917 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1174/2348] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:51:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:51:07.598442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774a074-6f59-43f6-b36e-b93315170605 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:07.600564 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8774a074-6f59-43f6-b36e-b93315170605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:07.622037 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774a074-6f59-43f6-b36e-b93315170605 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:07.628378 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19940d5b-e245-400e-8af3-5e70ccb7cd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:07.629602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19940d5b-e245-400e-8af3-5e70ccb7cd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:07.629896 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19940d5b-e245-400e-8af3-5e70ccb7cd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:07.630182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19940d5b-e245-400e-8af3-5e70ccb7cd40 admin admin] PATH_INFO: `/v3/projects/32239e24aadf4432acec2b8eefe8ed04` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:07.631467 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19940d5b-e245-400e-8af3-5e70ccb7cd40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32239e24aadf4432acec2b8eefe8ed04)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:07.642054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19940d5b-e245-400e-8af3-5e70ccb7cd40 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:07.715233 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-19940d5b-e245-400e-8af3-5e70ccb7cd40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32239e24aadf4432acec2b8eefe8ed04', 'request_id': 'req-19940d5b-e245-400e-8af3-5e70ccb7cd40'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:07.723109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-19940d5b-e245-400e-8af3-5e70ccb7cd40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32239e24aadf4432acec2b8eefe8ed04', 'request_id': 'req-19940d5b-e245-400e-8af3-5e70ccb7cd40'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:07.730531 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-19940d5b-e245-400e-8af3-5e70ccb7cd40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32239e24aadf4432acec2b8eefe8ed04', 'request_id': 'req-19940d5b-e245-400e-8af3-5e70ccb7cd40'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:07.744206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-19940d5b-e245-400e-8af3-5e70ccb7cd40 admin admin] The token cache is being invalidate because project 32239e24aadf4432acec2b8eefe8ed04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:51:07.744496 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-19940d5b-e245-400e-8af3-5e70ccb7cd40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:07.745149 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-19940d5b-e245-400e-8af3-5e70ccb7cd40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:07.746732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1175/2349] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:51:07 2022] DELETE /identity/v3/projects/32239e24aadf4432acec2b8eefe8ed04 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:07.750943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a392ea-ddae-4b76-822f-6591a0aa0991 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:07.760893 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a392ea-ddae-4b76-822f-6591a0aa0991 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:07.824553 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fddd88-2ab6-4c96-8306-e316c4241c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:07.825298 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fddd88-2ab6-4c96-8306-e316c4241c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:07.825537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fddd88-2ab6-4c96-8306-e316c4241c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:07.825784 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fddd88-2ab6-4c96-8306-e316c4241c92 admin admin] PATH_INFO: `/v3/users/c32769f1890943b4985a28da6613a372` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:07.827087 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fddd88-2ab6-4c96-8306-e316c4241c92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c32769f1890943b4985a28da6613a372)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:07.828992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fddd88-2ab6-4c96-8306-e316c4241c92 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:07.883113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e0fddd88-2ab6-4c96-8306-e316c4241c92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c32769f1890943b4985a28da6613a372'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:07.883788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e0fddd88-2ab6-4c96-8306-e316c4241c92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c32769f1890943b4985a28da6613a372'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:07.896659 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e0fddd88-2ab6-4c96-8306-e316c4241c92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c32769f1890943b4985a28da6613a372'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:07.903797 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e0fddd88-2ab6-4c96-8306-e316c4241c92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c32769f1890943b4985a28da6613a372'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:07.913417 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-e0fddd88-2ab6-4c96-8306-e316c4241c92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c32769f1890943b4985a28da6613a372'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:07.920473 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1175/2350] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:51:07 2022] DELETE /identity/v3/users/c32769f1890943b4985a28da6613a372 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:08.201670 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19940d5b-e245-400e-8af3-5e70ccb7cd40 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:08.204017 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-19940d5b-e245-400e-8af3-5e70ccb7cd40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:08.220357 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19940d5b-e245-400e-8af3-5e70ccb7cd40 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:08.281399 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68340428-27a4-45d7-b521-bdc6e5838f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:08.282048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68340428-27a4-45d7-b521-bdc6e5838f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:08.282334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68340428-27a4-45d7-b521-bdc6e5838f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:08.282655 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68340428-27a4-45d7-b521-bdc6e5838f3f admin admin] PATH_INFO: `/v3/projects/860ac46de20f41ab99b6113c98f60a63` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:08.283809 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68340428-27a4-45d7-b521-bdc6e5838f3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=860ac46de20f41ab99b6113c98f60a63)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:08.285711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68340428-27a4-45d7-b521-bdc6e5838f3f admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:08.330688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-68340428-27a4-45d7-b521-bdc6e5838f3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '860ac46de20f41ab99b6113c98f60a63', 'request_id': 'req-68340428-27a4-45d7-b521-bdc6e5838f3f'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:08.337640 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-68340428-27a4-45d7-b521-bdc6e5838f3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '860ac46de20f41ab99b6113c98f60a63', 'request_id': 'req-68340428-27a4-45d7-b521-bdc6e5838f3f'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:08.343185 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-68340428-27a4-45d7-b521-bdc6e5838f3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '860ac46de20f41ab99b6113c98f60a63', 'request_id': 'req-68340428-27a4-45d7-b521-bdc6e5838f3f'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:08.346677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:08.356307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-68340428-27a4-45d7-b521-bdc6e5838f3f admin admin] The token cache is being invalidate because project 860ac46de20f41ab99b6113c98f60a63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:51:08.356702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-68340428-27a4-45d7-b521-bdc6e5838f3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:08.357646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-68340428-27a4-45d7-b521-bdc6e5838f3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:08.359350 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1176/2351] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:51:08 2022] DELETE /identity/v3/projects/860ac46de20f41ab99b6113c98f60a63 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:08.364306 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681fa16-be79-4b2f-8cfe-96147efaa0d3 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:08.364758 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681fa16-be79-4b2f-8cfe-96147efaa0d3 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:08.364912 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2681fa16-be79-4b2f-8cfe-96147efaa0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:08.385901 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-2681fa16-be79-4b2f-8cfe-96147efaa0d3 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:08.387162 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-2681fa16-be79-4b2f-8cfe-96147efaa0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:08.446443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1176/2352] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:51:08.455128 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6cd72-1f2d-44e2-ae3d-a3882fcf0e5e None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:08.455413 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6cd72-1f2d-44e2-ae3d-a3882fcf0e5e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:08.455692 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6cd72-1f2d-44e2-ae3d-a3882fcf0e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:08.475942 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-8fd6cd72-1f2d-44e2-ae3d-a3882fcf0e5e None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:08.477137 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8fd6cd72-1f2d-44e2-ae3d-a3882fcf0e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:08.484928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1177/2353] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:08.489131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681fa16-be79-4b2f-8cfe-96147efaa0d3 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:08.498870 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2681fa16-be79-4b2f-8cfe-96147efaa0d3 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:08.503459 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac815d31-233c-4a85-8d89-b5aecb128da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:08.504069 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac815d31-233c-4a85-8d89-b5aecb128da3 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:08.504358 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac815d31-233c-4a85-8d89-b5aecb128da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:08.504640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac815d31-233c-4a85-8d89-b5aecb128da3 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:08.506011 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac815d31-233c-4a85-8d89-b5aecb128da3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:51:08.506325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac815d31-233c-4a85-8d89-b5aecb128da3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:08.508005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac815d31-233c-4a85-8d89-b5aecb128da3 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:08.519614 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1177/2354] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:51:08.524602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6cd72-1f2d-44e2-ae3d-a3882fcf0e5e None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:08.533786 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6cd72-1f2d-44e2-ae3d-a3882fcf0e5e None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:08.540119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94b756-b92d-4a95-939c-245d86d606d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:08.541109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94b756-b92d-4a95-939c-245d86d606d2 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:08.541605 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94b756-b92d-4a95-939c-245d86d606d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:08.542123 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94b756-b92d-4a95-939c-245d86d606d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:08.543105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94b756-b92d-4a95-939c-245d86d606d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:08.545551 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94b756-b92d-4a95-939c-245d86d606d2 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:08.572809 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1178/2355] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:51:08 2022] POST /identity/v3/projects => generated 409 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:51:08.577228 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac815d31-233c-4a85-8d89-b5aecb128da3 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:08.582677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:08.589651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac815d31-233c-4a85-8d89-b5aecb128da3 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:08.645201 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d226fa-fc6b-492a-9c6b-729190837702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:08.645865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d226fa-fc6b-492a-9c6b-729190837702 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:08.646762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d226fa-fc6b-492a-9c6b-729190837702 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:08.647041 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d226fa-fc6b-492a-9c6b-729190837702 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:08.647716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d226fa-fc6b-492a-9c6b-729190837702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:08.649621 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d226fa-fc6b-492a-9c6b-729190837702 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:08.669667 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1178/2356] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:51:08 2022] POST /identity/v3/users => generated 305 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:51:08.673874 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94b756-b92d-4a95-939c-245d86d606d2 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:08.684793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94b756-b92d-4a95-939c-245d86d606d2 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:08.689372 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c0acf-afd7-4f20-9e89-72773918af07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:08.689988 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c0acf-afd7-4f20-9e89-72773918af07 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:08.690276 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c0acf-afd7-4f20-9e89-72773918af07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:08.690588 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c0acf-afd7-4f20-9e89-72773918af07 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:08.691288 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c0acf-afd7-4f20-9e89-72773918af07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:08.693412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c0acf-afd7-4f20-9e89-72773918af07 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:08.703539 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1179/2357] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:51:08.707696 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d226fa-fc6b-492a-9c6b-729190837702 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:08.717712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d226fa-fc6b-492a-9c6b-729190837702 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:08.722375 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059aa520-af0b-4844-b888-df5118185eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:08.722997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aa520-af0b-4844-b888-df5118185eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:08.723285 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aa520-af0b-4844-b888-df5118185eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:08.723564 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059aa520-af0b-4844-b888-df5118185eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:08.724355 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059aa520-af0b-4844-b888-df5118185eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:08.725864 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059aa520-af0b-4844-b888-df5118185eb3 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:08.736645 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1179/2358] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:51:08.741807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c0acf-afd7-4f20-9e89-72773918af07 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:08.752409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c0acf-afd7-4f20-9e89-72773918af07 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:08.758006 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36fc2a-ba26-4de7-ac2e-5062255fe085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:08.758707 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36fc2a-ba26-4de7-ac2e-5062255fe085 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:08.759023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36fc2a-ba26-4de7-ac2e-5062255fe085 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:08.759301 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36fc2a-ba26-4de7-ac2e-5062255fe085 admin admin] PATH_INFO: `/v3/projects/898986f71786421f93e60c00257157b8/users/54f8813537dd477486e543c4749ce17a/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:08.774153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36fc2a-ba26-4de7-ac2e-5062255fe085 admin admin] RBAC: Authorizing `identity:create_grant(project_id=898986f71786421f93e60c00257157b8, user_id=54f8813537dd477486e543c4749ce17a, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:08.777209 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e36fc2a-ba26-4de7-ac2e-5062255fe085 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:08.791304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1180/2359] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:51:08 2022] PUT /identity/v3/projects/898986f71786421f93e60c00257157b8/users/54f8813537dd477486e543c4749ce17a/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:08.801381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb74f3-1eb9-491b-8486-826de4a19032 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:08.801995 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb74f3-1eb9-491b-8486-826de4a19032 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:08.802762 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb74f3-1eb9-491b-8486-826de4a19032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:08.831185 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-5ddb74f3-1eb9-491b-8486-826de4a19032 None None] MFA Rules not processed for user `54f8813537dd477486e543c4749ce17a`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:08.832748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-5ddb74f3-1eb9-491b-8486-826de4a19032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:08.902909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1180/2360] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:08 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:08.909160 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36fc2a-ba26-4de7-ac2e-5062255fe085 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:08.986284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36fc2a-ba26-4de7-ac2e-5062255fe085 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:08.992498 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d8675-0a3b-4be0-8155-751e9c09de4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:08.993246 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d8675-0a3b-4be0-8155-751e9c09de4e admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:08.993554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d8675-0a3b-4be0-8155-751e9c09de4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:08.993877 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d8675-0a3b-4be0-8155-751e9c09de4e admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:08.994772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d8675-0a3b-4be0-8155-751e9c09de4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:08.997037 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d8675-0a3b-4be0-8155-751e9c09de4e admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:09.034947 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1181/2361] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:51:08 2022] POST /identity/v3/projects => generated 409 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:51:09.039795 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb74f3-1eb9-491b-8486-826de4a19032 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:09.056109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddb74f3-1eb9-491b-8486-826de4a19032 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:09.130974 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddec13b-752c-4fa5-9645-d56aeeb5f56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:09.131818 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddec13b-752c-4fa5-9645-d56aeeb5f56b admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:09.132144 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddec13b-752c-4fa5-9645-d56aeeb5f56b admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:09.132434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddec13b-752c-4fa5-9645-d56aeeb5f56b admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:09.133344 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddec13b-752c-4fa5-9645-d56aeeb5f56b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:09.135481 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddec13b-752c-4fa5-9645-d56aeeb5f56b admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:09.155263 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:09.162460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1181/2362] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:51:09 2022] POST /identity/v3/users => generated 311 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:51:09.166675 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d8675-0a3b-4be0-8155-751e9c09de4e admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:09.179708 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d8675-0a3b-4be0-8155-751e9c09de4e admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:09.184469 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb630a-3454-4e7f-bad9-dcf04b1d6b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:09.185085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb630a-3454-4e7f-bad9-dcf04b1d6b5d admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:09.185368 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb630a-3454-4e7f-bad9-dcf04b1d6b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:09.185642 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebb630a-3454-4e7f-bad9-dcf04b1d6b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:09.186335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb630a-3454-4e7f-bad9-dcf04b1d6b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:09.187948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebb630a-3454-4e7f-bad9-dcf04b1d6b5d admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:09.203536 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1182/2363] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:51:09.204770 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddec13b-752c-4fa5-9645-d56aeeb5f56b admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:09.215428 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddec13b-752c-4fa5-9645-d56aeeb5f56b admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:09.220085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70184ce-900d-4af7-a1e3-4f0a30739edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:09.220829 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70184ce-900d-4af7-a1e3-4f0a30739edd admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:09.221181 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70184ce-900d-4af7-a1e3-4f0a30739edd admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:09.221527 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70184ce-900d-4af7-a1e3-4f0a30739edd admin admin] PATH_INFO: `/v3/projects/c4a3804163d340e9921cfea5dd7ce4e6/users/9657d84b462b42afac3c4cb4892ec6c3/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:09.238055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70184ce-900d-4af7-a1e3-4f0a30739edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a3804163d340e9921cfea5dd7ce4e6, user_id=9657d84b462b42afac3c4cb4892ec6c3, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:09.241458 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70184ce-900d-4af7-a1e3-4f0a30739edd admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:09.264306 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1182/2364] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:51:09 2022] PUT /identity/v3/projects/c4a3804163d340e9921cfea5dd7ce4e6/users/9657d84b462b42afac3c4cb4892ec6c3/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:51:09.267506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb630a-3454-4e7f-bad9-dcf04b1d6b5d admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:09.278922 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebb630a-3454-4e7f-bad9-dcf04b1d6b5d admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:09.342229 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45592abe-5b7e-41c4-95c6-021df349bf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:09.342896 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45592abe-5b7e-41c4-95c6-021df349bf7b admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:09.343187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45592abe-5b7e-41c4-95c6-021df349bf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:09.343466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45592abe-5b7e-41c4-95c6-021df349bf7b admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:09.344176 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45592abe-5b7e-41c4-95c6-021df349bf7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:09.346305 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45592abe-5b7e-41c4-95c6-021df349bf7b admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:09.358126 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1183/2365] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:51:09.362249 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70184ce-900d-4af7-a1e3-4f0a30739edd admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:09.373630 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70184ce-900d-4af7-a1e3-4f0a30739edd admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:09.379803 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31532948-dc20-46e1-83d4-082bd55d1e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:09.380536 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31532948-dc20-46e1-83d4-082bd55d1e98 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:09.380825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31532948-dc20-46e1-83d4-082bd55d1e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:09.381114 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31532948-dc20-46e1-83d4-082bd55d1e98 admin admin] PATH_INFO: `/v3/projects/c4a3804163d340e9921cfea5dd7ce4e6/users/9657d84b462b42afac3c4cb4892ec6c3/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:09.383122 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31532948-dc20-46e1-83d4-082bd55d1e98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4a3804163d340e9921cfea5dd7ce4e6, user_id=9657d84b462b42afac3c4cb4892ec6c3, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:09.386090 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31532948-dc20-46e1-83d4-082bd55d1e98 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:09.399392 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1183/2366] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:51:09 2022] PUT /identity/v3/projects/c4a3804163d340e9921cfea5dd7ce4e6/users/9657d84b462b42afac3c4cb4892ec6c3/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:09.409582 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d72637-0cbb-4c37-aef0-838189af566c None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:09.410294 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d72637-0cbb-4c37-aef0-838189af566c None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:09.410668 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d72637-0cbb-4c37-aef0-838189af566c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:09.420112 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:09.447567 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-27d72637-0cbb-4c37-aef0-838189af566c None None] MFA Rules not processed for user `9657d84b462b42afac3c4cb4892ec6c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:09.449031 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-27d72637-0cbb-4c37-aef0-838189af566c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:09.533506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1184/2367] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:09 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:51:09.539043 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31532948-dc20-46e1-83d4-082bd55d1e98 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:09.540952 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-31532948-dc20-46e1-83d4-082bd55d1e98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:09.609466 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31532948-dc20-46e1-83d4-082bd55d1e98 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:09.613212 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c46ab9-44e4-49bd-bc8b-77b8715a8b28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:09.613874 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c46ab9-44e4-49bd-bc8b-77b8715a8b28 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:09.614167 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c46ab9-44e4-49bd-bc8b-77b8715a8b28 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:09.614488 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c46ab9-44e4-49bd-bc8b-77b8715a8b28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:09.624304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c46ab9-44e4-49bd-bc8b-77b8715a8b28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:09.625784 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c46ab9-44e4-49bd-bc8b-77b8715a8b28 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:09.635655 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1184/2368] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:51:09 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:51:09.789617 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d72637-0cbb-4c37-aef0-838189af566c None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:09.799115 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d72637-0cbb-4c37-aef0-838189af566c None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:09.802749 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df02cd-c7db-417b-962e-ede6b8f7356c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:09.803452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df02cd-c7db-417b-962e-ede6b8f7356c service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:09.803733 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df02cd-c7db-417b-962e-ede6b8f7356c service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:09.804007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df02cd-c7db-417b-962e-ede6b8f7356c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:09.862004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df02cd-c7db-417b-962e-ede6b8f7356c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:09.863485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df02cd-c7db-417b-962e-ede6b8f7356c service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:09.872909 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1185/2369] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:51:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:51:11.027805 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c46ab9-44e4-49bd-bc8b-77b8715a8b28 service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:11.029279 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a9c46ab9-44e4-49bd-bc8b-77b8715a8b28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:11.093554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c46ab9-44e4-49bd-bc8b-77b8715a8b28 service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:11.098103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380377e1-e613-4ced-b75d-5ab613a39473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:11.098780 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380377e1-e613-4ced-b75d-5ab613a39473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:11.099706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380377e1-e613-4ced-b75d-5ab613a39473 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:11.099987 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380377e1-e613-4ced-b75d-5ab613a39473 admin admin] PATH_INFO: `/v3/users/ffbcf30aa9ee4f599f79c3de0065c49c` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:11.101152 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380377e1-e613-4ced-b75d-5ab613a39473 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffbcf30aa9ee4f599f79c3de0065c49c)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:11.103103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380377e1-e613-4ced-b75d-5ab613a39473 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:11.147494 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-380377e1-e613-4ced-b75d-5ab613a39473 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffbcf30aa9ee4f599f79c3de0065c49c'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:11.148158 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-380377e1-e613-4ced-b75d-5ab613a39473 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffbcf30aa9ee4f599f79c3de0065c49c'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:11.159791 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-380377e1-e613-4ced-b75d-5ab613a39473 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffbcf30aa9ee4f599f79c3de0065c49c'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:11.162843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:11.168618 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-380377e1-e613-4ced-b75d-5ab613a39473 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffbcf30aa9ee4f599f79c3de0065c49c'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:11.176624 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-380377e1-e613-4ced-b75d-5ab613a39473 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffbcf30aa9ee4f599f79c3de0065c49c'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:11.182802 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1185/2370] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:51:11 2022] DELETE /identity/v3/users/ffbcf30aa9ee4f599f79c3de0065c49c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:11.187636 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f511d-5b38-44d0-9936-7e41e24d3815 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:11.188106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f511d-5b38-44d0-9936-7e41e24d3815 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:11.188202 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f511d-5b38-44d0-9936-7e41e24d3815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:11.206942 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-423f511d-5b38-44d0-9936-7e41e24d3815 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:11.208886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-423f511d-5b38-44d0-9936-7e41e24d3815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:11.276299 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1186/2371] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:51:11.285865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380377e1-e613-4ced-b75d-5ab613a39473 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:11.287922 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-380377e1-e613-4ced-b75d-5ab613a39473 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:11.350388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380377e1-e613-4ced-b75d-5ab613a39473 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:11.354021 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a672b4-f3b4-483b-bb0b-2ffdd8402c65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:11.354676 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a672b4-f3b4-483b-bb0b-2ffdd8402c65 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:11.354959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a672b4-f3b4-483b-bb0b-2ffdd8402c65 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:11.355265 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a672b4-f3b4-483b-bb0b-2ffdd8402c65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:11.364381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a672b4-f3b4-483b-bb0b-2ffdd8402c65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:11.366049 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a672b4-f3b4-483b-bb0b-2ffdd8402c65 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:11.375599 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1186/2372] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:51:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:51:11.732393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f511d-5b38-44d0-9936-7e41e24d3815 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:11.734061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-423f511d-5b38-44d0-9936-7e41e24d3815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:11.747118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f511d-5b38-44d0-9936-7e41e24d3815 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:11.752221 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed7c1a-ca3b-4a51-809c-847d7eadfb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:11.752951 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed7c1a-ca3b-4a51-809c-847d7eadfb5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:11.753304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed7c1a-ca3b-4a51-809c-847d7eadfb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:11.753681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed7c1a-ca3b-4a51-809c-847d7eadfb5c admin admin] PATH_INFO: `/v3/projects/89946c2112d2425498165b20dea49426` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:11.755887 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed7c1a-ca3b-4a51-809c-847d7eadfb5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=89946c2112d2425498165b20dea49426)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:11.757470 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed7c1a-ca3b-4a51-809c-847d7eadfb5c admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:11.782119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:11.808295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-beed7c1a-ca3b-4a51-809c-847d7eadfb5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89946c2112d2425498165b20dea49426', 'request_id': 'req-beed7c1a-ca3b-4a51-809c-847d7eadfb5c'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:11.815106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-beed7c1a-ca3b-4a51-809c-847d7eadfb5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89946c2112d2425498165b20dea49426', 'request_id': 'req-beed7c1a-ca3b-4a51-809c-847d7eadfb5c'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:11.821807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-beed7c1a-ca3b-4a51-809c-847d7eadfb5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89946c2112d2425498165b20dea49426', 'request_id': 'req-beed7c1a-ca3b-4a51-809c-847d7eadfb5c'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:11.835421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-beed7c1a-ca3b-4a51-809c-847d7eadfb5c admin admin] The token cache is being invalidate because project 89946c2112d2425498165b20dea49426 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:51:11.835704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-beed7c1a-ca3b-4a51-809c-847d7eadfb5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:11.836340 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-beed7c1a-ca3b-4a51-809c-847d7eadfb5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:11.838020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1187/2373] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:51:11 2022] DELETE /identity/v3/projects/89946c2112d2425498165b20dea49426 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:11.842009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a672b4-f3b4-483b-bb0b-2ffdd8402c65 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:11.852518 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a672b4-f3b4-483b-bb0b-2ffdd8402c65 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:11.915813 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d9411-52ac-460c-b0e6-4a1e003d26d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:11.916452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d9411-52ac-460c-b0e6-4a1e003d26d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:11.916735 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d9411-52ac-460c-b0e6-4a1e003d26d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:11.917010 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d9411-52ac-460c-b0e6-4a1e003d26d6 admin admin] PATH_INFO: `/v3/users/20cb7814a8574420b09709a9b6ea7fa7` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:11.918158 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d9411-52ac-460c-b0e6-4a1e003d26d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20cb7814a8574420b09709a9b6ea7fa7)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:11.920104 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d9411-52ac-460c-b0e6-4a1e003d26d6 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:11.965360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-739d9411-52ac-460c-b0e6-4a1e003d26d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20cb7814a8574420b09709a9b6ea7fa7'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:11.966159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-739d9411-52ac-460c-b0e6-4a1e003d26d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20cb7814a8574420b09709a9b6ea7fa7'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:11.977709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-739d9411-52ac-460c-b0e6-4a1e003d26d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20cb7814a8574420b09709a9b6ea7fa7'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:11.984581 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-739d9411-52ac-460c-b0e6-4a1e003d26d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20cb7814a8574420b09709a9b6ea7fa7'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:11.992965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-739d9411-52ac-460c-b0e6-4a1e003d26d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20cb7814a8574420b09709a9b6ea7fa7'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:11.998694 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1187/2374] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:51:11 2022] DELETE /identity/v3/users/20cb7814a8574420b09709a9b6ea7fa7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:51:12.279495 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed7c1a-ca3b-4a51-809c-847d7eadfb5c admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:12.281309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-beed7c1a-ca3b-4a51-809c-847d7eadfb5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:12.295308 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed7c1a-ca3b-4a51-809c-847d7eadfb5c admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:12.354220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648e068a-9137-4c0d-bbd5-56040e79e823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:12.354911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e068a-9137-4c0d-bbd5-56040e79e823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:12.355202 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e068a-9137-4c0d-bbd5-56040e79e823 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:12.355487 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648e068a-9137-4c0d-bbd5-56040e79e823 admin admin] PATH_INFO: `/v3/projects/87dab24da23242de849a784ce365f1fe` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:12.356672 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e068a-9137-4c0d-bbd5-56040e79e823 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87dab24da23242de849a784ce365f1fe)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:12.358685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648e068a-9137-4c0d-bbd5-56040e79e823 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:12.403880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-648e068a-9137-4c0d-bbd5-56040e79e823 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87dab24da23242de849a784ce365f1fe', 'request_id': 'req-648e068a-9137-4c0d-bbd5-56040e79e823'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:12.409845 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-648e068a-9137-4c0d-bbd5-56040e79e823 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87dab24da23242de849a784ce365f1fe', 'request_id': 'req-648e068a-9137-4c0d-bbd5-56040e79e823'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:12.416295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-648e068a-9137-4c0d-bbd5-56040e79e823 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87dab24da23242de849a784ce365f1fe', 'request_id': 'req-648e068a-9137-4c0d-bbd5-56040e79e823'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:12.428001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-648e068a-9137-4c0d-bbd5-56040e79e823 admin admin] The token cache is being invalidate because project 87dab24da23242de849a784ce365f1fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:51:12.428284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-648e068a-9137-4c0d-bbd5-56040e79e823 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:12.428899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-648e068a-9137-4c0d-bbd5-56040e79e823 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:12.430409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1188/2375] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:51:12 2022] DELETE /identity/v3/projects/87dab24da23242de849a784ce365f1fe => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:12.436214 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4caefb-7f99-47f2-8bac-8566a13123ea None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:12.436686 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4caefb-7f99-47f2-8bac-8566a13123ea None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:12.436802 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4caefb-7f99-47f2-8bac-8566a13123ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:12.450816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:12.458822 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-5a4caefb-7f99-47f2-8bac-8566a13123ea None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:12.460721 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-5a4caefb-7f99-47f2-8bac-8566a13123ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:12.520143 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1188/2376] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:12.531664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056945a-b5d6-4782-9841-b7e30295495e None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:12.531962 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056945a-b5d6-4782-9841-b7e30295495e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:12.532397 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1056945a-b5d6-4782-9841-b7e30295495e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:12.558980 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-1056945a-b5d6-4782-9841-b7e30295495e None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:12.560202 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-1056945a-b5d6-4782-9841-b7e30295495e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:12.569035 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1189/2377] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:12.573424 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4caefb-7f99-47f2-8bac-8566a13123ea None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:12.586783 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4caefb-7f99-47f2-8bac-8566a13123ea None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:12.594558 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2950986-d066-487e-93ab-9ec058b4cc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:12.594558 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2950986-d066-487e-93ab-9ec058b4cc76 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:12.594558 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2950986-d066-487e-93ab-9ec058b4cc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:12.594558 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2950986-d066-487e-93ab-9ec058b4cc76 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:12.594929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2950986-d066-487e-93ab-9ec058b4cc76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:51:12.594929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2950986-d066-487e-93ab-9ec058b4cc76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:12.595702 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2950986-d066-487e-93ab-9ec058b4cc76 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:12.608703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1189/2378] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:51:12.613124 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056945a-b5d6-4782-9841-b7e30295495e None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:12.622821 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1056945a-b5d6-4782-9841-b7e30295495e None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:12.627834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3fae1-228e-4f04-91a8-f291fe5499f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:12.628459 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3fae1-228e-4f04-91a8-f291fe5499f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:12.628751 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3fae1-228e-4f04-91a8-f291fe5499f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:12.629028 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa3fae1-228e-4f04-91a8-f291fe5499f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:12.629696 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3fae1-228e-4f04-91a8-f291fe5499f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:12.631668 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa3fae1-228e-4f04-91a8-f291fe5499f9 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:12.666853 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1190/2379] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:51:12 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:51:12.672404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2950986-d066-487e-93ab-9ec058b4cc76 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:12.683395 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2950986-d066-487e-93ab-9ec058b4cc76 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:12.785965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e70a3-96dc-433a-a62f-d79c685f3360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:12.788216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e70a3-96dc-433a-a62f-d79c685f3360 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:12.788216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e70a3-96dc-433a-a62f-d79c685f3360 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:12.788216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e70a3-96dc-433a-a62f-d79c685f3360 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:12.788518 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e70a3-96dc-433a-a62f-d79c685f3360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:12.790944 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64e70a3-96dc-433a-a62f-d79c685f3360 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:12.822443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1190/2380] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:51:12 2022] POST /identity/v3/users => generated 289 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:51:12.826109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3fae1-228e-4f04-91a8-f291fe5499f9 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:12.839946 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa3fae1-228e-4f04-91a8-f291fe5499f9 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:12.846146 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c431e7-5700-476e-8eb2-d2835adf16bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:12.847026 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c431e7-5700-476e-8eb2-d2835adf16bf admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:12.847489 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c431e7-5700-476e-8eb2-d2835adf16bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:12.847923 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c431e7-5700-476e-8eb2-d2835adf16bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:12.848790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c431e7-5700-476e-8eb2-d2835adf16bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:12.850915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c431e7-5700-476e-8eb2-d2835adf16bf admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:12.857281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:12.867920 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e70a3-96dc-433a-a62f-d79c685f3360 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:12.873759 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1191/2381] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:51:12.879760 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64e70a3-96dc-433a-a62f-d79c685f3360 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:12.889683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b5de6-613b-4cff-bf4e-faa73761e7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:12.890353 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b5de6-613b-4cff-bf4e-faa73761e7fb admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:12.890811 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b5de6-613b-4cff-bf4e-faa73761e7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:12.891098 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b5de6-613b-4cff-bf4e-faa73761e7fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:12.891934 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b5de6-613b-4cff-bf4e-faa73761e7fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:12.906381 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b5de6-613b-4cff-bf4e-faa73761e7fb admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:12.907129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1191/2382] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:51:12.910938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c431e7-5700-476e-8eb2-d2835adf16bf admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:12.924286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c431e7-5700-476e-8eb2-d2835adf16bf admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:12.939733 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016b965-7522-4317-990e-140810e5dab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:12.941152 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016b965-7522-4317-990e-140810e5dab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:12.941152 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016b965-7522-4317-990e-140810e5dab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:12.941152 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016b965-7522-4317-990e-140810e5dab1 admin admin] PATH_INFO: `/v3/projects/aca215d4372c431ca37ad462e347b958/users/0d608b895e3a485992fd5ac26aee8cb0/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:12.962918 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016b965-7522-4317-990e-140810e5dab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aca215d4372c431ca37ad462e347b958, user_id=0d608b895e3a485992fd5ac26aee8cb0, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:12.967094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016b965-7522-4317-990e-140810e5dab1 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:12.998408 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1192/2383] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:51:12 2022] PUT /identity/v3/projects/aca215d4372c431ca37ad462e347b958/users/0d608b895e3a485992fd5ac26aee8cb0/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:13.062143 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b6c1e-7428-47ed-aa57-38e9f882e76f None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:13.062613 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b6c1e-7428-47ed-aa57-38e9f882e76f None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:13.062899 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b6c1e-7428-47ed-aa57-38e9f882e76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:13.091237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-d26b6c1e-7428-47ed-aa57-38e9f882e76f None None] MFA Rules not processed for user `0d608b895e3a485992fd5ac26aee8cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:13.092383 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d26b6c1e-7428-47ed-aa57-38e9f882e76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:13.156559 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1192/2384] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:13 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:13.168505 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016b965-7522-4317-990e-140810e5dab1 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:13.170166 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-b016b965-7522-4317-990e-140810e5dab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:13.226377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016b965-7522-4317-990e-140810e5dab1 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:13.230260 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78c1ab-fcc9-4181-a8f6-271103f56feb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b26c60d08b9f47aca8404e4173290908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:13.230894 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78c1ab-fcc9-4181-a8f6-271103f56feb service glance] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:13.231174 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78c1ab-fcc9-4181-a8f6-271103f56feb service glance] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:13.231443 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78c1ab-fcc9-4181-a8f6-271103f56feb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:13.240101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78c1ab-fcc9-4181-a8f6-271103f56feb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:13.241512 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78c1ab-fcc9-4181-a8f6-271103f56feb service glance] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:13.250882 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1193/2385] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:51:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:51:15.366174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b6c1e-7428-47ed-aa57-38e9f882e76f None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:15.367688 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d26b6c1e-7428-47ed-aa57-38e9f882e76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:15.372670 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:15.444261 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b6c1e-7428-47ed-aa57-38e9f882e76f None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:15.448729 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e55ff-ba43-462b-8842-4b24ec6700f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:15.449414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e55ff-ba43-462b-8842-4b24ec6700f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:15.449701 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e55ff-ba43-462b-8842-4b24ec6700f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:15.449979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e55ff-ba43-462b-8842-4b24ec6700f1 admin admin] PATH_INFO: `/v3/users/54f8813537dd477486e543c4749ce17a` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:15.451266 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e55ff-ba43-462b-8842-4b24ec6700f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f8813537dd477486e543c4749ce17a)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:15.453233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e55ff-ba43-462b-8842-4b24ec6700f1 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:15.506264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-354e55ff-ba43-462b-8842-4b24ec6700f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f8813537dd477486e543c4749ce17a'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:15.507041 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-354e55ff-ba43-462b-8842-4b24ec6700f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f8813537dd477486e543c4749ce17a'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:15.520303 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-354e55ff-ba43-462b-8842-4b24ec6700f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f8813537dd477486e543c4749ce17a'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:15.528806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-354e55ff-ba43-462b-8842-4b24ec6700f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f8813537dd477486e543c4749ce17a'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:15.539671 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-354e55ff-ba43-462b-8842-4b24ec6700f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f8813537dd477486e543c4749ce17a'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:15.547164 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1193/2386] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:51:15 2022] DELETE /identity/v3/users/54f8813537dd477486e543c4749ce17a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:15.551543 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d0b29-a5ba-4134-a75e-87600d68f53b None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:15.552048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d0b29-a5ba-4134-a75e-87600d68f53b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:15.552242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44d0b29-a5ba-4134-a75e-87600d68f53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:15.574018 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-b44d0b29-a5ba-4134-a75e-87600d68f53b None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:15.574018 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-b44d0b29-a5ba-4134-a75e-87600d68f53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:15.648821 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1194/2387] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:15.660537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e55ff-ba43-462b-8842-4b24ec6700f1 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:15.664576 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-354e55ff-ba43-462b-8842-4b24ec6700f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:15.725992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e55ff-ba43-462b-8842-4b24ec6700f1 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:15.729699 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4df9a5-5c81-49e7-a438-4f4ae0a094f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:15.730329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4df9a5-5c81-49e7-a438-4f4ae0a094f6 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:15.730645 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4df9a5-5c81-49e7-a438-4f4ae0a094f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:15.730925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4df9a5-5c81-49e7-a438-4f4ae0a094f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:15.740204 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4df9a5-5c81-49e7-a438-4f4ae0a094f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:15.742540 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4df9a5-5c81-49e7-a438-4f4ae0a094f6 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:15.753005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1194/2388] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:51:16.078136 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d0b29-a5ba-4134-a75e-87600d68f53b None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:16.079581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-b44d0b29-a5ba-4134-a75e-87600d68f53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:16.096206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44d0b29-a5ba-4134-a75e-87600d68f53b None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:16.101578 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a5fba-b192-4325-af33-34740ae31881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:16.102192 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a5fba-b192-4325-af33-34740ae31881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:16.102529 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a5fba-b192-4325-af33-34740ae31881 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:16.102813 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a5fba-b192-4325-af33-34740ae31881 admin admin] PATH_INFO: `/v3/projects/898986f71786421f93e60c00257157b8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:16.104155 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a5fba-b192-4325-af33-34740ae31881 admin admin] RBAC: Authorizing `identity:delete_project(project_id=898986f71786421f93e60c00257157b8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:16.106145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a5fba-b192-4325-af33-34740ae31881 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:16.153265 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-691a5fba-b192-4325-af33-34740ae31881 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898986f71786421f93e60c00257157b8', 'request_id': 'req-691a5fba-b192-4325-af33-34740ae31881'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:16.159157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-691a5fba-b192-4325-af33-34740ae31881 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898986f71786421f93e60c00257157b8', 'request_id': 'req-691a5fba-b192-4325-af33-34740ae31881'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:16.164598 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-691a5fba-b192-4325-af33-34740ae31881 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898986f71786421f93e60c00257157b8', 'request_id': 'req-691a5fba-b192-4325-af33-34740ae31881'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:16.178526 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-691a5fba-b192-4325-af33-34740ae31881 admin admin] The token cache is being invalidate because project 898986f71786421f93e60c00257157b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:51:16.178822 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-691a5fba-b192-4325-af33-34740ae31881 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:16.179476 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-691a5fba-b192-4325-af33-34740ae31881 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:16.180994 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1195/2389] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:51:16 2022] DELETE /identity/v3/projects/898986f71786421f93e60c00257157b8 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:51:16.185013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4df9a5-5c81-49e7-a438-4f4ae0a094f6 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:16.195210 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4df9a5-5c81-49e7-a438-4f4ae0a094f6 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:16.215031 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:16.255811 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897162a-d7f7-48d7-b928-a640cfa3867d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:16.256578 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897162a-d7f7-48d7-b928-a640cfa3867d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:16.256858 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897162a-d7f7-48d7-b928-a640cfa3867d admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:16.257129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897162a-d7f7-48d7-b928-a640cfa3867d admin admin] PATH_INFO: `/v3/users/9657d84b462b42afac3c4cb4892ec6c3` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:16.258652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897162a-d7f7-48d7-b928-a640cfa3867d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9657d84b462b42afac3c4cb4892ec6c3)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:16.260901 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897162a-d7f7-48d7-b928-a640cfa3867d admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:16.311030 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-4897162a-d7f7-48d7-b928-a640cfa3867d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9657d84b462b42afac3c4cb4892ec6c3'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:16.311751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-4897162a-d7f7-48d7-b928-a640cfa3867d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9657d84b462b42afac3c4cb4892ec6c3'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:16.327210 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-4897162a-d7f7-48d7-b928-a640cfa3867d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9657d84b462b42afac3c4cb4892ec6c3'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:16.334670 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-4897162a-d7f7-48d7-b928-a640cfa3867d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9657d84b462b42afac3c4cb4892ec6c3'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:16.341986 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-4897162a-d7f7-48d7-b928-a640cfa3867d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9657d84b462b42afac3c4cb4892ec6c3'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:16.348248 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1195/2390] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:51:16 2022] DELETE /identity/v3/users/9657d84b462b42afac3c4cb4892ec6c3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:16.728304 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a5fba-b192-4325-af33-34740ae31881 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:16.730504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-691a5fba-b192-4325-af33-34740ae31881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:16.748103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:16.754660 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a5fba-b192-4325-af33-34740ae31881 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:16.842525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c81921-ef21-42b5-8fc5-084971378dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:16.843323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c81921-ef21-42b5-8fc5-084971378dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:16.843671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c81921-ef21-42b5-8fc5-084971378dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:16.844022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c81921-ef21-42b5-8fc5-084971378dc7 admin admin] PATH_INFO: `/v3/projects/c4a3804163d340e9921cfea5dd7ce4e6` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:16.846028 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c81921-ef21-42b5-8fc5-084971378dc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4a3804163d340e9921cfea5dd7ce4e6)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:16.848122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c81921-ef21-42b5-8fc5-084971378dc7 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:16.953347 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-27c81921-ef21-42b5-8fc5-084971378dc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4a3804163d340e9921cfea5dd7ce4e6', 'request_id': 'req-27c81921-ef21-42b5-8fc5-084971378dc7'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:16.960944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-27c81921-ef21-42b5-8fc5-084971378dc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4a3804163d340e9921cfea5dd7ce4e6', 'request_id': 'req-27c81921-ef21-42b5-8fc5-084971378dc7'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:16.969404 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-27c81921-ef21-42b5-8fc5-084971378dc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4a3804163d340e9921cfea5dd7ce4e6', 'request_id': 'req-27c81921-ef21-42b5-8fc5-084971378dc7'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:16.987286 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-27c81921-ef21-42b5-8fc5-084971378dc7 admin admin] The token cache is being invalidate because project c4a3804163d340e9921cfea5dd7ce4e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:51:16.988245 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-27c81921-ef21-42b5-8fc5-084971378dc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:16.988954 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-27c81921-ef21-42b5-8fc5-084971378dc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:16.991695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1196/2391] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:51:16 2022] DELETE /identity/v3/projects/c4a3804163d340e9921cfea5dd7ce4e6 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:16.996626 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b05fb6-da4c-44fd-877c-072f17ba6f44 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:16.997177 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b05fb6-da4c-44fd-877c-072f17ba6f44 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:16.997177 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b05fb6-da4c-44fd-877c-072f17ba6f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:17.027327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-21b05fb6-da4c-44fd-877c-072f17ba6f44 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:17.029064 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-21b05fb6-da4c-44fd-877c-072f17ba6f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:17.103392 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1196/2392] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:51:17.112307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99af3d4-ccfe-4a22-a83f-0a3bea321067 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:17.112595 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99af3d4-ccfe-4a22-a83f-0a3bea321067 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:17.112875 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99af3d4-ccfe-4a22-a83f-0a3bea321067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:17.136910 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-a99af3d4-ccfe-4a22-a83f-0a3bea321067 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:17.138430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a99af3d4-ccfe-4a22-a83f-0a3bea321067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:17.147358 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1197/2393] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:17.151620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b05fb6-da4c-44fd-877c-072f17ba6f44 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:17.163191 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b05fb6-da4c-44fd-877c-072f17ba6f44 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:17.168785 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcd735-b583-467d-9dc6-5de7f4696940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:17.169416 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcd735-b583-467d-9dc6-5de7f4696940 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:17.169702 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcd735-b583-467d-9dc6-5de7f4696940 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:17.169977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcd735-b583-467d-9dc6-5de7f4696940 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:17.170711 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcd735-b583-467d-9dc6-5de7f4696940 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:51:17.171017 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcd735-b583-467d-9dc6-5de7f4696940 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:17.172603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bcd735-b583-467d-9dc6-5de7f4696940 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:17.193830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1197/2394] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:51:17.195539 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99af3d4-ccfe-4a22-a83f-0a3bea321067 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:17.205429 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99af3d4-ccfe-4a22-a83f-0a3bea321067 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:17.212102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8d10f-5cac-4b1d-aca1-b3d48b4e524f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:17.213106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8d10f-5cac-4b1d-aca1-b3d48b4e524f admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:17.213398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8d10f-5cac-4b1d-aca1-b3d48b4e524f admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:17.213678 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e8d10f-5cac-4b1d-aca1-b3d48b4e524f admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:17.214393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8d10f-5cac-4b1d-aca1-b3d48b4e524f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:17.216346 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e8d10f-5cac-4b1d-aca1-b3d48b4e524f admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:17.248677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1198/2395] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:51:17 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:51:17.253098 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcd735-b583-467d-9dc6-5de7f4696940 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:17.264006 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcd735-b583-467d-9dc6-5de7f4696940 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:17.297698 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:17.330715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86e5ce-c400-42dc-a3c7-e88fd8972a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:17.331466 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86e5ce-c400-42dc-a3c7-e88fd8972a61 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:17.331751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86e5ce-c400-42dc-a3c7-e88fd8972a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:17.332027 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca86e5ce-c400-42dc-a3c7-e88fd8972a61 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:17.333175 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86e5ce-c400-42dc-a3c7-e88fd8972a61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:17.335348 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca86e5ce-c400-42dc-a3c7-e88fd8972a61 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:17.359544 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1198/2396] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:51:17 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:51:17.363821 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8d10f-5cac-4b1d-aca1-b3d48b4e524f admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:17.377756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e8d10f-5cac-4b1d-aca1-b3d48b4e524f admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:17.382911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fb0e0-b139-418e-8763-a5ef6d99ff9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:17.383549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fb0e0-b139-418e-8763-a5ef6d99ff9d admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:17.383834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fb0e0-b139-418e-8763-a5ef6d99ff9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:17.384115 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223fb0e0-b139-418e-8763-a5ef6d99ff9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:17.384824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223fb0e0-b139-418e-8763-a5ef6d99ff9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:17.386446 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223fb0e0-b139-418e-8763-a5ef6d99ff9d admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:17.398745 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1199/2397] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:51:17.402400 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86e5ce-c400-42dc-a3c7-e88fd8972a61 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:17.413723 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca86e5ce-c400-42dc-a3c7-e88fd8972a61 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:17.419602 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c24ad0-5f7a-412b-929f-040e0d612934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:17.420326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24ad0-5f7a-412b-929f-040e0d612934 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:17.420513 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24ad0-5f7a-412b-929f-040e0d612934 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:17.420808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c24ad0-5f7a-412b-929f-040e0d612934 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:17.421740 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c24ad0-5f7a-412b-929f-040e0d612934 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:17.427921 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c24ad0-5f7a-412b-929f-040e0d612934 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:17.439231 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1199/2398] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:51:17.443329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fb0e0-b139-418e-8763-a5ef6d99ff9d admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:17.454085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223fb0e0-b139-418e-8763-a5ef6d99ff9d admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:17.459087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872f938-8791-4df3-adf7-1cd6692ac70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:17.459760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872f938-8791-4df3-adf7-1cd6692ac70c admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:17.460045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872f938-8791-4df3-adf7-1cd6692ac70c admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:17.460326 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872f938-8791-4df3-adf7-1cd6692ac70c admin admin] PATH_INFO: `/v3/projects/65c8676cba0149629f3f76ff75a989a6/users/9ea5766a28af4d5c992d2c7b361484b9/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:17.476754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872f938-8791-4df3-adf7-1cd6692ac70c admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c8676cba0149629f3f76ff75a989a6, user_id=9ea5766a28af4d5c992d2c7b361484b9, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:17.479492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872f938-8791-4df3-adf7-1cd6692ac70c admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:17.493159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1200/2399] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:51:17 2022] PUT /identity/v3/projects/65c8676cba0149629f3f76ff75a989a6/users/9ea5766a28af4d5c992d2c7b361484b9/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:17.503501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf3b9f-c5a8-4f50-8c04-5e1861ffb75c None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:17.503793 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf3b9f-c5a8-4f50-8c04-5e1861ffb75c None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:17.504131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf3b9f-c5a8-4f50-8c04-5e1861ffb75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:17.533130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-6daf3b9f-c5a8-4f50-8c04-5e1861ffb75c None None] MFA Rules not processed for user `9ea5766a28af4d5c992d2c7b361484b9`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:17.534369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6daf3b9f-c5a8-4f50-8c04-5e1861ffb75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:17.599840 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1200/2400] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:17.610610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872f938-8791-4df3-adf7-1cd6692ac70c admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:17.612454 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d872f938-8791-4df3-adf7-1cd6692ac70c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:17.645020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:17.674105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872f938-8791-4df3-adf7-1cd6692ac70c admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:17.678362 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3627ce-6ec5-4c0d-9d22-80f68d8e1aaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:17.679004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3627ce-6ec5-4c0d-9d22-80f68d8e1aaa service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:17.679288 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3627ce-6ec5-4c0d-9d22-80f68d8e1aaa service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:17.679564 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3627ce-6ec5-4c0d-9d22-80f68d8e1aaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:17.687704 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3627ce-6ec5-4c0d-9d22-80f68d8e1aaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:17.689141 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3627ce-6ec5-4c0d-9d22-80f68d8e1aaa service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:17.697991 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1201/2401] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:51:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:51:24.680009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fd592-29e0-4f2a-8e64-b9183845bccb None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:24.680604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fd592-29e0-4f2a-8e64-b9183845bccb None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:24.680865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52fd592-29e0-4f2a-8e64-b9183845bccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:24.700618 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-c52fd592-29e0-4f2a-8e64-b9183845bccb None None] MFA Rules not processed for user `7e7b9e21971c432b9f23ceee4c5b7a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:24.701805 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-c52fd592-29e0-4f2a-8e64-b9183845bccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:24.762844 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1201/2402] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:25.453756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed680e11-afad-45aa-89ca-41cc3b1dd27e None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:25.454408 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed680e11-afad-45aa-89ca-41cc3b1dd27e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:25.454498 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed680e11-afad-45aa-89ca-41cc3b1dd27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:25.477321 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-ed680e11-afad-45aa-89ca-41cc3b1dd27e None None] MFA Rules not processed for user `db10ad54ec9948a3bb8b04c708fc4ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:25.478670 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ed680e11-afad-45aa-89ca-41cc3b1dd27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:25.545916 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1202/2403] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 22:51:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:25.590617 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fd592-29e0-4f2a-8e64-b9183845bccb None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:25.592087 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-c52fd592-29e0-4f2a-8e64-b9183845bccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:25.655072 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:25.689600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52fd592-29e0-4f2a-8e64-b9183845bccb None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:25.701772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190e4c44-6ec2-4aae-a59f-bed180955665 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf405258b9d413fae1192e10250b6a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:25.702652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e4c44-6ec2-4aae-a59f-bed180955665 service swift] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:25.702940 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e4c44-6ec2-4aae-a59f-bed180955665 service swift] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:25.703217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190e4c44-6ec2-4aae-a59f-bed180955665 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:25.712408 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e4c44-6ec2-4aae-a59f-bed180955665 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:25.713984 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190e4c44-6ec2-4aae-a59f-bed180955665 service swift] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:25.722096 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1202/2404] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 22:51:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 22:51:28.130140 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed680e11-afad-45aa-89ca-41cc3b1dd27e None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:28.202070 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed680e11-afad-45aa-89ca-41cc3b1dd27e None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:28.206999 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b4507-2323-45d2-a5df-b657e63fedb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:28.208122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b4507-2323-45d2-a5df-b657e63fedb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:28.208571 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b4507-2323-45d2-a5df-b657e63fedb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:28.209065 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b4507-2323-45d2-a5df-b657e63fedb1 admin admin] PATH_INFO: `/v3/users/9ea5766a28af4d5c992d2c7b361484b9` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:28.210292 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b4507-2323-45d2-a5df-b657e63fedb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ea5766a28af4d5c992d2c7b361484b9)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:28.212733 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b4507-2323-45d2-a5df-b657e63fedb1 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:28.268944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f63b4507-2323-45d2-a5df-b657e63fedb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ea5766a28af4d5c992d2c7b361484b9'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:28.269634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f63b4507-2323-45d2-a5df-b657e63fedb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ea5766a28af4d5c992d2c7b361484b9'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:28.279488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f63b4507-2323-45d2-a5df-b657e63fedb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ea5766a28af4d5c992d2c7b361484b9'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:28.293938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f63b4507-2323-45d2-a5df-b657e63fedb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ea5766a28af4d5c992d2c7b361484b9'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:28.295117 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f63b4507-2323-45d2-a5df-b657e63fedb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ea5766a28af4d5c992d2c7b361484b9'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:28.301759 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:28.316064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1203/2405] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:51:28 2022] DELETE /identity/v3/users/9ea5766a28af4d5c992d2c7b361484b9 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:28.317758 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1176d-90d3-4676-9c30-0b26f6458dfa None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:28.319127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1176d-90d3-4676-9c30-0b26f6458dfa None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:28.319127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1176d-90d3-4676-9c30-0b26f6458dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:28.347560 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-65d1176d-90d3-4676-9c30-0b26f6458dfa None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:28.348770 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-65d1176d-90d3-4676-9c30-0b26f6458dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:28.429687 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1203/2406] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:28.440576 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b4507-2323-45d2-a5df-b657e63fedb1 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:28.442776 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-f63b4507-2323-45d2-a5df-b657e63fedb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:28.548673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b4507-2323-45d2-a5df-b657e63fedb1 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:28.553356 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dc1eac-669a-4ca2-a32b-6533d41ba3f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:28.554086 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc1eac-669a-4ca2-a32b-6533d41ba3f9 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:28.554405 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc1eac-669a-4ca2-a32b-6533d41ba3f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:28.554688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dc1eac-669a-4ca2-a32b-6533d41ba3f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:28.569707 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc1eac-669a-4ca2-a32b-6533d41ba3f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:28.571336 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dc1eac-669a-4ca2-a32b-6533d41ba3f9 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:28.594941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1204/2407] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:51:29.200012 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1176d-90d3-4676-9c30-0b26f6458dfa None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:29.201565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-65d1176d-90d3-4676-9c30-0b26f6458dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:29.225370 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1176d-90d3-4676-9c30-0b26f6458dfa None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:29.234005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cb6ae-d63e-4052-8316-bb3a7ab56eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:29.235327 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cb6ae-d63e-4052-8316-bb3a7ab56eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:29.235979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cb6ae-d63e-4052-8316-bb3a7ab56eee admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:29.236478 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cb6ae-d63e-4052-8316-bb3a7ab56eee admin admin] PATH_INFO: `/v3/projects/65c8676cba0149629f3f76ff75a989a6` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:29.237922 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cb6ae-d63e-4052-8316-bb3a7ab56eee admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c8676cba0149629f3f76ff75a989a6)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:29.241388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424cb6ae-d63e-4052-8316-bb3a7ab56eee admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:29.308312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-424cb6ae-d63e-4052-8316-bb3a7ab56eee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c8676cba0149629f3f76ff75a989a6', 'request_id': 'req-424cb6ae-d63e-4052-8316-bb3a7ab56eee'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:29.315142 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-424cb6ae-d63e-4052-8316-bb3a7ab56eee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c8676cba0149629f3f76ff75a989a6', 'request_id': 'req-424cb6ae-d63e-4052-8316-bb3a7ab56eee'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:29.325498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-424cb6ae-d63e-4052-8316-bb3a7ab56eee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c8676cba0149629f3f76ff75a989a6', 'request_id': 'req-424cb6ae-d63e-4052-8316-bb3a7ab56eee'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:29.338113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-424cb6ae-d63e-4052-8316-bb3a7ab56eee admin admin] The token cache is being invalidate because project 65c8676cba0149629f3f76ff75a989a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:51:29.338461 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-424cb6ae-d63e-4052-8316-bb3a7ab56eee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:29.339361 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-424cb6ae-d63e-4052-8316-bb3a7ab56eee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:29.341434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1204/2408] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:51:29 2022] DELETE /identity/v3/projects/65c8676cba0149629f3f76ff75a989a6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:29.345970 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b42c38-fae2-4c38-a939-8314b419517c None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:29.346841 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b42c38-fae2-4c38-a939-8314b419517c None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:29.347291 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b42c38-fae2-4c38-a939-8314b419517c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:29.373947 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-84b42c38-fae2-4c38-a939-8314b419517c None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:29.375240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-84b42c38-fae2-4c38-a939-8314b419517c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:29.450529 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1205/2409] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:51:29.527884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95149bed-5494-4362-bc04-c7f3cabbe085 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:29.528848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95149bed-5494-4362-bc04-c7f3cabbe085 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:29.529301 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95149bed-5494-4362-bc04-c7f3cabbe085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:29.590590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-95149bed-5494-4362-bc04-c7f3cabbe085 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:29.591861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-95149bed-5494-4362-bc04-c7f3cabbe085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:29.602388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1205/2410] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:29.606317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b42c38-fae2-4c38-a939-8314b419517c None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:29.617070 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b42c38-fae2-4c38-a939-8314b419517c None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:29.622186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd8b90-b6a8-4bd0-b8e4-2d7277205bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:29.622974 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd8b90-b6a8-4bd0-b8e4-2d7277205bec admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:29.623345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd8b90-b6a8-4bd0-b8e4-2d7277205bec admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:29.623786 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd8b90-b6a8-4bd0-b8e4-2d7277205bec admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:29.624602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd8b90-b6a8-4bd0-b8e4-2d7277205bec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:51:29.624999 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd8b90-b6a8-4bd0-b8e4-2d7277205bec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:29.626696 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd8b90-b6a8-4bd0-b8e4-2d7277205bec admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:29.639330 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1206/2411] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:51:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:51:29.644092 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95149bed-5494-4362-bc04-c7f3cabbe085 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:29.661084 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95149bed-5494-4362-bc04-c7f3cabbe085 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:29.668495 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a0829-68cf-47b9-8376-f0e6453f9a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:29.669160 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a0829-68cf-47b9-8376-f0e6453f9a35 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:29.669444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a0829-68cf-47b9-8376-f0e6453f9a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:29.669720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a0829-68cf-47b9-8376-f0e6453f9a35 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:29.670563 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a0829-68cf-47b9-8376-f0e6453f9a35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:29.673020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a0829-68cf-47b9-8376-f0e6453f9a35 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:29.707925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1206/2412] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:51:29 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:51:29.714751 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd8b90-b6a8-4bd0-b8e4-2d7277205bec admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:29.728684 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd8b90-b6a8-4bd0-b8e4-2d7277205bec admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:29.788563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40279c0-8b94-4e97-a60c-6deaf4febf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:29.789187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40279c0-8b94-4e97-a60c-6deaf4febf8b admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:29.789471 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40279c0-8b94-4e97-a60c-6deaf4febf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:29.789749 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40279c0-8b94-4e97-a60c-6deaf4febf8b admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:29.790436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40279c0-8b94-4e97-a60c-6deaf4febf8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:29.792359 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40279c0-8b94-4e97-a60c-6deaf4febf8b admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:29.812955 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1207/2413] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:51:29 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:51:29.816938 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a0829-68cf-47b9-8376-f0e6453f9a35 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:29.827154 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a0829-68cf-47b9-8376-f0e6453f9a35 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:29.831744 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8066b10-29ab-4bb5-a613-44a25cd797a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:29.832363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8066b10-29ab-4bb5-a613-44a25cd797a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:29.832908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8066b10-29ab-4bb5-a613-44a25cd797a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:29.833188 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8066b10-29ab-4bb5-a613-44a25cd797a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:29.834404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8066b10-29ab-4bb5-a613-44a25cd797a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:29.836072 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8066b10-29ab-4bb5-a613-44a25cd797a0 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:29.847477 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1207/2414] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:51:29.851867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40279c0-8b94-4e97-a60c-6deaf4febf8b admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:29.863636 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40279c0-8b94-4e97-a60c-6deaf4febf8b admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:29.869558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a18c8-9158-448f-bfc8-9378f5ca2161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:29.870401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a18c8-9158-448f-bfc8-9378f5ca2161 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:29.870690 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a18c8-9158-448f-bfc8-9378f5ca2161 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:29.870972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a18c8-9158-448f-bfc8-9378f5ca2161 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:29.871675 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a18c8-9158-448f-bfc8-9378f5ca2161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:29.873279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a18c8-9158-448f-bfc8-9378f5ca2161 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:29.887762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1208/2415] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:51:29.893825 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8066b10-29ab-4bb5-a613-44a25cd797a0 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:29.904479 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8066b10-29ab-4bb5-a613-44a25cd797a0 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:29.909065 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47710114-c956-4262-9f92-d017a429d4ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:29.909727 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47710114-c956-4262-9f92-d017a429d4ef admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:29.910014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47710114-c956-4262-9f92-d017a429d4ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:29.910294 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47710114-c956-4262-9f92-d017a429d4ef admin admin] PATH_INFO: `/v3/projects/b9a0d575f64a4d74967d2fcf09587c3c/users/965e389784a44f68b2e5484224b95b12/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:29.924967 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47710114-c956-4262-9f92-d017a429d4ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9a0d575f64a4d74967d2fcf09587c3c, user_id=965e389784a44f68b2e5484224b95b12, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:29.927699 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47710114-c956-4262-9f92-d017a429d4ef admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:29.929900 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:29.942169 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1208/2416] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:51:29 2022] PUT /identity/v3/projects/b9a0d575f64a4d74967d2fcf09587c3c/users/965e389784a44f68b2e5484224b95b12/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:51:29.952191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca206b3-da9f-43ce-ad95-43276e124580 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:29.952484 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca206b3-da9f-43ce-ad95-43276e124580 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:29.952769 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca206b3-da9f-43ce-ad95-43276e124580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:29.961737 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:29.973373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-bca206b3-da9f-43ce-ad95-43276e124580 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:29.975256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-bca206b3-da9f-43ce-ad95-43276e124580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:30.062871 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1209/2417] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:30.070990 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47710114-c956-4262-9f92-d017a429d4ef admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:30.073222 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-47710114-c956-4262-9f92-d017a429d4ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:30.148764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47710114-c956-4262-9f92-d017a429d4ef admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:30.153485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fbd05-d69f-4b8b-8c51-d1160d917d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:30.154766 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fbd05-d69f-4b8b-8c51-d1160d917d0d service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:30.155058 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fbd05-d69f-4b8b-8c51-d1160d917d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:30.155349 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fbd05-d69f-4b8b-8c51-d1160d917d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:30.167243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fbd05-d69f-4b8b-8c51-d1160d917d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:30.168900 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3fbd05-d69f-4b8b-8c51-d1160d917d0d service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:30.190549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1209/2418] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:51:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:51:31.038803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9797ed-9973-43c5-9105-9a3c0e552021 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:31.039307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9797ed-9973-43c5-9105-9a3c0e552021 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:31.039405 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9797ed-9973-43c5-9105-9a3c0e552021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:31.068916 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-4d9797ed-9973-43c5-9105-9a3c0e552021 None None] MFA Rules not processed for user `965e389784a44f68b2e5484224b95b12`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:31.070159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-4d9797ed-9973-43c5-9105-9a3c0e552021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:31.144698 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1210/2419] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:31.155827 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fbd05-d69f-4b8b-8c51-d1160d917d0d service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:31.157275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-5a3fbd05-d69f-4b8b-8c51-d1160d917d0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:31.248751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fbd05-d69f-4b8b-8c51-d1160d917d0d service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:31.252375 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3695c9-e13a-4f3b-8159-4f2cee187c55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:31.252990 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3695c9-e13a-4f3b-8159-4f2cee187c55 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:31.253395 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3695c9-e13a-4f3b-8159-4f2cee187c55 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:31.253687 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3695c9-e13a-4f3b-8159-4f2cee187c55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:31.264652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3695c9-e13a-4f3b-8159-4f2cee187c55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:31.264652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3695c9-e13a-4f3b-8159-4f2cee187c55 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:31.276419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1210/2420] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:51:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:51:32.733032 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241e620-29fb-441f-8cad-4a282e21f22f None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:32.733551 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241e620-29fb-441f-8cad-4a282e21f22f None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:32.733551 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5241e620-29fb-441f-8cad-4a282e21f22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:32.756311 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-5241e620-29fb-441f-8cad-4a282e21f22f None None] MFA Rules not processed for user `965e389784a44f68b2e5484224b95b12`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:32.757545 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5241e620-29fb-441f-8cad-4a282e21f22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:32.765414 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1211/2421] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:39.768711 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3695c9-e13a-4f3b-8159-4f2cee187c55 service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:39.771354 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-3f3695c9-e13a-4f3b-8159-4f2cee187c55 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:39.796603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3695c9-e13a-4f3b-8159-4f2cee187c55 service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:39.802483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e18a7c-06a6-4b14-8131-4e038566ab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:39.803363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e18a7c-06a6-4b14-8131-4e038566ab4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:39.803778 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e18a7c-06a6-4b14-8131-4e038566ab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:39.804162 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e18a7c-06a6-4b14-8131-4e038566ab4a admin admin] PATH_INFO: `/v3/users/0d608b895e3a485992fd5ac26aee8cb0` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:39.807351 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e18a7c-06a6-4b14-8131-4e038566ab4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d608b895e3a485992fd5ac26aee8cb0)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:39.810691 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e18a7c-06a6-4b14-8131-4e038566ab4a admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:39.912298 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-71e18a7c-06a6-4b14-8131-4e038566ab4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d608b895e3a485992fd5ac26aee8cb0'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:39.913540 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-71e18a7c-06a6-4b14-8131-4e038566ab4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d608b895e3a485992fd5ac26aee8cb0'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:39.931662 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-71e18a7c-06a6-4b14-8131-4e038566ab4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d608b895e3a485992fd5ac26aee8cb0'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:39.944085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-71e18a7c-06a6-4b14-8131-4e038566ab4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d608b895e3a485992fd5ac26aee8cb0'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:39.959496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-71e18a7c-06a6-4b14-8131-4e038566ab4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d608b895e3a485992fd5ac26aee8cb0'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:39.973488 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1211/2422] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:51:39 2022] DELETE /identity/v3/users/0d608b895e3a485992fd5ac26aee8cb0 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:39.976688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3547a6c-88a3-4229-a1eb-e7918e24dffe None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:39.977715 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3547a6c-88a3-4229-a1eb-e7918e24dffe None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:39.978110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3547a6c-88a3-4229-a1eb-e7918e24dffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:40.002115 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-a3547a6c-88a3-4229-a1eb-e7918e24dffe None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:40.004500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a3547a6c-88a3-4229-a1eb-e7918e24dffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:40.102806 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1212/2423] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:40.103547 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e18a7c-06a6-4b14-8131-4e038566ab4a admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:40.105123 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-71e18a7c-06a6-4b14-8131-4e038566ab4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:40.131494 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:40.207784 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e18a7c-06a6-4b14-8131-4e038566ab4a admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:40.218095 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17732283-464c-493e-8645-43068066c865 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:40.221803 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17732283-464c-493e-8645-43068066c865 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:40.222222 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17732283-464c-493e-8645-43068066c865 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:40.222743 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17732283-464c-493e-8645-43068066c865 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:40.248551 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17732283-464c-493e-8645-43068066c865 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:40.250142 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17732283-464c-493e-8645-43068066c865 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:40.274553 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1212/2424] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:51:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:51:40.652300 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3547a6c-88a3-4229-a1eb-e7918e24dffe None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:40.653776 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a3547a6c-88a3-4229-a1eb-e7918e24dffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:40.670696 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3547a6c-88a3-4229-a1eb-e7918e24dffe None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:40.683538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed579bf3-e94c-43a5-8c0d-e02e09bc9731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:40.684116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed579bf3-e94c-43a5-8c0d-e02e09bc9731 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:40.684408 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed579bf3-e94c-43a5-8c0d-e02e09bc9731 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:40.684689 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed579bf3-e94c-43a5-8c0d-e02e09bc9731 admin admin] PATH_INFO: `/v3/projects/aca215d4372c431ca37ad462e347b958` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:40.698079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed579bf3-e94c-43a5-8c0d-e02e09bc9731 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aca215d4372c431ca37ad462e347b958)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:40.702287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed579bf3-e94c-43a5-8c0d-e02e09bc9731 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:40.743241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:40.809455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-ed579bf3-e94c-43a5-8c0d-e02e09bc9731 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aca215d4372c431ca37ad462e347b958', 'request_id': 'req-ed579bf3-e94c-43a5-8c0d-e02e09bc9731'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:40.821435 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-ed579bf3-e94c-43a5-8c0d-e02e09bc9731 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aca215d4372c431ca37ad462e347b958', 'request_id': 'req-ed579bf3-e94c-43a5-8c0d-e02e09bc9731'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:40.828462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-ed579bf3-e94c-43a5-8c0d-e02e09bc9731 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aca215d4372c431ca37ad462e347b958', 'request_id': 'req-ed579bf3-e94c-43a5-8c0d-e02e09bc9731'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:40.859903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-ed579bf3-e94c-43a5-8c0d-e02e09bc9731 admin admin] The token cache is being invalidate because project aca215d4372c431ca37ad462e347b958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:51:40.860468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-ed579bf3-e94c-43a5-8c0d-e02e09bc9731 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:40.861751 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-ed579bf3-e94c-43a5-8c0d-e02e09bc9731 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:40.866568 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1213/2425] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:51:40 2022] DELETE /identity/v3/projects/aca215d4372c431ca37ad462e347b958 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:40.871460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cafed-94f2-4830-ac55-f67945e10db3 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:40.877846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cafed-94f2-4830-ac55-f67945e10db3 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:40.878132 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cafed-94f2-4830-ac55-f67945e10db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:40.901365 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-1c0cafed-94f2-4830-ac55-f67945e10db3 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:40.903093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-1c0cafed-94f2-4830-ac55-f67945e10db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:41.012764 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1213/2426] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:41.021708 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d531c3d-8260-4d5d-884f-1302e75e739f None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:41.022969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d531c3d-8260-4d5d-884f-1302e75e739f None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:41.023450 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d531c3d-8260-4d5d-884f-1302e75e739f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:41.050617 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-8d531c3d-8260-4d5d-884f-1302e75e739f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:41.052702 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8d531c3d-8260-4d5d-884f-1302e75e739f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:41.062208 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1214/2427] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:41.072197 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cafed-94f2-4830-ac55-f67945e10db3 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:41.083030 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cafed-94f2-4830-ac55-f67945e10db3 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:41.088187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946da169-57c4-49a6-a0ff-fe16a539f5a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:41.088841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946da169-57c4-49a6-a0ff-fe16a539f5a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:41.089131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946da169-57c4-49a6-a0ff-fe16a539f5a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:41.089415 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946da169-57c4-49a6-a0ff-fe16a539f5a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:41.090127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946da169-57c4-49a6-a0ff-fe16a539f5a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:51:41.090478 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946da169-57c4-49a6-a0ff-fe16a539f5a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:41.092112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946da169-57c4-49a6-a0ff-fe16a539f5a4 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:41.117609 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1214/2428] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:51:41.122170 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d531c3d-8260-4d5d-884f-1302e75e739f None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:41.141681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d531c3d-8260-4d5d-884f-1302e75e739f None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:41.145662 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597e6dd-484f-4e55-84d0-7be0df45d224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:41.145662 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597e6dd-484f-4e55-84d0-7be0df45d224 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:41.145662 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597e6dd-484f-4e55-84d0-7be0df45d224 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:41.146019 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597e6dd-484f-4e55-84d0-7be0df45d224 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:41.147718 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597e6dd-484f-4e55-84d0-7be0df45d224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:41.149923 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597e6dd-484f-4e55-84d0-7be0df45d224 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:41.244848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1215/2429] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:51:41 2022] POST /identity/v3/projects => generated 371 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:51:41.249192 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946da169-57c4-49a6-a0ff-fe16a539f5a4 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:41.260253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946da169-57c4-49a6-a0ff-fe16a539f5a4 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:41.326171 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8bd81-ecf3-4518-a078-e4d9ff27574a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:41.327181 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8bd81-ecf3-4518-a078-e4d9ff27574a admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:41.327474 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8bd81-ecf3-4518-a078-e4d9ff27574a admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:41.327755 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8bd81-ecf3-4518-a078-e4d9ff27574a admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:41.328557 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8bd81-ecf3-4518-a078-e4d9ff27574a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:41.330522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf8bd81-ecf3-4518-a078-e4d9ff27574a admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:41.368812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1215/2430] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:51:41 2022] POST /identity/v3/users => generated 286 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:51:41.370121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597e6dd-484f-4e55-84d0-7be0df45d224 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:41.383641 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597e6dd-484f-4e55-84d0-7be0df45d224 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:41.397031 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c114d7-d405-45a0-b4ef-a812c55132b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:41.398218 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c114d7-d405-45a0-b4ef-a812c55132b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:41.398858 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c114d7-d405-45a0-b4ef-a812c55132b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:41.399392 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c114d7-d405-45a0-b4ef-a812c55132b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:41.400367 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c114d7-d405-45a0-b4ef-a812c55132b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:41.402475 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c114d7-d405-45a0-b4ef-a812c55132b8 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:41.432265 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1216/2431] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:51:41.434187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8bd81-ecf3-4518-a078-e4d9ff27574a admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:41.458038 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf8bd81-ecf3-4518-a078-e4d9ff27574a admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:41.466363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc90a54-d265-4a91-a6f8-fceed84c1497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:41.467013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc90a54-d265-4a91-a6f8-fceed84c1497 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:41.467304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc90a54-d265-4a91-a6f8-fceed84c1497 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:41.469939 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc90a54-d265-4a91-a6f8-fceed84c1497 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:41.469939 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc90a54-d265-4a91-a6f8-fceed84c1497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:41.469939 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc90a54-d265-4a91-a6f8-fceed84c1497 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:41.500498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1216/2432] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:51:41.504943 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c114d7-d405-45a0-b4ef-a812c55132b8 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:41.518051 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c114d7-d405-45a0-b4ef-a812c55132b8 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:41.529292 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864224a0-8acc-4e72-a432-c381448d0745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:41.530367 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864224a0-8acc-4e72-a432-c381448d0745 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:41.530695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864224a0-8acc-4e72-a432-c381448d0745 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:41.531102 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864224a0-8acc-4e72-a432-c381448d0745 admin admin] PATH_INFO: `/v3/projects/a16e128e11954f738c175e642785b688/users/8e07454f97884ffe9e57ee894103986c/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:41.569724 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864224a0-8acc-4e72-a432-c381448d0745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16e128e11954f738c175e642785b688, user_id=8e07454f97884ffe9e57ee894103986c, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:41.577793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864224a0-8acc-4e72-a432-c381448d0745 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:41.613454 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47804d-7391-4b42-b6c5-911cc4d8ef99 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:41.613662 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1217/2433] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:51:41 2022] PUT /identity/v3/projects/a16e128e11954f738c175e642785b688/users/8e07454f97884ffe9e57ee894103986c/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:41.613777 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47804d-7391-4b42-b6c5-911cc4d8ef99 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:41.615861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47804d-7391-4b42-b6c5-911cc4d8ef99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:41.686414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-4e47804d-7391-4b42-b6c5-911cc4d8ef99 None None] MFA Rules not processed for user `8e07454f97884ffe9e57ee894103986c`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:41.687657 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-4e47804d-7391-4b42-b6c5-911cc4d8ef99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:41.709504 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:41.803665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864224a0-8acc-4e72-a432-c381448d0745 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:41.804746 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1217/2434] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:41.933584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864224a0-8acc-4e72-a432-c381448d0745 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:41.940556 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612d423-1399-4847-afed-b791e60a0a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:41.941504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612d423-1399-4847-afed-b791e60a0a42 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:41.941802 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612d423-1399-4847-afed-b791e60a0a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:41.942083 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612d423-1399-4847-afed-b791e60a0a42 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:41.942865 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612d423-1399-4847-afed-b791e60a0a42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:41.945478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612d423-1399-4847-afed-b791e60a0a42 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:41.993450 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1218/2435] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:51:41 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:51:41.995253 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47804d-7391-4b42-b6c5-911cc4d8ef99 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:42.010803 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47804d-7391-4b42-b6c5-911cc4d8ef99 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:42.096110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f42f6a-da93-458a-bad5-596ff152c9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:42.101334 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f42f6a-da93-458a-bad5-596ff152c9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:42.101921 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f42f6a-da93-458a-bad5-596ff152c9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:42.102459 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f42f6a-da93-458a-bad5-596ff152c9d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:42.103402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f42f6a-da93-458a-bad5-596ff152c9d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:42.105577 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f42f6a-da93-458a-bad5-596ff152c9d9 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:42.142867 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1218/2436] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:51:41 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:51:42.146435 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612d423-1399-4847-afed-b791e60a0a42 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:42.158436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612d423-1399-4847-afed-b791e60a0a42 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:42.175301 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d1666-ca41-4a38-97e0-724c117f5b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:42.175988 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d1666-ca41-4a38-97e0-724c117f5b5f admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:42.176281 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d1666-ca41-4a38-97e0-724c117f5b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:42.176569 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d1666-ca41-4a38-97e0-724c117f5b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:42.177843 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d1666-ca41-4a38-97e0-724c117f5b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:42.183972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7d1666-ca41-4a38-97e0-724c117f5b5f admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:42.209980 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1219/2437] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:51:42.214634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f42f6a-da93-458a-bad5-596ff152c9d9 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:42.237053 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f42f6a-da93-458a-bad5-596ff152c9d9 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:42.243532 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548679d-bc43-4f84-b713-32b9eae1099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:42.244246 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548679d-bc43-4f84-b713-32b9eae1099a admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:42.244693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548679d-bc43-4f84-b713-32b9eae1099a admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:42.245186 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548679d-bc43-4f84-b713-32b9eae1099a admin admin] PATH_INFO: `/v3/projects/cee66730bca147d2910463df1c5e3dd4/users/40b0e44725884dde99866fc1b70af56e/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:42.277599 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548679d-bc43-4f84-b713-32b9eae1099a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee66730bca147d2910463df1c5e3dd4, user_id=40b0e44725884dde99866fc1b70af56e, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:42.280514 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548679d-bc43-4f84-b713-32b9eae1099a admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:42.299779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1219/2438] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:51:42 2022] PUT /identity/v3/projects/cee66730bca147d2910463df1c5e3dd4/users/40b0e44725884dde99866fc1b70af56e/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:42.303640 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d1666-ca41-4a38-97e0-724c117f5b5f admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:42.315201 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d1666-ca41-4a38-97e0-724c117f5b5f admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:42.337739 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:42.391850 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ee198-b47d-45b5-84fc-039f3d4bb1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:42.392593 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ee198-b47d-45b5-84fc-039f3d4bb1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:42.392996 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ee198-b47d-45b5-84fc-039f3d4bb1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:42.393618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ee198-b47d-45b5-84fc-039f3d4bb1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:42.394427 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ee198-b47d-45b5-84fc-039f3d4bb1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:42.396368 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ee198-b47d-45b5-84fc-039f3d4bb1e0 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:42.410678 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1220/2439] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:51:42.414871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548679d-bc43-4f84-b713-32b9eae1099a admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:42.429469 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548679d-bc43-4f84-b713-32b9eae1099a admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:42.440189 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e39d1-a08c-40f8-be28-8e03a8366a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:42.440930 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e39d1-a08c-40f8-be28-8e03a8366a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:42.441222 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e39d1-a08c-40f8-be28-8e03a8366a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:42.441576 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e39d1-a08c-40f8-be28-8e03a8366a8d admin admin] PATH_INFO: `/v3/projects/cee66730bca147d2910463df1c5e3dd4/users/40b0e44725884dde99866fc1b70af56e/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:42.447289 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e39d1-a08c-40f8-be28-8e03a8366a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cee66730bca147d2910463df1c5e3dd4, user_id=40b0e44725884dde99866fc1b70af56e, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:42.450001 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e39d1-a08c-40f8-be28-8e03a8366a8d admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:42.463701 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1220/2440] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:51:42 2022] PUT /identity/v3/projects/cee66730bca147d2910463df1c5e3dd4/users/40b0e44725884dde99866fc1b70af56e/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:42.475726 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97896c-eacb-40e7-9575-7423800c2740 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:42.476047 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97896c-eacb-40e7-9575-7423800c2740 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:42.476309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97896c-eacb-40e7-9575-7423800c2740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:42.510585 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-9e97896c-eacb-40e7-9575-7423800c2740 None None] MFA Rules not processed for user `40b0e44725884dde99866fc1b70af56e`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:42.511814 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-9e97896c-eacb-40e7-9575-7423800c2740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:42.605355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1221/2441] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:42.616888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e39d1-a08c-40f8-be28-8e03a8366a8d admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:42.618868 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-991e39d1-a08c-40f8-be28-8e03a8366a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:42.681615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e39d1-a08c-40f8-be28-8e03a8366a8d admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:42.685486 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443d361-9fe2-422c-95c3-afd16434b8b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:42.686110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443d361-9fe2-422c-95c3-afd16434b8b2 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:42.686436 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443d361-9fe2-422c-95c3-afd16434b8b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:42.686712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443d361-9fe2-422c-95c3-afd16434b8b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:42.703006 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:42.761633 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443d361-9fe2-422c-95c3-afd16434b8b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:42.763514 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443d361-9fe2-422c-95c3-afd16434b8b2 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:42.779226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1221/2442] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:51:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:51:45.415289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97896c-eacb-40e7-9575-7423800c2740 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:45.487268 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97896c-eacb-40e7-9575-7423800c2740 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:45.492461 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1d720-f268-4c1a-97da-2ea48bbed611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:45.493354 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1d720-f268-4c1a-97da-2ea48bbed611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:45.493777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1d720-f268-4c1a-97da-2ea48bbed611 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:45.494212 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec1d720-f268-4c1a-97da-2ea48bbed611 admin admin] PATH_INFO: `/v3/users/8e07454f97884ffe9e57ee894103986c` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:45.495675 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1d720-f268-4c1a-97da-2ea48bbed611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e07454f97884ffe9e57ee894103986c)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:45.497794 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec1d720-f268-4c1a-97da-2ea48bbed611 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:45.551855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:45.553491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-dec1d720-f268-4c1a-97da-2ea48bbed611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e07454f97884ffe9e57ee894103986c'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:45.554296 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-dec1d720-f268-4c1a-97da-2ea48bbed611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e07454f97884ffe9e57ee894103986c'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:45.564428 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-dec1d720-f268-4c1a-97da-2ea48bbed611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e07454f97884ffe9e57ee894103986c'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:45.590073 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-dec1d720-f268-4c1a-97da-2ea48bbed611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e07454f97884ffe9e57ee894103986c'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:45.591395 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-dec1d720-f268-4c1a-97da-2ea48bbed611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e07454f97884ffe9e57ee894103986c'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:45.611216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1222/2443] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:51:45 2022] DELETE /identity/v3/users/8e07454f97884ffe9e57ee894103986c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:45.616283 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b10083-40d8-4fab-a907-baaf79e216d7 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:45.617152 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b10083-40d8-4fab-a907-baaf79e216d7 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:45.617585 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b10083-40d8-4fab-a907-baaf79e216d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:45.646611 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-80b10083-40d8-4fab-a907-baaf79e216d7 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:45.648875 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-80b10083-40d8-4fab-a907-baaf79e216d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:45.714288 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1222/2444] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:45.721236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1d720-f268-4c1a-97da-2ea48bbed611 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:45.722734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-dec1d720-f268-4c1a-97da-2ea48bbed611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:45.789934 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec1d720-f268-4c1a-97da-2ea48bbed611 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:45.793890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459519ba-4337-4a13-9ca8-d4c911846a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:45.794542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459519ba-4337-4a13-9ca8-d4c911846a53 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:45.794825 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459519ba-4337-4a13-9ca8-d4c911846a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:45.795101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459519ba-4337-4a13-9ca8-d4c911846a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:45.804834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459519ba-4337-4a13-9ca8-d4c911846a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:45.806260 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459519ba-4337-4a13-9ca8-d4c911846a53 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:45.817088 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1223/2445] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:51:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:51:46.115704 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b10083-40d8-4fab-a907-baaf79e216d7 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:46.117382 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-80b10083-40d8-4fab-a907-baaf79e216d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:46.134264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b10083-40d8-4fab-a907-baaf79e216d7 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:46.139176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3ff9f-b5e2-4e28-a674-b5155d01d1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:46.144055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3ff9f-b5e2-4e28-a674-b5155d01d1fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:46.144392 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3ff9f-b5e2-4e28-a674-b5155d01d1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:46.144838 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3ff9f-b5e2-4e28-a674-b5155d01d1fc admin admin] PATH_INFO: `/v3/projects/a16e128e11954f738c175e642785b688` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:46.146302 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3ff9f-b5e2-4e28-a674-b5155d01d1fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a16e128e11954f738c175e642785b688)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:46.148263 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3ff9f-b5e2-4e28-a674-b5155d01d1fc admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:46.194892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-50a3ff9f-b5e2-4e28-a674-b5155d01d1fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a16e128e11954f738c175e642785b688', 'request_id': 'req-50a3ff9f-b5e2-4e28-a674-b5155d01d1fc'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:46.200345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-50a3ff9f-b5e2-4e28-a674-b5155d01d1fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a16e128e11954f738c175e642785b688', 'request_id': 'req-50a3ff9f-b5e2-4e28-a674-b5155d01d1fc'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:46.208236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-50a3ff9f-b5e2-4e28-a674-b5155d01d1fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a16e128e11954f738c175e642785b688', 'request_id': 'req-50a3ff9f-b5e2-4e28-a674-b5155d01d1fc'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:46.220624 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-50a3ff9f-b5e2-4e28-a674-b5155d01d1fc admin admin] The token cache is being invalidate because project a16e128e11954f738c175e642785b688 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:51:46.220915 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-50a3ff9f-b5e2-4e28-a674-b5155d01d1fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:46.221547 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-50a3ff9f-b5e2-4e28-a674-b5155d01d1fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:46.223082 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1223/2446] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:51:46 2022] DELETE /identity/v3/projects/a16e128e11954f738c175e642785b688 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:46.227184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459519ba-4337-4a13-9ca8-d4c911846a53 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:46.236801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459519ba-4337-4a13-9ca8-d4c911846a53 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:46.291881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db12f9-7bab-4544-875f-9196bdb175f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:46.292511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db12f9-7bab-4544-875f-9196bdb175f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:46.292793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db12f9-7bab-4544-875f-9196bdb175f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:46.293069 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db12f9-7bab-4544-875f-9196bdb175f8 admin admin] PATH_INFO: `/v3/users/40b0e44725884dde99866fc1b70af56e` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:46.294206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db12f9-7bab-4544-875f-9196bdb175f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40b0e44725884dde99866fc1b70af56e)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:46.296146 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db12f9-7bab-4544-875f-9196bdb175f8 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:46.341459 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-44db12f9-7bab-4544-875f-9196bdb175f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40b0e44725884dde99866fc1b70af56e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:46.342039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-44db12f9-7bab-4544-875f-9196bdb175f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40b0e44725884dde99866fc1b70af56e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:46.349456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-44db12f9-7bab-4544-875f-9196bdb175f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40b0e44725884dde99866fc1b70af56e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:46.359435 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:46.361951 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-44db12f9-7bab-4544-875f-9196bdb175f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40b0e44725884dde99866fc1b70af56e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:46.363044 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-44db12f9-7bab-4544-875f-9196bdb175f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40b0e44725884dde99866fc1b70af56e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:46.376151 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1224/2447] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:51:46 2022] DELETE /identity/v3/users/40b0e44725884dde99866fc1b70af56e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:46.640434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3ff9f-b5e2-4e28-a674-b5155d01d1fc admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:46.641946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-50a3ff9f-b5e2-4e28-a674-b5155d01d1fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:46.664210 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3ff9f-b5e2-4e28-a674-b5155d01d1fc admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:46.704759 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:46.729616 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6db302-a116-4533-a221-a47213c1c9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:46.730293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6db302-a116-4533-a221-a47213c1c9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:46.730710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6db302-a116-4533-a221-a47213c1c9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:46.730998 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6db302-a116-4533-a221-a47213c1c9b7 admin admin] PATH_INFO: `/v3/projects/cee66730bca147d2910463df1c5e3dd4` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:46.732188 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6db302-a116-4533-a221-a47213c1c9b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cee66730bca147d2910463df1c5e3dd4)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:46.734275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6db302-a116-4533-a221-a47213c1c9b7 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:46.786725 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-db6db302-a116-4533-a221-a47213c1c9b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cee66730bca147d2910463df1c5e3dd4', 'request_id': 'req-db6db302-a116-4533-a221-a47213c1c9b7'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:46.787372 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30da750-546a-409c-83d7-759507990f3a None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:46.787808 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30da750-546a-409c-83d7-759507990f3a None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:46.788172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30da750-546a-409c-83d7-759507990f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:46.792820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-db6db302-a116-4533-a221-a47213c1c9b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cee66730bca147d2910463df1c5e3dd4', 'request_id': 'req-db6db302-a116-4533-a221-a47213c1c9b7'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:46.800478 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-db6db302-a116-4533-a221-a47213c1c9b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cee66730bca147d2910463df1c5e3dd4', 'request_id': 'req-db6db302-a116-4533-a221-a47213c1c9b7'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:46.809254 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-e30da750-546a-409c-83d7-759507990f3a None None] MFA Rules not processed for user `db10ad54ec9948a3bb8b04c708fc4ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:46.810499 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e30da750-546a-409c-83d7-759507990f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:46.813405 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-db6db302-a116-4533-a221-a47213c1c9b7 admin admin] The token cache is being invalidate because project cee66730bca147d2910463df1c5e3dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:51:46.813691 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-db6db302-a116-4533-a221-a47213c1c9b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:46.814330 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-db6db302-a116-4533-a221-a47213c1c9b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:46.816486 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1224/2448] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:51:46 2022] DELETE /identity/v3/projects/cee66730bca147d2910463df1c5e3dd4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:46.821163 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988968b-dd73-4ce5-b76b-106bbc373519 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:46.821450 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988968b-dd73-4ce5-b76b-106bbc373519 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:46.821728 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988968b-dd73-4ce5-b76b-106bbc373519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:46.840520 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-4988968b-dd73-4ce5-b76b-106bbc373519 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:46.841730 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-4988968b-dd73-4ce5-b76b-106bbc373519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:46.870368 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1225/2449] 10.222.0.48 () {58 vars in 967 bytes} [Wed Jul 27 22:51:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:51:46.882832 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30da750-546a-409c-83d7-759507990f3a None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:46.884226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e30da750-546a-409c-83d7-759507990f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:46.902469 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1225/2450] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:51:46.910292 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d1e2b-62f5-4d7f-8bd0-8b99c7f19f6b None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:46.910671 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d1e2b-62f5-4d7f-8bd0-8b99c7f19f6b None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:46.911041 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d1e2b-62f5-4d7f-8bd0-8b99c7f19f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:46.930900 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-766d1e2b-62f5-4d7f-8bd0-8b99c7f19f6b None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:46.932095 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-766d1e2b-62f5-4d7f-8bd0-8b99c7f19f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:46.939907 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1226/2451] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:51:46.944226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d1e2b-62f5-4d7f-8bd0-8b99c7f19f6b None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:46.953071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d1e2b-62f5-4d7f-8bd0-8b99c7f19f6b None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:46.953817 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30da750-546a-409c-83d7-759507990f3a None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:46.957957 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614aa54-759b-4345-8859-f692fc098c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:46.959081 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614aa54-759b-4345-8859-f692fc098c06 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:46.959383 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614aa54-759b-4345-8859-f692fc098c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:46.959662 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614aa54-759b-4345-8859-f692fc098c06 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:46.959796 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26bc3b-b312-443c-be00-79d3ba84f97c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf405258b9d413fae1192e10250b6a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:46.960350 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614aa54-759b-4345-8859-f692fc098c06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:51:46.960450 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26bc3b-b312-443c-be00-79d3ba84f97c service swift] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:46.960662 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614aa54-759b-4345-8859-f692fc098c06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:46.960797 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26bc3b-b312-443c-be00-79d3ba84f97c service swift] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:46.961048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26bc3b-b312-443c-be00-79d3ba84f97c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:46.962249 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614aa54-759b-4345-8859-f692fc098c06 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:46.969309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26bc3b-b312-443c-be00-79d3ba84f97c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:46.970924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26bc3b-b312-443c-be00-79d3ba84f97c service swift] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:46.977467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1227/2452] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:51:46.978542 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614aa54-759b-4345-8859-f692fc098c06 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:46.982724 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1226/2453] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 22:51:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 22:51:46.988442 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614aa54-759b-4345-8859-f692fc098c06 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:46.993687 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7719b-89d4-43e2-a5c3-bcb98cc4bd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:46.994293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7719b-89d4-43e2-a5c3-bcb98cc4bd34 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:46.994611 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7719b-89d4-43e2-a5c3-bcb98cc4bd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:46.994893 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b7719b-89d4-43e2-a5c3-bcb98cc4bd34 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:46.995582 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7719b-89d4-43e2-a5c3-bcb98cc4bd34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:46.997471 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b7719b-89d4-43e2-a5c3-bcb98cc4bd34 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:47.029669 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1228/2454] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:51:46 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:51:47.033180 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26bc3b-b312-443c-be00-79d3ba84f97c service swift] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:47.045871 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26bc3b-b312-443c-be00-79d3ba84f97c service swift] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:47.113543 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc3bac-1914-45a2-893a-d49fb051d00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:47.114334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc3bac-1914-45a2-893a-d49fb051d00a admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:47.114676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc3bac-1914-45a2-893a-d49fb051d00a admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:47.115070 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cc3bac-1914-45a2-893a-d49fb051d00a admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:47.115820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc3bac-1914-45a2-893a-d49fb051d00a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:47.117894 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cc3bac-1914-45a2-893a-d49fb051d00a admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:47.143592 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1227/2455] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:51:47 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:51:47.148580 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7719b-89d4-43e2-a5c3-bcb98cc4bd34 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:47.159743 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b7719b-89d4-43e2-a5c3-bcb98cc4bd34 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:47.165140 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116db76-1fb1-46e3-9dc4-ebe0a33cd984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:47.165770 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116db76-1fb1-46e3-9dc4-ebe0a33cd984 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:47.166050 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116db76-1fb1-46e3-9dc4-ebe0a33cd984 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:47.167526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116db76-1fb1-46e3-9dc4-ebe0a33cd984 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:47.168290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116db76-1fb1-46e3-9dc4-ebe0a33cd984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:47.170296 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9116db76-1fb1-46e3-9dc4-ebe0a33cd984 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:47.186097 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1229/2456] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:51:47.193310 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc3bac-1914-45a2-893a-d49fb051d00a admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:47.207438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cc3bac-1914-45a2-893a-d49fb051d00a admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:47.214188 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48194c3-086f-436e-bc0c-0359394d62db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:47.215205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48194c3-086f-436e-bc0c-0359394d62db admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:47.215597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48194c3-086f-436e-bc0c-0359394d62db admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:47.216054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48194c3-086f-436e-bc0c-0359394d62db admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:47.216949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48194c3-086f-436e-bc0c-0359394d62db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:47.218597 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48194c3-086f-436e-bc0c-0359394d62db admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:47.222042 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:47.237229 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1228/2457] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:51:47.241299 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116db76-1fb1-46e3-9dc4-ebe0a33cd984 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:47.251334 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116db76-1fb1-46e3-9dc4-ebe0a33cd984 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:47.256879 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d18ef6-b335-47b9-b193-3cb37b1e32c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:47.257584 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d18ef6-b335-47b9-b193-3cb37b1e32c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:47.257846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d18ef6-b335-47b9-b193-3cb37b1e32c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:47.258117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d18ef6-b335-47b9-b193-3cb37b1e32c3 admin admin] PATH_INFO: `/v3/projects/f49b689546db489e88b124db488b095b/users/65962dca4e974535864d5315aa42fbd1/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:47.275306 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d18ef6-b335-47b9-b193-3cb37b1e32c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f49b689546db489e88b124db488b095b, user_id=65962dca4e974535864d5315aa42fbd1, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:47.278373 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d18ef6-b335-47b9-b193-3cb37b1e32c3 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:47.281174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:47.301054 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1230/2458] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:51:47 2022] PUT /identity/v3/projects/f49b689546db489e88b124db488b095b/users/65962dca4e974535864d5315aa42fbd1/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:47.306666 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c27a2-b403-40ef-b796-f29ce68d40c6 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:47.306959 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c27a2-b403-40ef-b796-f29ce68d40c6 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:47.307244 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c27a2-b403-40ef-b796-f29ce68d40c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:47.338181 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-6a3c27a2-b403-40ef-b796-f29ce68d40c6 None None] MFA Rules not processed for user `65962dca4e974535864d5315aa42fbd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:47.339446 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-6a3c27a2-b403-40ef-b796-f29ce68d40c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:47.408626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1229/2459] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:47.420272 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d18ef6-b335-47b9-b193-3cb37b1e32c3 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:47.422196 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e2d18ef6-b335-47b9-b193-3cb37b1e32c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:47.479872 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d18ef6-b335-47b9-b193-3cb37b1e32c3 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:47.483554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77360cb1-34c7-43cd-866e-0c9005ef3431 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:47.484186 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77360cb1-34c7-43cd-866e-0c9005ef3431 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:47.484474 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77360cb1-34c7-43cd-866e-0c9005ef3431 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:47.484754 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77360cb1-34c7-43cd-866e-0c9005ef3431 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:47.492904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77360cb1-34c7-43cd-866e-0c9005ef3431 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:47.494329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77360cb1-34c7-43cd-866e-0c9005ef3431 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:47.503240 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1231/2460] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:51:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:51:49.014997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c27a2-b403-40ef-b796-f29ce68d40c6 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:49.016799 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-6a3c27a2-b403-40ef-b796-f29ce68d40c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:49.109896 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c27a2-b403-40ef-b796-f29ce68d40c6 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:49.115426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ba8a6-3f3a-4e47-b996-f0d72edaee23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:49.116133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ba8a6-3f3a-4e47-b996-f0d72edaee23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:49.116418 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ba8a6-3f3a-4e47-b996-f0d72edaee23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:49.116695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ba8a6-3f3a-4e47-b996-f0d72edaee23 admin admin] PATH_INFO: `/v3/users/5b1e09a2671c433c8562763ca83c4596` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:49.118234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ba8a6-3f3a-4e47-b996-f0d72edaee23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b1e09a2671c433c8562763ca83c4596)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:49.120256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ba8a6-3f3a-4e47-b996-f0d72edaee23 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:49.167648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f46ba8a6-3f3a-4e47-b996-f0d72edaee23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b1e09a2671c433c8562763ca83c4596'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:49.168331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f46ba8a6-3f3a-4e47-b996-f0d72edaee23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b1e09a2671c433c8562763ca83c4596'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:49.175505 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f46ba8a6-3f3a-4e47-b996-f0d72edaee23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b1e09a2671c433c8562763ca83c4596'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:49.187775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f46ba8a6-3f3a-4e47-b996-f0d72edaee23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b1e09a2671c433c8562763ca83c4596'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:49.188412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-f46ba8a6-3f3a-4e47-b996-f0d72edaee23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b1e09a2671c433c8562763ca83c4596'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:49.200859 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1230/2461] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:51:49 2022] DELETE /identity/v3/users/5b1e09a2671c433c8562763ca83c4596 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:49.386811 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77360cb1-34c7-43cd-866e-0c9005ef3431 service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:49.398280 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77360cb1-34c7-43cd-866e-0c9005ef3431 service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:49.462836 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a3ae20-03d1-4c8d-9c90-762e48e16251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:49.463490 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3ae20-03d1-4c8d-9c90-762e48e16251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:49.463778 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3ae20-03d1-4c8d-9c90-762e48e16251 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:49.464062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a3ae20-03d1-4c8d-9c90-762e48e16251 admin admin] PATH_INFO: `/v3/projects/3b6e8d888bc84ad9911249e990a50d67` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:49.465222 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3ae20-03d1-4c8d-9c90-762e48e16251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b6e8d888bc84ad9911249e990a50d67)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:49.467160 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a3ae20-03d1-4c8d-9c90-762e48e16251 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:49.514136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a5a3ae20-03d1-4c8d-9c90-762e48e16251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b6e8d888bc84ad9911249e990a50d67', 'request_id': 'req-a5a3ae20-03d1-4c8d-9c90-762e48e16251'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:49.520282 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a5a3ae20-03d1-4c8d-9c90-762e48e16251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b6e8d888bc84ad9911249e990a50d67', 'request_id': 'req-a5a3ae20-03d1-4c8d-9c90-762e48e16251'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:49.531270 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a5a3ae20-03d1-4c8d-9c90-762e48e16251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b6e8d888bc84ad9911249e990a50d67', 'request_id': 'req-a5a3ae20-03d1-4c8d-9c90-762e48e16251'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:49.543238 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a5a3ae20-03d1-4c8d-9c90-762e48e16251 admin admin] The token cache is being invalidate because project 3b6e8d888bc84ad9911249e990a50d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:51:49.543680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a5a3ae20-03d1-4c8d-9c90-762e48e16251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:49.544598 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a5a3ae20-03d1-4c8d-9c90-762e48e16251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:49.546324 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1232/2462] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:51:49 2022] DELETE /identity/v3/projects/3b6e8d888bc84ad9911249e990a50d67 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:57.574243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ba8a6-3f3a-4e47-b996-f0d72edaee23 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:57.575698 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-f46ba8a6-3f3a-4e47-b996-f0d72edaee23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:57.589345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ba8a6-3f3a-4e47-b996-f0d72edaee23 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:57.593059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:57.652719 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce63b06-e05f-44ee-9018-b532b38425e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:57.653363 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce63b06-e05f-44ee-9018-b532b38425e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:57.653646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce63b06-e05f-44ee-9018-b532b38425e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:57.653922 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce63b06-e05f-44ee-9018-b532b38425e7 admin admin] PATH_INFO: `/v3/users/65962dca4e974535864d5315aa42fbd1` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:57.655104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce63b06-e05f-44ee-9018-b532b38425e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65962dca4e974535864d5315aa42fbd1)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:57.657016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce63b06-e05f-44ee-9018-b532b38425e7 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:57.704000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4ce63b06-e05f-44ee-9018-b532b38425e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65962dca4e974535864d5315aa42fbd1'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:57.704643 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4ce63b06-e05f-44ee-9018-b532b38425e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65962dca4e974535864d5315aa42fbd1'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:57.712012 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4ce63b06-e05f-44ee-9018-b532b38425e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65962dca4e974535864d5315aa42fbd1'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:57.724918 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4ce63b06-e05f-44ee-9018-b532b38425e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65962dca4e974535864d5315aa42fbd1'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:57.725550 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-4ce63b06-e05f-44ee-9018-b532b38425e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65962dca4e974535864d5315aa42fbd1'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:57.738096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1231/2463] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:51:57 2022] DELETE /identity/v3/users/65962dca4e974535864d5315aa42fbd1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:51:57.743586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4c17b-a7d2-4cae-a4ab-45f380fee4b7 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:57.744085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4c17b-a7d2-4cae-a4ab-45f380fee4b7 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:57.744189 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a4c17b-a7d2-4cae-a4ab-45f380fee4b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:57.763355 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-f2a4c17b-a7d2-4cae-a4ab-45f380fee4b7 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:51:57.764568 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-f2a4c17b-a7d2-4cae-a4ab-45f380fee4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:57.783953 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:51:57.827496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1233/2464] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:51:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:51:57.840713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce63b06-e05f-44ee-9018-b532b38425e7 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:57.842201 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-4ce63b06-e05f-44ee-9018-b532b38425e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:57.901502 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce63b06-e05f-44ee-9018-b532b38425e7 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:57.905169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10e9b4-a265-4eb3-9498-5efd0f2843bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:57.905793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10e9b4-a265-4eb3-9498-5efd0f2843bc service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:57.906078 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10e9b4-a265-4eb3-9498-5efd0f2843bc service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:57.906379 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10e9b4-a265-4eb3-9498-5efd0f2843bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:57.915639 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10e9b4-a265-4eb3-9498-5efd0f2843bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:57.917063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10e9b4-a265-4eb3-9498-5efd0f2843bc service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:57.926524 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1232/2465] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:51:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:51:58.198555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4c17b-a7d2-4cae-a4ab-45f380fee4b7 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:51:58.200090 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-f2a4c17b-a7d2-4cae-a4ab-45f380fee4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:51:58.215895 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a4c17b-a7d2-4cae-a4ab-45f380fee4b7 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:51:58.221406 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709868c-115b-43b0-a0f6-e0e4a2b4669f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:51:58.222261 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709868c-115b-43b0-a0f6-e0e4a2b4669f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:51:58.222901 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709868c-115b-43b0-a0f6-e0e4a2b4669f admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:51:58.223360 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8709868c-115b-43b0-a0f6-e0e4a2b4669f admin admin] PATH_INFO: `/v3/projects/f49b689546db489e88b124db488b095b` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:51:58.224960 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709868c-115b-43b0-a0f6-e0e4a2b4669f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f49b689546db489e88b124db488b095b)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:51:58.227380 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8709868c-115b-43b0-a0f6-e0e4a2b4669f admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:51:58.277740 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8709868c-115b-43b0-a0f6-e0e4a2b4669f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f49b689546db489e88b124db488b095b', 'request_id': 'req-8709868c-115b-43b0-a0f6-e0e4a2b4669f'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:58.285527 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8709868c-115b-43b0-a0f6-e0e4a2b4669f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f49b689546db489e88b124db488b095b', 'request_id': 'req-8709868c-115b-43b0-a0f6-e0e4a2b4669f'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:58.294387 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8709868c-115b-43b0-a0f6-e0e4a2b4669f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f49b689546db489e88b124db488b095b', 'request_id': 'req-8709868c-115b-43b0-a0f6-e0e4a2b4669f'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:58.315658 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8709868c-115b-43b0-a0f6-e0e4a2b4669f admin admin] The token cache is being invalidate because project f49b689546db489e88b124db488b095b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:51:58.315956 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8709868c-115b-43b0-a0f6-e0e4a2b4669f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:58.316617 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-8709868c-115b-43b0-a0f6-e0e4a2b4669f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:51:58.318129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1234/2466] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:51:58 2022] DELETE /identity/v3/projects/f49b689546db489e88b124db488b095b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:52:07.922172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=76,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:08.312539 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:15.036560 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104880f-300f-4cd5-a0d2-7fa876cc8a5b None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:15.037109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104880f-300f-4cd5-a0d2-7fa876cc8a5b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:15.037109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104880f-300f-4cd5-a0d2-7fa876cc8a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:15.057357 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-2104880f-300f-4cd5-a0d2-7fa876cc8a5b None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:52:15.058624 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-2104880f-300f-4cd5-a0d2-7fa876cc8a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:52:15.117264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1233/2467] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jul 27 22:52:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:52:15.139585 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709868c-115b-43b0-a0f6-e0e4a2b4669f admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:52:15.140975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8709868c-115b-43b0-a0f6-e0e4a2b4669f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:52:15.214494 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8709868c-115b-43b0-a0f6-e0e4a2b4669f admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:52:15.219913 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f679e-54c0-4349-a405-e3ee3a3a2052 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:52:15.220532 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f679e-54c0-4349-a405-e3ee3a3a2052 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:15.220821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f679e-54c0-4349-a405-e3ee3a3a2052 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:15.221110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f679e-54c0-4349-a405-e3ee3a3a2052 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:15.229760 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f679e-54c0-4349-a405-e3ee3a3a2052 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:52:15.231394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394f679e-54c0-4349-a405-e3ee3a3a2052 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:52:15.240750 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1235/2468] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:52:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:52:19.148733 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc447a0-1ce1-434c-9aef-be377292784e None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:19.149258 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc447a0-1ce1-434c-9aef-be377292784e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:19.149258 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc447a0-1ce1-434c-9aef-be377292784e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:19.169650 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-efc447a0-1ce1-434c-9aef-be377292784e None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:52:19.170897 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-efc447a0-1ce1-434c-9aef-be377292784e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:52:19.178694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1234/2469] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jul 27 22:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:52:19.205588 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f679e-54c0-4349-a405-e3ee3a3a2052 service nova] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:52:19.216996 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f679e-54c0-4349-a405-e3ee3a3a2052 service nova] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:52:19.222489 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b8cd7-1863-41c8-bcb8-32ef6083ca28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:52:19.223141 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b8cd7-1863-41c8-bcb8-32ef6083ca28 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:19.223429 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b8cd7-1863-41c8-bcb8-32ef6083ca28 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:19.223843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403b8cd7-1863-41c8-bcb8-32ef6083ca28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:19.232151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b8cd7-1863-41c8-bcb8-32ef6083ca28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:52:19.233738 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403b8cd7-1863-41c8-bcb8-32ef6083ca28 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:52:19.244273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1236/2470] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:52:23.427550 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d4374-d748-495e-8f6a-466560af47e8 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:23.428064 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d4374-d748-495e-8f6a-466560af47e8 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:23.428179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d4374-d748-495e-8f6a-466560af47e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:23.447228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-a64d4374-d748-495e-8f6a-466560af47e8 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:52:23.448447 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a64d4374-d748-495e-8f6a-466560af47e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:52:23.456396 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1235/2471] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jul 27 22:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:52:23.481824 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b8cd7-1863-41c8-bcb8-32ef6083ca28 service nova] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:52:23.483268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-403b8cd7-1863-41c8-bcb8-32ef6083ca28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:52:23.498293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403b8cd7-1863-41c8-bcb8-32ef6083ca28 service nova] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:52:23.503814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4155d-33bb-4aad-bf0b-cf4efc8b8b71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:52:23.504424 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4155d-33bb-4aad-bf0b-cf4efc8b8b71 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:23.504711 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4155d-33bb-4aad-bf0b-cf4efc8b8b71 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:23.504993 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4155d-33bb-4aad-bf0b-cf4efc8b8b71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:23.514008 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4155d-33bb-4aad-bf0b-cf4efc8b8b71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:52:23.515614 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4155d-33bb-4aad-bf0b-cf4efc8b8b71 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:52:23.524879 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1237/2472] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:52:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:52:27.526161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969db8d-0689-4df5-b282-83161abfb231 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:27.526676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969db8d-0689-4df5-b282-83161abfb231 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:27.526771 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a969db8d-0689-4df5-b282-83161abfb231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:27.546072 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-a969db8d-0689-4df5-b282-83161abfb231 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:52:27.547290 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a969db8d-0689-4df5-b282-83161abfb231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:52:27.555193 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1236/2473] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jul 27 22:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:52:27.576248 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4155d-33bb-4aad-bf0b-cf4efc8b8b71 service nova] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:52:27.589052 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4155d-33bb-4aad-bf0b-cf4efc8b8b71 service nova] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:52:27.597350 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5da176-02e8-4ca0-a256-da62a64cdffd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:52:27.597980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5da176-02e8-4ca0-a256-da62a64cdffd service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:27.598270 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5da176-02e8-4ca0-a256-da62a64cdffd service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:27.598600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5da176-02e8-4ca0-a256-da62a64cdffd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:27.608443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5da176-02e8-4ca0-a256-da62a64cdffd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:52:27.610020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5da176-02e8-4ca0-a256-da62a64cdffd service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:52:27.619591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1238/2474] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:52:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:52:31.088639 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99971a57-a0e7-452c-bf99-3636d02f4184 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:31.089136 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99971a57-a0e7-452c-bf99-3636d02f4184 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:31.089231 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99971a57-a0e7-452c-bf99-3636d02f4184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:31.108452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-99971a57-a0e7-452c-bf99-3636d02f4184 None None] MFA Rules not processed for user `db10ad54ec9948a3bb8b04c708fc4ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:52:31.109637 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-99971a57-a0e7-452c-bf99-3636d02f4184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:52:31.167038 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1237/2475] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 22:52:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:52:31.189973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5da176-02e8-4ca0-a256-da62a64cdffd service nova] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:52:31.191428 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6a5da176-02e8-4ca0-a256-da62a64cdffd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:52:31.272661 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5da176-02e8-4ca0-a256-da62a64cdffd service nova] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:52:31.277715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557e9f9-7a8a-4aa3-a681-4ba976cebdaf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf405258b9d413fae1192e10250b6a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:52:31.278352 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557e9f9-7a8a-4aa3-a681-4ba976cebdaf service swift] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:31.278669 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557e9f9-7a8a-4aa3-a681-4ba976cebdaf service swift] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:31.278946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557e9f9-7a8a-4aa3-a681-4ba976cebdaf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:31.287975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557e9f9-7a8a-4aa3-a681-4ba976cebdaf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:52:31.289570 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557e9f9-7a8a-4aa3-a681-4ba976cebdaf service swift] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:52:31.298038 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1239/2476] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 22:52:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 22:52:32.783328 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809b2b4-d748-4b86-a9cc-379cd8863f5f None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:32.783880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809b2b4-d748-4b86-a9cc-379cd8863f5f None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:32.783880 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809b2b4-d748-4b86-a9cc-379cd8863f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:32.804290 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-f809b2b4-d748-4b86-a9cc-379cd8863f5f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:52:32.805501 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-f809b2b4-d748-4b86-a9cc-379cd8863f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:52:32.814506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1238/2477] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jul 27 22:52:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:52:32.843833 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557e9f9-7a8a-4aa3-a681-4ba976cebdaf service swift] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:52:32.857179 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557e9f9-7a8a-4aa3-a681-4ba976cebdaf service swift] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:52:32.863228 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4458473-a1e2-4b4e-b26e-245ea3129e66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:52:32.863895 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4458473-a1e2-4b4e-b26e-245ea3129e66 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:32.864408 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4458473-a1e2-4b4e-b26e-245ea3129e66 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:32.864754 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4458473-a1e2-4b4e-b26e-245ea3129e66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:32.877744 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4458473-a1e2-4b4e-b26e-245ea3129e66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:52:32.880694 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4458473-a1e2-4b4e-b26e-245ea3129e66 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:52:32.892422 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1240/2478] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:52:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:52:37.006963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3cc57-4f10-49f8-a47b-034369ebd9b8 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:37.007527 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3cc57-4f10-49f8-a47b-034369ebd9b8 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:37.007527 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3cc57-4f10-49f8-a47b-034369ebd9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:37.027415 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-e7e3cc57-4f10-49f8-a47b-034369ebd9b8 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:52:37.028620 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e7e3cc57-4f10-49f8-a47b-034369ebd9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:52:37.036398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1239/2479] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jul 27 22:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:52:37.061506 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4458473-a1e2-4b4e-b26e-245ea3129e66 service nova] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:52:37.080211 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4458473-a1e2-4b4e-b26e-245ea3129e66 service nova] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:52:37.087058 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70763b-73ca-467f-951d-a4db5a0d7994 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:52:37.087749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70763b-73ca-467f-951d-a4db5a0d7994 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:37.088139 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70763b-73ca-467f-951d-a4db5a0d7994 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:37.088458 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70763b-73ca-467f-951d-a4db5a0d7994 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:37.098958 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70763b-73ca-467f-951d-a4db5a0d7994 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:52:37.100560 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70763b-73ca-467f-951d-a4db5a0d7994 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:52:37.123582 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1241/2480] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:52:47.021722 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=67 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:47.106805 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=96 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:52:50.437933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3cc57-4f10-49f8-a47b-034369ebd9b8 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:52:50.439438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e7e3cc57-4f10-49f8-a47b-034369ebd9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:52:50.512862 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3cc57-4f10-49f8-a47b-034369ebd9b8 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:52:50.518663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24454eb3-ba19-43bf-9901-5a446682b694 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a1384f3b34999a75572ee10a1e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:52:50.519469 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24454eb3-ba19-43bf-9901-5a446682b694 service placement] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:50.519762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24454eb3-ba19-43bf-9901-5a446682b694 service placement] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:50.520044 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24454eb3-ba19-43bf-9901-5a446682b694 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:50.521826 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-24454eb3-ba19-43bf-9901-5a446682b694 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:52:50.535645 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24454eb3-ba19-43bf-9901-5a446682b694 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:52:50.537240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24454eb3-ba19-43bf-9901-5a446682b694 service placement] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:52:50.546012 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70763b-73ca-467f-951d-a4db5a0d7994 service nova] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:52:50.547444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-fc70763b-73ca-467f-951d-a4db5a0d7994 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:52:50.547636 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1240/2481] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:52:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:52:50.561791 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70763b-73ca-467f-951d-a4db5a0d7994 service nova] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:52:50.568059 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966fed4-cb58-48a8-924c-c97863da9ad5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a1384f3b34999a75572ee10a1e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:52:50.568678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966fed4-cb58-48a8-924c-c97863da9ad5 service placement] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:50.569008 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966fed4-cb58-48a8-924c-c97863da9ad5 service placement] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:50.569237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966fed4-cb58-48a8-924c-c97863da9ad5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:50.584040 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966fed4-cb58-48a8-924c-c97863da9ad5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:52:50.585682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966fed4-cb58-48a8-924c-c97863da9ad5 service placement] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:52:50.596947 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1242/2482] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:52:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:52:52.053700 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e50e1-b331-42b2-8ac6-1edce1a33368 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:52.054214 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e50e1-b331-42b2-8ac6-1edce1a33368 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:52.054326 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e50e1-b331-42b2-8ac6-1edce1a33368 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:52.055854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1241/2483] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 22:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:52:52.062311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fab20d-bc76-4d5f-a061-bfe879f6aec6 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:52.062782 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fab20d-bc76-4d5f-a061-bfe879f6aec6 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:52.063050 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fab20d-bc76-4d5f-a061-bfe879f6aec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:52.088639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-73fab20d-bc76-4d5f-a061-bfe879f6aec6 None None] MFA Rules not processed for user `c621601261e44ca8a7938862d6578639`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:52:52.089906 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-73fab20d-bc76-4d5f-a061-bfe879f6aec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:52:52.099957 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1243/2484] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 22:52:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:52:52.113611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e50e1-b331-42b2-8ac6-1edce1a33368 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:52:52.115310 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-629e50e1-b331-42b2-8ac6-1edce1a33368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:52:52.173339 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e50e1-b331-42b2-8ac6-1edce1a33368 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:52:52.176728 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a59a6b-9291-4abe-b11a-caa25a0bdd98 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b26c60d08b9f47aca8404e4173290908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:52:52.177347 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a59a6b-9291-4abe-b11a-caa25a0bdd98 service glance] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:52.177641 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a59a6b-9291-4abe-b11a-caa25a0bdd98 service glance] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:52.177898 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a59a6b-9291-4abe-b11a-caa25a0bdd98 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:52.188061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a59a6b-9291-4abe-b11a-caa25a0bdd98 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:52:52.189464 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a59a6b-9291-4abe-b11a-caa25a0bdd98 service glance] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:52:52.200430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1242/2485] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:52:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:52:52.268071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ad34f-38d4-4fa3-8aa1-b61afd798bab None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:52.268362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ad34f-38d4-4fa3-8aa1-b61afd798bab None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:52.268643 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ad34f-38d4-4fa3-8aa1-b61afd798bab None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:52.269997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1244/2486] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 22:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:52:52.274644 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c862a27-8f3f-44f7-b174-3d7dafeef561 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:52.274938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c862a27-8f3f-44f7-b174-3d7dafeef561 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:52.275217 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c862a27-8f3f-44f7-b174-3d7dafeef561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:52.295039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-8c862a27-8f3f-44f7-b174-3d7dafeef561 None None] MFA Rules not processed for user `c266721767004428b9b54dd200f3cd6b`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:52:52.296242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8c862a27-8f3f-44f7-b174-3d7dafeef561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:52:52.346078 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1243/2487] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 22:52:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:52:52.357808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ad34f-38d4-4fa3-8aa1-b61afd798bab None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:52:52.359467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-9c2ad34f-38d4-4fa3-8aa1-b61afd798bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:52:52.372982 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ad34f-38d4-4fa3-8aa1-b61afd798bab None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:52:52.376516 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09da152-02e1-43f9-8441-4ae71ae1462b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:52:52.377125 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09da152-02e1-43f9-8441-4ae71ae1462b service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:52.377412 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09da152-02e1-43f9-8441-4ae71ae1462b service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:52.377692 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09da152-02e1-43f9-8441-4ae71ae1462b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:52.384626 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09da152-02e1-43f9-8441-4ae71ae1462b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:52:52.386072 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09da152-02e1-43f9-8441-4ae71ae1462b service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:52:52.394388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1245/2488] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:52:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:52:52.475197 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14441a7a-0204-474c-99c0-9578d35db324 None None] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:52.475492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14441a7a-0204-474c-99c0-9578d35db324 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:52.475773 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14441a7a-0204-474c-99c0-9578d35db324 None None] PATH_INFO: `/` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:52.477147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1244/2489] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 22:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 22:52:52.481943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f875d-44c2-4a2b-8d8c-7500119b3058 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:52.482233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f875d-44c2-4a2b-8d8c-7500119b3058 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:52.482542 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f875d-44c2-4a2b-8d8c-7500119b3058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:52.502154 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-066f875d-44c2-4a2b-8d8c-7500119b3058 None None] MFA Rules not processed for user `c621601261e44ca8a7938862d6578639`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:52:52.503485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-066f875d-44c2-4a2b-8d8c-7500119b3058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:52:52.513431 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1246/2490] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 22:52:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:52:52.523511 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14441a7a-0204-474c-99c0-9578d35db324 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:52:52.534390 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14441a7a-0204-474c-99c0-9578d35db324 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:52:52.537916 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6fd8c-dc77-44de-a305-ad83322b28c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:52:52.538549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6fd8c-dc77-44de-a305-ad83322b28c3 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:52.538837 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6fd8c-dc77-44de-a305-ad83322b28c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:52.539113 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c6fd8c-dc77-44de-a305-ad83322b28c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:52.548865 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6fd8c-dc77-44de-a305-ad83322b28c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:52:52.550276 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c6fd8c-dc77-44de-a305-ad83322b28c3 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:52:52.561231 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1245/2491] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:52:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:52:54.827997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f7fd5-2a28-4827-a745-430fa4884e91 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:54.828465 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f7fd5-2a28-4827-a745-430fa4884e91 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:54.828559 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4f7fd5-2a28-4827-a745-430fa4884e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:54.847330 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-9a4f7fd5-2a28-4827-a745-430fa4884e91 None None] MFA Rules not processed for user `db10ad54ec9948a3bb8b04c708fc4ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:52:54.848512 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-9a4f7fd5-2a28-4827-a745-430fa4884e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:52:54.855606 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1247/2492] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 22:52:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:52:54.867147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6fd8c-dc77-44de-a305-ad83322b28c3 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:52:54.878695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c6fd8c-dc77-44de-a305-ad83322b28c3 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:52:54.883665 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b87c7-2dda-46d2-ab58-14f01ff07f10 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf405258b9d413fae1192e10250b6a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:52:54.884289 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b87c7-2dda-46d2-ab58-14f01ff07f10 service swift] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:54.884560 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b87c7-2dda-46d2-ab58-14f01ff07f10 service swift] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:54.884837 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b87c7-2dda-46d2-ab58-14f01ff07f10 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:54.893661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b87c7-2dda-46d2-ab58-14f01ff07f10 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:52:54.895277 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b87c7-2dda-46d2-ab58-14f01ff07f10 service swift] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:52:54.903346 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1246/2493] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 22:52:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 22:52:56.774613 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4f756-5b04-4e4f-a9f3-1653d9ddd204 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:52:56.775137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4f756-5b04-4e4f-a9f3-1653d9ddd204 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:52:56.775322 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b4f756-5b04-4e4f-a9f3-1653d9ddd204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:52:56.794492 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-e6b4f756-5b04-4e4f-a9f3-1653d9ddd204 None None] MFA Rules not processed for user `965e389784a44f68b2e5484224b95b12`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:52:56.795674 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e6b4f756-5b04-4e4f-a9f3-1653d9ddd204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:52:56.854103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1248/2494] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:52:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:53:04.900166 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=93 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:53:06.846738 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=46 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:53:20.456179 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46635a35-3bd0-4a25-a30f-5159fb1f2a82 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:53:20.456711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46635a35-3bd0-4a25-a30f-5159fb1f2a82 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:53:20.456890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46635a35-3bd0-4a25-a30f-5159fb1f2a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:53:20.476747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-46635a35-3bd0-4a25-a30f-5159fb1f2a82 None None] MFA Rules not processed for user `db10ad54ec9948a3bb8b04c708fc4ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:53:20.478011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-46635a35-3bd0-4a25-a30f-5159fb1f2a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:53:20.485485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1247/2495] 10.222.0.48 () {58 vars in 967 bytes} [Wed Jul 27 22:53:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:53:20.498444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4f756-5b04-4e4f-a9f3-1653d9ddd204 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:53:20.510022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b4f756-5b04-4e4f-a9f3-1653d9ddd204 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:53:20.514925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c4d58-2659-46b6-91fb-7744e780f7bd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf405258b9d413fae1192e10250b6a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:53:20.515537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c4d58-2659-46b6-91fb-7744e780f7bd service swift] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:53:20.515821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c4d58-2659-46b6-91fb-7744e780f7bd service swift] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:53:20.516107 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c4d58-2659-46b6-91fb-7744e780f7bd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:53:20.524026 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c4d58-2659-46b6-91fb-7744e780f7bd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:53:20.525590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c4d58-2659-46b6-91fb-7744e780f7bd service swift] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:53:20.533503 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1249/2496] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 22:53:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 22:53:26.273122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62951d5d-bdb7-4cf7-8d9c-47e4e22ea90f None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:53:26.273703 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62951d5d-bdb7-4cf7-8d9c-47e4e22ea90f None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:53:26.273703 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62951d5d-bdb7-4cf7-8d9c-47e4e22ea90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:53:26.293416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-62951d5d-bdb7-4cf7-8d9c-47e4e22ea90f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:53:26.294630 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-62951d5d-bdb7-4cf7-8d9c-47e4e22ea90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:53:26.302525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1248/2497] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jul 27 22:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:53:26.323882 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c4d58-2659-46b6-91fb-7744e780f7bd service swift] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:53:26.337078 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c4d58-2659-46b6-91fb-7744e780f7bd service swift] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:53:26.342545 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe6eae-0a4e-487e-8c37-043ed443d76b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:53:26.343151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe6eae-0a4e-487e-8c37-043ed443d76b service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:53:26.343439 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe6eae-0a4e-487e-8c37-043ed443d76b service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:53:26.343720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe6eae-0a4e-487e-8c37-043ed443d76b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:53:26.351738 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe6eae-0a4e-487e-8c37-043ed443d76b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:53:26.353304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe6eae-0a4e-487e-8c37-043ed443d76b service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:53:26.362836 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1250/2498] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:53:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:53:30.549696 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025bb0b6-1a2e-46e0-a80d-9d4ffbc33d54 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:53:30.550232 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025bb0b6-1a2e-46e0-a80d-9d4ffbc33d54 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:53:30.550232 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025bb0b6-1a2e-46e0-a80d-9d4ffbc33d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:53:30.568787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-025bb0b6-1a2e-46e0-a80d-9d4ffbc33d54 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:53:30.569965 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-025bb0b6-1a2e-46e0-a80d-9d4ffbc33d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:53:30.578114 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1249/2499] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jul 27 22:53:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:53:30.602677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe6eae-0a4e-487e-8c37-043ed443d76b service nova] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:53:30.614195 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe6eae-0a4e-487e-8c37-043ed443d76b service nova] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:53:30.619640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c79563-2b1f-444c-baba-63b513b4395c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:53:30.620244 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c79563-2b1f-444c-baba-63b513b4395c service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:53:30.620527 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c79563-2b1f-444c-baba-63b513b4395c service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:53:30.620802 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c79563-2b1f-444c-baba-63b513b4395c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:53:30.628721 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c79563-2b1f-444c-baba-63b513b4395c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:53:30.630269 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c79563-2b1f-444c-baba-63b513b4395c service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:53:30.639848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1251/2500] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:53:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:53:34.682578 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae17170-4399-447b-91ad-06805cf45b19 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:53:34.683141 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae17170-4399-447b-91ad-06805cf45b19 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:53:34.683387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae17170-4399-447b-91ad-06805cf45b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:53:34.703293 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-5ae17170-4399-447b-91ad-06805cf45b19 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:53:34.704506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5ae17170-4399-447b-91ad-06805cf45b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:53:34.712768 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1250/2501] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jul 27 22:53:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:53:34.757833 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c79563-2b1f-444c-baba-63b513b4395c service nova] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:53:34.769747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c79563-2b1f-444c-baba-63b513b4395c service nova] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:53:34.775391 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fac228-94cc-4b14-a772-5d2745d8a0a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:53:34.776013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fac228-94cc-4b14-a772-5d2745d8a0a3 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:53:34.776302 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fac228-94cc-4b14-a772-5d2745d8a0a3 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:53:34.776586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fac228-94cc-4b14-a772-5d2745d8a0a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:53:34.785798 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fac228-94cc-4b14-a772-5d2745d8a0a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:53:34.787413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fac228-94cc-4b14-a772-5d2745d8a0a3 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:53:34.797204 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1252/2502] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:53:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:53:38.859770 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834f61b-9f08-4435-9b4c-a1057cdd3cad None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:53:38.860329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834f61b-9f08-4435-9b4c-a1057cdd3cad None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:53:38.860329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8834f61b-9f08-4435-9b4c-a1057cdd3cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:53:38.879044 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-8834f61b-9f08-4435-9b4c-a1057cdd3cad None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:53:38.880234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8834f61b-9f08-4435-9b4c-a1057cdd3cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:53:38.887929 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1251/2503] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jul 27 22:53:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:53:38.913881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fac228-94cc-4b14-a772-5d2745d8a0a3 service nova] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:53:38.925775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fac228-94cc-4b14-a772-5d2745d8a0a3 service nova] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:53:38.931206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1018cd-2ba0-4bb7-b413-848cbd1be1e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:53:38.931809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1018cd-2ba0-4bb7-b413-848cbd1be1e7 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:53:38.932093 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1018cd-2ba0-4bb7-b413-848cbd1be1e7 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:53:38.932371 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1018cd-2ba0-4bb7-b413-848cbd1be1e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:53:38.940683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1018cd-2ba0-4bb7-b413-848cbd1be1e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:53:38.942246 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1018cd-2ba0-4bb7-b413-848cbd1be1e7 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:53:38.951446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1253/2504] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:53:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:53:43.048118 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b9b1c-e90a-4c61-93d7-60fd45998dcc None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:53:43.048646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b9b1c-e90a-4c61-93d7-60fd45998dcc None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:53:43.048750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b9b1c-e90a-4c61-93d7-60fd45998dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:53:43.068467 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-3f9b9b1c-e90a-4c61-93d7-60fd45998dcc None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:53:43.069684 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-3f9b9b1c-e90a-4c61-93d7-60fd45998dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:53:43.079944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1252/2505] 10.222.0.58 () {58 vars in 1016 bytes} [Wed Jul 27 22:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:53:43.110222 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1018cd-2ba0-4bb7-b413-848cbd1be1e7 service nova] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:53:43.121837 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1018cd-2ba0-4bb7-b413-848cbd1be1e7 service nova] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:53:43.127477 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf29b81-3c52-462b-86e7-ded6af8fe373 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:53:43.128091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf29b81-3c52-462b-86e7-ded6af8fe373 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:53:43.128373 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf29b81-3c52-462b-86e7-ded6af8fe373 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:53:43.128648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf29b81-3c52-462b-86e7-ded6af8fe373 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:53:43.136795 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf29b81-3c52-462b-86e7-ded6af8fe373 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:53:43.138359 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf29b81-3c52-462b-86e7-ded6af8fe373 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:53:43.148008 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1254/2506] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:53:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:53:50.143183 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aaf7d-fcb3-4a61-bacf-4be2e97233da None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:53:50.143703 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aaf7d-fcb3-4a61-bacf-4be2e97233da None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:53:50.143703 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85aaf7d-fcb3-4a61-bacf-4be2e97233da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:53:50.150677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=19 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:53:50.163583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-f85aaf7d-fcb3-4a61-bacf-4be2e97233da None None] MFA Rules not processed for user `7e7b9e21971c432b9f23ceee4c5b7a3d`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:53:50.164753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-f85aaf7d-fcb3-4a61-bacf-4be2e97233da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:53:50.218301 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1253/2507] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:53:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:53:53.143634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=36 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:00.211840 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=24 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:19.538820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf29b81-3c52-462b-86e7-ded6af8fe373 service nova] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:54:19.540249 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-2cf29b81-3c52-462b-86e7-ded6af8fe373 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:54:19.556849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf29b81-3c52-462b-86e7-ded6af8fe373 service nova] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:54:19.562382 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da73241-283a-4b86-9d74-81dcea682e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:54:19.563224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da73241-283a-4b86-9d74-81dcea682e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:54:19.563606 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da73241-283a-4b86-9d74-81dcea682e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:54:19.563889 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da73241-283a-4b86-9d74-81dcea682e17 admin admin] PATH_INFO: `/v3/users/965e389784a44f68b2e5484224b95b12` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:54:19.565052 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da73241-283a-4b86-9d74-81dcea682e17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=965e389784a44f68b2e5484224b95b12)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:54:19.566994 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da73241-283a-4b86-9d74-81dcea682e17 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:54:19.615340 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0da73241-283a-4b86-9d74-81dcea682e17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '965e389784a44f68b2e5484224b95b12'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:54:19.615988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0da73241-283a-4b86-9d74-81dcea682e17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '965e389784a44f68b2e5484224b95b12'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:54:19.628144 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0da73241-283a-4b86-9d74-81dcea682e17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '965e389784a44f68b2e5484224b95b12'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:54:19.634823 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0da73241-283a-4b86-9d74-81dcea682e17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '965e389784a44f68b2e5484224b95b12'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:54:19.642622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0da73241-283a-4b86-9d74-81dcea682e17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '965e389784a44f68b2e5484224b95b12'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:54:19.648367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1255/2508] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:54:19 2022] DELETE /identity/v3/users/965e389784a44f68b2e5484224b95b12 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:54:19.832933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85aaf7d-fcb3-4a61-bacf-4be2e97233da None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:54:19.844001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85aaf7d-fcb3-4a61-bacf-4be2e97233da None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:54:19.902837 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901eca84-e9b1-4bb2-99ec-5c3275948c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:54:19.903489 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901eca84-e9b1-4bb2-99ec-5c3275948c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:54:19.903774 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901eca84-e9b1-4bb2-99ec-5c3275948c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:54:19.904054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901eca84-e9b1-4bb2-99ec-5c3275948c02 admin admin] PATH_INFO: `/v3/projects/b9a0d575f64a4d74967d2fcf09587c3c` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:54:19.905248 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901eca84-e9b1-4bb2-99ec-5c3275948c02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9a0d575f64a4d74967d2fcf09587c3c)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:54:19.907208 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901eca84-e9b1-4bb2-99ec-5c3275948c02 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:54:19.953308 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-901eca84-e9b1-4bb2-99ec-5c3275948c02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9a0d575f64a4d74967d2fcf09587c3c', 'request_id': 'req-901eca84-e9b1-4bb2-99ec-5c3275948c02'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:54:19.959661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-901eca84-e9b1-4bb2-99ec-5c3275948c02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9a0d575f64a4d74967d2fcf09587c3c', 'request_id': 'req-901eca84-e9b1-4bb2-99ec-5c3275948c02'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:54:19.965183 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-901eca84-e9b1-4bb2-99ec-5c3275948c02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9a0d575f64a4d74967d2fcf09587c3c', 'request_id': 'req-901eca84-e9b1-4bb2-99ec-5c3275948c02'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:54:19.977646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-901eca84-e9b1-4bb2-99ec-5c3275948c02 admin admin] The token cache is being invalidate because project b9a0d575f64a4d74967d2fcf09587c3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:54:19.977936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-901eca84-e9b1-4bb2-99ec-5c3275948c02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:54:19.978585 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-901eca84-e9b1-4bb2-99ec-5c3275948c02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:54:19.980595 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1254/2509] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:54:19 2022] DELETE /identity/v3/projects/b9a0d575f64a4d74967d2fcf09587c3c => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:54:29.152892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da73241-283a-4b86-9d74-81dcea682e17 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:54:29.154371 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-0da73241-283a-4b86-9d74-81dcea682e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:54:29.226803 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da73241-283a-4b86-9d74-81dcea682e17 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:54:29.287955 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f494786-58cb-498d-a153-ab0caaf9cc88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:54:29.288540 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f494786-58cb-498d-a153-ab0caaf9cc88 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:54:29.288829 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f494786-58cb-498d-a153-ab0caaf9cc88 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:54:29.289107 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f494786-58cb-498d-a153-ab0caaf9cc88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:54:29.290935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-2f494786-58cb-498d-a153-ab0caaf9cc88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:54:29.296769 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:29.357028 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f494786-58cb-498d-a153-ab0caaf9cc88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:54:29.358656 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f494786-58cb-498d-a153-ab0caaf9cc88 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:54:29.367625 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1256/2510] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:54:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:54:29.526446 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901eca84-e9b1-4bb2-99ec-5c3275948c02 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:54:29.527869 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-901eca84-e9b1-4bb2-99ec-5c3275948c02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:54:29.584428 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901eca84-e9b1-4bb2-99ec-5c3275948c02 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:54:29.588084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954a648-ba1c-4b97-832a-6eba3505909c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:54:29.588695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954a648-ba1c-4b97-832a-6eba3505909c service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:54:29.588976 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954a648-ba1c-4b97-832a-6eba3505909c service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:54:29.589251 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954a648-ba1c-4b97-832a-6eba3505909c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:54:29.590984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d954a648-ba1c-4b97-832a-6eba3505909c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:54:29.604814 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954a648-ba1c-4b97-832a-6eba3505909c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:54:29.606296 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954a648-ba1c-4b97-832a-6eba3505909c service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:54:29.617681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1255/2511] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:54:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:54:32.242743 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f494786-58cb-498d-a153-ab0caaf9cc88 service nova] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:54:32.244265 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-2f494786-58cb-498d-a153-ab0caaf9cc88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:54:32.300632 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f494786-58cb-498d-a153-ab0caaf9cc88 service nova] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:54:32.304232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b6129-c826-41da-a764-41760b09256a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:54:32.304850 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b6129-c826-41da-a764-41760b09256a service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:54:32.305133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b6129-c826-41da-a764-41760b09256a service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:54:32.305414 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074b6129-c826-41da-a764-41760b09256a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:54:32.307189 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-074b6129-c826-41da-a764-41760b09256a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:54:32.320520 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b6129-c826-41da-a764-41760b09256a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:54:32.321926 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074b6129-c826-41da-a764-41760b09256a service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:54:32.333222 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1257/2512] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:54:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:54:36.932157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aefd50-019d-45cb-abe8-bb647bffee46 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:54:36.933255 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aefd50-019d-45cb-abe8-bb647bffee46 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:54:36.933255 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aefd50-019d-45cb-abe8-bb647bffee46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:54:36.951777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-70aefd50-019d-45cb-abe8-bb647bffee46 None None] MFA Rules not processed for user `7276ed630a694d0f844aa402169b938d`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:54:36.952954 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-70aefd50-019d-45cb-abe8-bb647bffee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:54:36.960188 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1256/2513] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:54:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:54:37.260015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b6129-c826-41da-a764-41760b09256a service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:54:37.268541 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074b6129-c826-41da-a764-41760b09256a service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:54:37.272115 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f87999-1e5c-453c-874e-666c1e1555d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:54:37.272723 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f87999-1e5c-453c-874e-666c1e1555d0 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:54:37.273010 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f87999-1e5c-453c-874e-666c1e1555d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:54:37.273292 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f87999-1e5c-453c-874e-666c1e1555d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:54:37.275046 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-c6f87999-1e5c-453c-874e-666c1e1555d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:54:37.284789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f87999-1e5c-453c-874e-666c1e1555d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:54:37.286235 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f87999-1e5c-453c-874e-666c1e1555d0 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:54:37.294729 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1258/2514] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:54:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:54:37.612892 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aefd50-019d-45cb-abe8-bb647bffee46 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:54:37.614250 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-70aefd50-019d-45cb-abe8-bb647bffee46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:54:37.645318 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:37.686610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aefd50-019d-45cb-abe8-bb647bffee46 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:54:37.691889 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaf12c-ce0c-4edc-a328-098e59f9a990 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a1384f3b34999a75572ee10a1e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:54:37.692559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaf12c-ce0c-4edc-a328-098e59f9a990 service placement] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:54:37.692840 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaf12c-ce0c-4edc-a328-098e59f9a990 service placement] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:54:37.693111 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eaf12c-ce0c-4edc-a328-098e59f9a990 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:54:37.694859 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-80eaf12c-ce0c-4edc-a328-098e59f9a990 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:54:37.707611 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaf12c-ce0c-4edc-a328-098e59f9a990 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:54:37.709455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eaf12c-ce0c-4edc-a328-098e59f9a990 service placement] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:54:37.720495 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1257/2515] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:54:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:54:39.574990 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f87999-1e5c-453c-874e-666c1e1555d0 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:54:39.576534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-c6f87999-1e5c-453c-874e-666c1e1555d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:54:39.587366 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f87999-1e5c-453c-874e-666c1e1555d0 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:54:39.591097 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbe107-ea42-43f7-9845-50aadfe9f1b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:54:39.591718 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbe107-ea42-43f7-9845-50aadfe9f1b5 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:54:39.592005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbe107-ea42-43f7-9845-50aadfe9f1b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:54:39.592283 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dbe107-ea42-43f7-9845-50aadfe9f1b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:54:39.593954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-25dbe107-ea42-43f7-9845-50aadfe9f1b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:54:39.603761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbe107-ea42-43f7-9845-50aadfe9f1b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:54:39.605199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dbe107-ea42-43f7-9845-50aadfe9f1b5 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:54:39.613217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1259/2516] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:54:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:54:47.715981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=20 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:49.525463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaf12c-ce0c-4edc-a328-098e59f9a990 service placement] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:54:49.527394 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-80eaf12c-ce0c-4edc-a328-098e59f9a990 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:54:49.543054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eaf12c-ce0c-4edc-a328-098e59f9a990 service placement] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:54:49.548487 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98550cd6-5b07-4817-957f-c87e6b2cfe6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:54:49.549107 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98550cd6-5b07-4817-957f-c87e6b2cfe6f service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:54:49.549395 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98550cd6-5b07-4817-957f-c87e6b2cfe6f service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:54:49.549671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98550cd6-5b07-4817-957f-c87e6b2cfe6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:54:49.551456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-98550cd6-5b07-4817-957f-c87e6b2cfe6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:54:49.563721 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98550cd6-5b07-4817-957f-c87e6b2cfe6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:54:49.565392 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98550cd6-5b07-4817-957f-c87e6b2cfe6f service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:54:49.576431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1258/2517] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:54:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:54:49.609555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=62 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:54:59.571673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=6 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:06.473071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbe107-ea42-43f7-9845-50aadfe9f1b5 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:06.482438 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dbe107-ea42-43f7-9845-50aadfe9f1b5 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:06.486039 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2e2d5-f26d-4ff7-b11f-b8b02792c916 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:06.486675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2e2d5-f26d-4ff7-b11f-b8b02792c916 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:06.486960 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2e2d5-f26d-4ff7-b11f-b8b02792c916 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:06.487238 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2e2d5-f26d-4ff7-b11f-b8b02792c916 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:06.488956 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ece2e2d5-f26d-4ff7-b11f-b8b02792c916 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:06.548372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2e2d5-f26d-4ff7-b11f-b8b02792c916 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:06.549786 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2e2d5-f26d-4ff7-b11f-b8b02792c916 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:06.559143 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1260/2518] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:55:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:55:06.594806 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98550cd6-5b07-4817-957f-c87e6b2cfe6f service nova] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:06.596239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-98550cd6-5b07-4817-957f-c87e6b2cfe6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:06.607999 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98550cd6-5b07-4817-957f-c87e6b2cfe6f service nova] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:06.611883 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47823c67-8aac-4fae-a3ce-7f016db1442c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:06.612504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47823c67-8aac-4fae-a3ce-7f016db1442c service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:06.613011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47823c67-8aac-4fae-a3ce-7f016db1442c service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:06.613324 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47823c67-8aac-4fae-a3ce-7f016db1442c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:06.615789 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-47823c67-8aac-4fae-a3ce-7f016db1442c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:06.683724 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47823c67-8aac-4fae-a3ce-7f016db1442c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:06.685202 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47823c67-8aac-4fae-a3ce-7f016db1442c service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:06.694777 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1259/2519] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:55:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:55:16.061841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c8d53-27c0-4f92-b492-66a33870113f None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:16.062462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c8d53-27c0-4f92-b492-66a33870113f None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:16.062462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c8d53-27c0-4f92-b492-66a33870113f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:16.081015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-743c8d53-27c0-4f92-b492-66a33870113f None None] MFA Rules not processed for user `0de16e13f2f948698e9174fcf1e0a3a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:55:16.082271 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-743c8d53-27c0-4f92-b492-66a33870113f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:16.089609 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1261/2520] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:55:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:55:16.393208 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47823c67-8aac-4fae-a3ce-7f016db1442c service cinder] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:16.405628 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47823c67-8aac-4fae-a3ce-7f016db1442c service cinder] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:16.407706 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f7e25-97d0-422f-ba0a-5e04a9b45ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:16.408327 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f7e25-97d0-422f-ba0a-5e04a9b45ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:16.408607 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f7e25-97d0-422f-ba0a-5e04a9b45ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:16.408881 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f7e25-97d0-422f-ba0a-5e04a9b45ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:16.410659 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-358f7e25-97d0-422f-ba0a-5e04a9b45ba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:16.421865 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f7e25-97d0-422f-ba0a-5e04a9b45ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:16.423306 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f7e25-97d0-422f-ba0a-5e04a9b45ba8 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:16.432269 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1260/2521] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:55:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:55:26.075941 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=31 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:26.189707 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c8d53-27c0-4f92-b492-66a33870113f None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:26.191623 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-743c8d53-27c0-4f92-b492-66a33870113f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:26.209910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c8d53-27c0-4f92-b492-66a33870113f None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:26.216207 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5943e-b510-4d7e-b770-213cfb062461 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:26.216866 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5943e-b510-4d7e-b770-213cfb062461 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:26.217156 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5943e-b510-4d7e-b770-213cfb062461 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:26.217438 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a5943e-b510-4d7e-b770-213cfb062461 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:26.219356 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-c5a5943e-b510-4d7e-b770-213cfb062461 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:26.232407 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5943e-b510-4d7e-b770-213cfb062461 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:26.233917 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a5943e-b510-4d7e-b770-213cfb062461 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:26.244934 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1262/2522] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:55:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:55:26.427982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=34 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:30.246107 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f7e25-97d0-422f-ba0a-5e04a9b45ba8 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:30.254943 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f7e25-97d0-422f-ba0a-5e04a9b45ba8 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:30.258846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce1dcf-bc9d-4aa8-9c17-0bcbd3668c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:30.259486 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce1dcf-bc9d-4aa8-9c17-0bcbd3668c6f service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:30.259774 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce1dcf-bc9d-4aa8-9c17-0bcbd3668c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:30.260055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ce1dcf-bc9d-4aa8-9c17-0bcbd3668c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:30.261817 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-39ce1dcf-bc9d-4aa8-9c17-0bcbd3668c6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:30.323209 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce1dcf-bc9d-4aa8-9c17-0bcbd3668c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:30.324706 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ce1dcf-bc9d-4aa8-9c17-0bcbd3668c6f service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:30.334492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1261/2523] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:55:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:55:33.720978 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5943e-b510-4d7e-b770-213cfb062461 service nova] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:33.723256 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-c5a5943e-b510-4d7e-b770-213cfb062461 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:33.744157 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a5943e-b510-4d7e-b770-213cfb062461 service nova] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:33.758066 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d6ac14-7bd0-4f4b-b8f3-55f7878005fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:33.758885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6ac14-7bd0-4f4b-b8f3-55f7878005fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:33.761966 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6ac14-7bd0-4f4b-b8f3-55f7878005fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:33.762247 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d6ac14-7bd0-4f4b-b8f3-55f7878005fe admin admin] PATH_INFO: `/v3/users/7e7b9e21971c432b9f23ceee4c5b7a3d` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:33.763505 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6ac14-7bd0-4f4b-b8f3-55f7878005fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e7b9e21971c432b9f23ceee4c5b7a3d)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:33.765581 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d6ac14-7bd0-4f4b-b8f3-55f7878005fe admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:33.813754 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-c6d6ac14-7bd0-4f4b-b8f3-55f7878005fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e7b9e21971c432b9f23ceee4c5b7a3d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:33.814530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-c6d6ac14-7bd0-4f4b-b8f3-55f7878005fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e7b9e21971c432b9f23ceee4c5b7a3d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:33.827328 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-c6d6ac14-7bd0-4f4b-b8f3-55f7878005fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e7b9e21971c432b9f23ceee4c5b7a3d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:33.835306 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-c6d6ac14-7bd0-4f4b-b8f3-55f7878005fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e7b9e21971c432b9f23ceee4c5b7a3d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:33.843415 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-c6d6ac14-7bd0-4f4b-b8f3-55f7878005fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e7b9e21971c432b9f23ceee4c5b7a3d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:33.849396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1263/2524] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:55:33 2022] DELETE /identity/v3/users/7e7b9e21971c432b9f23ceee4c5b7a3d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:55:34.020617 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce1dcf-bc9d-4aa8-9c17-0bcbd3668c6f service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:34.031339 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ce1dcf-bc9d-4aa8-9c17-0bcbd3668c6f service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:34.094273 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c0e9c-816a-4f15-b438-0a02a53e791f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:34.094975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c0e9c-816a-4f15-b438-0a02a53e791f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:34.095259 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c0e9c-816a-4f15-b438-0a02a53e791f admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:34.095533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c0e9c-816a-4f15-b438-0a02a53e791f admin admin] PATH_INFO: `/v3/projects/16b144b0bec84b07b68856c10d59e72b` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:34.096676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c0e9c-816a-4f15-b438-0a02a53e791f admin admin] RBAC: Authorizing `identity:delete_project(project_id=16b144b0bec84b07b68856c10d59e72b)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:34.098612 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c0e9c-816a-4f15-b438-0a02a53e791f admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:34.144184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-659c0e9c-816a-4f15-b438-0a02a53e791f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16b144b0bec84b07b68856c10d59e72b', 'request_id': 'req-659c0e9c-816a-4f15-b438-0a02a53e791f'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:34.150110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-659c0e9c-816a-4f15-b438-0a02a53e791f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16b144b0bec84b07b68856c10d59e72b', 'request_id': 'req-659c0e9c-816a-4f15-b438-0a02a53e791f'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:34.155700 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-659c0e9c-816a-4f15-b438-0a02a53e791f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16b144b0bec84b07b68856c10d59e72b', 'request_id': 'req-659c0e9c-816a-4f15-b438-0a02a53e791f'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:34.168243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-659c0e9c-816a-4f15-b438-0a02a53e791f admin admin] The token cache is being invalidate because project 16b144b0bec84b07b68856c10d59e72b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:55:34.168531 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-659c0e9c-816a-4f15-b438-0a02a53e791f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:34.169186 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-659c0e9c-816a-4f15-b438-0a02a53e791f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:34.170731 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1262/2525] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:55:34 2022] DELETE /identity/v3/projects/16b144b0bec84b07b68856c10d59e72b => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:55:34.175655 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354e3aa-dd0f-4f04-a740-d1c24a12c891 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:34.175970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354e3aa-dd0f-4f04-a740-d1c24a12c891 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:34.176252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354e3aa-dd0f-4f04-a740-d1c24a12c891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:34.195977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-5354e3aa-dd0f-4f04-a740-d1c24a12c891 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:55:34.197178 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-5354e3aa-dd0f-4f04-a740-d1c24a12c891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:34.255008 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1264/2526] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:55:34.262561 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65a553-0fc7-4304-bce1-cb23d1d8bd57 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:34.262833 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65a553-0fc7-4304-bce1-cb23d1d8bd57 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:34.263105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65a553-0fc7-4304-bce1-cb23d1d8bd57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:34.282401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-1d65a553-0fc7-4304-bce1-cb23d1d8bd57 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:55:34.283587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-1d65a553-0fc7-4304-bce1-cb23d1d8bd57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:34.291298 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1263/2527] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:55:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:55:34.296016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354e3aa-dd0f-4f04-a740-d1c24a12c891 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:34.305707 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354e3aa-dd0f-4f04-a740-d1c24a12c891 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:34.310311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c2e4f-5a08-4b1c-95a4-6a9a4ec0a499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:34.310949 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c2e4f-5a08-4b1c-95a4-6a9a4ec0a499 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:34.311235 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c2e4f-5a08-4b1c-95a4-6a9a4ec0a499 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:34.311513 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c2e4f-5a08-4b1c-95a4-6a9a4ec0a499 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:34.312208 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c2e4f-5a08-4b1c-95a4-6a9a4ec0a499 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:55:34.312513 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c2e4f-5a08-4b1c-95a4-6a9a4ec0a499 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:34.314107 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c2e4f-5a08-4b1c-95a4-6a9a4ec0a499 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:34.325819 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1265/2528] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:55:34.330005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65a553-0fc7-4304-bce1-cb23d1d8bd57 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:34.340034 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65a553-0fc7-4304-bce1-cb23d1d8bd57 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:34.344681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553541a-39c9-435b-9080-2128c1e71fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:34.345283 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553541a-39c9-435b-9080-2128c1e71fff admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:34.345567 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553541a-39c9-435b-9080-2128c1e71fff admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:34.345844 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d553541a-39c9-435b-9080-2128c1e71fff admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:34.346546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553541a-39c9-435b-9080-2128c1e71fff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:34.348421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d553541a-39c9-435b-9080-2128c1e71fff admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:34.364508 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:34.378334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1264/2529] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:55:34 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:55:34.387478 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c2e4f-5a08-4b1c-95a4-6a9a4ec0a499 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:34.398054 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c2e4f-5a08-4b1c-95a4-6a9a4ec0a499 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:34.444821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:34.458810 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5b1e6-7147-49fe-9b1c-3a897015507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:34.459708 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5b1e6-7147-49fe-9b1c-3a897015507c admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:34.459991 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5b1e6-7147-49fe-9b1c-3a897015507c admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:34.460268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5b1e6-7147-49fe-9b1c-3a897015507c admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:34.460937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5b1e6-7147-49fe-9b1c-3a897015507c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:34.462899 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5b1e6-7147-49fe-9b1c-3a897015507c admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:34.484268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1266/2530] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:55:34 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:55:34.488391 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553541a-39c9-435b-9080-2128c1e71fff admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:34.498676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d553541a-39c9-435b-9080-2128c1e71fff admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:34.503284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f8a0b-28c9-47ab-9724-89038a9933a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:34.503927 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f8a0b-28c9-47ab-9724-89038a9933a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:34.504211 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f8a0b-28c9-47ab-9724-89038a9933a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:34.504492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f8a0b-28c9-47ab-9724-89038a9933a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:34.505192 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f8a0b-28c9-47ab-9724-89038a9933a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:34.506833 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f8a0b-28c9-47ab-9724-89038a9933a4 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:34.516661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1265/2531] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:55:34.520401 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5b1e6-7147-49fe-9b1c-3a897015507c admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:34.530550 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5b1e6-7147-49fe-9b1c-3a897015507c admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:34.535133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0a140-1731-4eb6-8283-be411c9d68d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:34.535734 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a140-1731-4eb6-8283-be411c9d68d0 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:34.536018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a140-1731-4eb6-8283-be411c9d68d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:34.536298 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a140-1731-4eb6-8283-be411c9d68d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:34.536988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0a140-1731-4eb6-8283-be411c9d68d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:34.538598 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0a140-1731-4eb6-8283-be411c9d68d0 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:34.549476 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1267/2532] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:55:34.553325 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f8a0b-28c9-47ab-9724-89038a9933a4 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:34.563933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f8a0b-28c9-47ab-9724-89038a9933a4 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:34.568565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b54f6-b4b6-4c2d-9fb0-b8b01f0f6cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:34.569225 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b54f6-b4b6-4c2d-9fb0-b8b01f0f6cb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:34.569514 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b54f6-b4b6-4c2d-9fb0-b8b01f0f6cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:34.569790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b54f6-b4b6-4c2d-9fb0-b8b01f0f6cb6 admin admin] PATH_INFO: `/v3/projects/5b5a8fc8804f4e7c81e80c07fa047334/users/fe5bb617a08b43e3a7abd4c8dd5131be/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:34.585818 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b54f6-b4b6-4c2d-9fb0-b8b01f0f6cb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b5a8fc8804f4e7c81e80c07fa047334, user_id=fe5bb617a08b43e3a7abd4c8dd5131be, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:34.588481 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b54f6-b4b6-4c2d-9fb0-b8b01f0f6cb6 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:34.601061 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1266/2533] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:55:34 2022] PUT /identity/v3/projects/5b5a8fc8804f4e7c81e80c07fa047334/users/fe5bb617a08b43e3a7abd4c8dd5131be/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:55:34.611885 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c9729-8dc1-48c6-8d45-29eb48a68615 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:34.612170 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c9729-8dc1-48c6-8d45-29eb48a68615 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:34.612445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4c9729-8dc1-48c6-8d45-29eb48a68615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:34.639708 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-6e4c9729-8dc1-48c6-8d45-29eb48a68615 None None] MFA Rules not processed for user `fe5bb617a08b43e3a7abd4c8dd5131be`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:55:34.640895 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6e4c9729-8dc1-48c6-8d45-29eb48a68615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:34.714014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1268/2534] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:55:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:55:34.725225 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b54f6-b4b6-4c2d-9fb0-b8b01f0f6cb6 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:34.726989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a83b54f6-b4b6-4c2d-9fb0-b8b01f0f6cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:34.798779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b54f6-b4b6-4c2d-9fb0-b8b01f0f6cb6 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:34.804309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf3d66-ef96-44bd-b678-c67942720730 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:34.804925 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf3d66-ef96-44bd-b678-c67942720730 service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:34.805211 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf3d66-ef96-44bd-b678-c67942720730 service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:34.805497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf3d66-ef96-44bd-b678-c67942720730 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:34.813798 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf3d66-ef96-44bd-b678-c67942720730 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:34.815424 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf3d66-ef96-44bd-b678-c67942720730 service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:34.824137 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1267/2535] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:55:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:55:37.490591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c9729-8dc1-48c6-8d45-29eb48a68615 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:37.549733 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4c9729-8dc1-48c6-8d45-29eb48a68615 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:37.554244 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed475893-efe7-4f93-95c0-0f66ed31f58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:37.554919 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed475893-efe7-4f93-95c0-0f66ed31f58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:37.555206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed475893-efe7-4f93-95c0-0f66ed31f58d admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:37.555488 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed475893-efe7-4f93-95c0-0f66ed31f58d admin admin] PATH_INFO: `/v3/users/fe5bb617a08b43e3a7abd4c8dd5131be` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:37.556654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed475893-efe7-4f93-95c0-0f66ed31f58d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe5bb617a08b43e3a7abd4c8dd5131be)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:37.559089 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed475893-efe7-4f93-95c0-0f66ed31f58d admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:37.606466 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ed475893-efe7-4f93-95c0-0f66ed31f58d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe5bb617a08b43e3a7abd4c8dd5131be'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:37.607137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ed475893-efe7-4f93-95c0-0f66ed31f58d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe5bb617a08b43e3a7abd4c8dd5131be'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:37.614406 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:37.621590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ed475893-efe7-4f93-95c0-0f66ed31f58d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe5bb617a08b43e3a7abd4c8dd5131be'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:37.629965 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ed475893-efe7-4f93-95c0-0f66ed31f58d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe5bb617a08b43e3a7abd4c8dd5131be'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:37.637892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ed475893-efe7-4f93-95c0-0f66ed31f58d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe5bb617a08b43e3a7abd4c8dd5131be'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:37.643908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1269/2536] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:55:37 2022] DELETE /identity/v3/users/fe5bb617a08b43e3a7abd4c8dd5131be => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:55:37.648522 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec221533-68b0-4da1-b11a-f82993a49463 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:37.649009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec221533-68b0-4da1-b11a-f82993a49463 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:37.649114 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec221533-68b0-4da1-b11a-f82993a49463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:37.673996 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-ec221533-68b0-4da1-b11a-f82993a49463 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:55:37.675248 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ec221533-68b0-4da1-b11a-f82993a49463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:37.734802 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1268/2537] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:55:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:55:37.744520 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed475893-efe7-4f93-95c0-0f66ed31f58d admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:37.746476 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ed475893-efe7-4f93-95c0-0f66ed31f58d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:37.804340 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed475893-efe7-4f93-95c0-0f66ed31f58d admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:37.808674 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6f4e5-a8a6-4ddf-86b4-538cd9803820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:37.809284 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6f4e5-a8a6-4ddf-86b4-538cd9803820 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:37.809567 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6f4e5-a8a6-4ddf-86b4-538cd9803820 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:37.809842 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6f4e5-a8a6-4ddf-86b4-538cd9803820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:37.818981 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6f4e5-a8a6-4ddf-86b4-538cd9803820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:37.820405 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6f4e5-a8a6-4ddf-86b4-538cd9803820 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:37.829657 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1270/2538] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:55:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:55:38.098131 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec221533-68b0-4da1-b11a-f82993a49463 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:38.099604 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ec221533-68b0-4da1-b11a-f82993a49463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:38.111729 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec221533-68b0-4da1-b11a-f82993a49463 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:38.116323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431fe35e-19cd-4925-946b-35ec6a7ff242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:38.116958 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fe35e-19cd-4925-946b-35ec6a7ff242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:38.117245 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fe35e-19cd-4925-946b-35ec6a7ff242 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:38.117525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431fe35e-19cd-4925-946b-35ec6a7ff242 admin admin] PATH_INFO: `/v3/projects/5b5a8fc8804f4e7c81e80c07fa047334` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:38.118719 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fe35e-19cd-4925-946b-35ec6a7ff242 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b5a8fc8804f4e7c81e80c07fa047334)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:38.121223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431fe35e-19cd-4925-946b-35ec6a7ff242 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:38.164043 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:38.171500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-431fe35e-19cd-4925-946b-35ec6a7ff242 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b5a8fc8804f4e7c81e80c07fa047334', 'request_id': 'req-431fe35e-19cd-4925-946b-35ec6a7ff242'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:38.177831 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-431fe35e-19cd-4925-946b-35ec6a7ff242 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b5a8fc8804f4e7c81e80c07fa047334', 'request_id': 'req-431fe35e-19cd-4925-946b-35ec6a7ff242'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:38.184099 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-431fe35e-19cd-4925-946b-35ec6a7ff242 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b5a8fc8804f4e7c81e80c07fa047334', 'request_id': 'req-431fe35e-19cd-4925-946b-35ec6a7ff242'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:38.195901 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-431fe35e-19cd-4925-946b-35ec6a7ff242 admin admin] The token cache is being invalidate because project 5b5a8fc8804f4e7c81e80c07fa047334 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:55:38.196188 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-431fe35e-19cd-4925-946b-35ec6a7ff242 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:38.196800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-431fe35e-19cd-4925-946b-35ec6a7ff242 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:38.199466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1269/2539] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:55:38 2022] DELETE /identity/v3/projects/5b5a8fc8804f4e7c81e80c07fa047334 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:55:38.204498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd7b35-f51f-4002-bd05-95f018b76193 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:38.204866 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd7b35-f51f-4002-bd05-95f018b76193 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:38.205156 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd7b35-f51f-4002-bd05-95f018b76193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:38.227334 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-5dfd7b35-f51f-4002-bd05-95f018b76193 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:55:38.228466 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-5dfd7b35-f51f-4002-bd05-95f018b76193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:38.286829 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1271/2540] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:55:38.296497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48f52c-b28e-4224-9c6a-fb2b303f3a4d None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:38.296784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48f52c-b28e-4224-9c6a-fb2b303f3a4d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:38.297058 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e48f52c-b28e-4224-9c6a-fb2b303f3a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:38.316177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-3e48f52c-b28e-4224-9c6a-fb2b303f3a4d None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:55:38.317363 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-3e48f52c-b28e-4224-9c6a-fb2b303f3a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:38.325685 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1270/2541] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:55:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:55:38.329796 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd7b35-f51f-4002-bd05-95f018b76193 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:38.340280 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd7b35-f51f-4002-bd05-95f018b76193 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:38.344831 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cd257-13b8-4943-a0c0-95f877fc06be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:38.345441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cd257-13b8-4943-a0c0-95f877fc06be admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:38.345727 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cd257-13b8-4943-a0c0-95f877fc06be admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:38.346008 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cd257-13b8-4943-a0c0-95f877fc06be admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:38.346743 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cd257-13b8-4943-a0c0-95f877fc06be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:55:38.347054 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cd257-13b8-4943-a0c0-95f877fc06be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:38.348642 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cd257-13b8-4943-a0c0-95f877fc06be admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:38.360462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1272/2542] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:55:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 22:55:38.364540 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48f52c-b28e-4224-9c6a-fb2b303f3a4d None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:38.373475 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e48f52c-b28e-4224-9c6a-fb2b303f3a4d None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:38.378043 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c98de-097a-4b65-895d-af10148dcdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:38.378659 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c98de-097a-4b65-895d-af10148dcdad admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:38.378939 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c98de-097a-4b65-895d-af10148dcdad admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:38.379211 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c98de-097a-4b65-895d-af10148dcdad admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:38.379864 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c98de-097a-4b65-895d-af10148dcdad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:38.381756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c98de-097a-4b65-895d-af10148dcdad admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:38.409600 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1271/2543] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:55:38 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:55:38.413739 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cd257-13b8-4943-a0c0-95f877fc06be admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:38.423389 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cd257-13b8-4943-a0c0-95f877fc06be admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:38.479784 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e468ee-ea63-41a8-ad18-a0b8341e870d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:38.480325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e468ee-ea63-41a8-ad18-a0b8341e870d admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:38.480609 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e468ee-ea63-41a8-ad18-a0b8341e870d admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:38.480889 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e468ee-ea63-41a8-ad18-a0b8341e870d admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:38.481561 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e468ee-ea63-41a8-ad18-a0b8341e870d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:38.483496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e468ee-ea63-41a8-ad18-a0b8341e870d admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:38.493148 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:38.505631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1273/2544] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:55:38 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:55:38.509889 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c98de-097a-4b65-895d-af10148dcdad admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:38.520367 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c98de-097a-4b65-895d-af10148dcdad admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:38.524944 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea999a23-fdee-4f99-a722-e2867d677e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:38.525545 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea999a23-fdee-4f99-a722-e2867d677e8e admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:38.525822 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea999a23-fdee-4f99-a722-e2867d677e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:38.526097 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea999a23-fdee-4f99-a722-e2867d677e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:38.527420 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea999a23-fdee-4f99-a722-e2867d677e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:38.528998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea999a23-fdee-4f99-a722-e2867d677e8e admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:38.538619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1272/2545] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:55:38.542391 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e468ee-ea63-41a8-ad18-a0b8341e870d admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:38.552158 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e468ee-ea63-41a8-ad18-a0b8341e870d admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:38.556731 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88174ad-3ef9-419d-bffc-597c85b95f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:38.557330 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88174ad-3ef9-419d-bffc-597c85b95f46 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:38.557613 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88174ad-3ef9-419d-bffc-597c85b95f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:38.557888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88174ad-3ef9-419d-bffc-597c85b95f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:38.558611 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88174ad-3ef9-419d-bffc-597c85b95f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:38.560182 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88174ad-3ef9-419d-bffc-597c85b95f46 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:38.570475 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1274/2546] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:55:38.574972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea999a23-fdee-4f99-a722-e2867d677e8e admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:38.585624 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea999a23-fdee-4f99-a722-e2867d677e8e admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:38.590858 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fe1cf-151c-4a48-bf04-c59f9e06e20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:38.591514 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fe1cf-151c-4a48-bf04-c59f9e06e20f admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:38.591798 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fe1cf-151c-4a48-bf04-c59f9e06e20f admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:38.592105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319fe1cf-151c-4a48-bf04-c59f9e06e20f admin admin] PATH_INFO: `/v3/projects/d8e569453e174d74a3d778e9115c6d98/users/cbcb17817dab4cd7bbfa9bc895e1ad48/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:38.606654 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fe1cf-151c-4a48-bf04-c59f9e06e20f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e569453e174d74a3d778e9115c6d98, user_id=cbcb17817dab4cd7bbfa9bc895e1ad48, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:38.609391 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319fe1cf-151c-4a48-bf04-c59f9e06e20f admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:38.622303 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1273/2547] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:55:38 2022] PUT /identity/v3/projects/d8e569453e174d74a3d778e9115c6d98/users/cbcb17817dab4cd7bbfa9bc895e1ad48/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:55:38.632759 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88fa5f-a286-4f44-b890-157ade0d37ea None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:38.633050 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88fa5f-a286-4f44-b890-157ade0d37ea None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:38.633328 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88fa5f-a286-4f44-b890-157ade0d37ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:38.660710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-7a88fa5f-a286-4f44-b890-157ade0d37ea None None] MFA Rules not processed for user `cbcb17817dab4cd7bbfa9bc895e1ad48`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:55:38.661899 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-7a88fa5f-a286-4f44-b890-157ade0d37ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:38.723815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1275/2548] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:55:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:55:38.728252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fe1cf-151c-4a48-bf04-c59f9e06e20f admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:38.788797 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319fe1cf-151c-4a48-bf04-c59f9e06e20f admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:38.793363 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5ddea-33c9-44a9-9891-9e3bc805761f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:38.793984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5ddea-33c9-44a9-9891-9e3bc805761f admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:38.794267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5ddea-33c9-44a9-9891-9e3bc805761f admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:38.794572 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa5ddea-33c9-44a9-9891-9e3bc805761f admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:38.795234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5ddea-33c9-44a9-9891-9e3bc805761f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:38.797113 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa5ddea-33c9-44a9-9891-9e3bc805761f admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:38.823224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1274/2549] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:55:38 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:55:38.827772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88fa5f-a286-4f44-b890-157ade0d37ea None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:38.838441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88fa5f-a286-4f44-b890-157ade0d37ea None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:38.903619 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dc977-fc1e-4653-8993-6455411b974e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:38.904280 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dc977-fc1e-4653-8993-6455411b974e admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:38.904565 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dc977-fc1e-4653-8993-6455411b974e admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:38.904844 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715dc977-fc1e-4653-8993-6455411b974e admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:38.905539 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715dc977-fc1e-4653-8993-6455411b974e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:38.907484 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715dc977-fc1e-4653-8993-6455411b974e admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:38.928012 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1276/2550] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:55:38 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:55:38.932223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5ddea-33c9-44a9-9891-9e3bc805761f admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:38.942965 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa5ddea-33c9-44a9-9891-9e3bc805761f admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:38.947524 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f635d0-6a89-41ac-af6a-042fc87e4ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:38.948157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f635d0-6a89-41ac-af6a-042fc87e4ada admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:38.949069 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f635d0-6a89-41ac-af6a-042fc87e4ada admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:38.949349 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f635d0-6a89-41ac-af6a-042fc87e4ada admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:38.950041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f635d0-6a89-41ac-af6a-042fc87e4ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:38.951674 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f635d0-6a89-41ac-af6a-042fc87e4ada admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:38.962261 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1275/2551] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:55:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:55:38.966255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dc977-fc1e-4653-8993-6455411b974e admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:38.976280 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715dc977-fc1e-4653-8993-6455411b974e admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:38.980956 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c8bf2-cee8-4774-8c47-0c4a415e3bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:38.981618 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c8bf2-cee8-4774-8c47-0c4a415e3bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:38.981906 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c8bf2-cee8-4774-8c47-0c4a415e3bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:38.982191 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73c8bf2-cee8-4774-8c47-0c4a415e3bdd admin admin] PATH_INFO: `/v3/projects/4a721c8e4c564d7fabf4bf8dc44f52e1/users/921c9bf8626c4373a747d98aeba26356/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:38.997068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c8bf2-cee8-4774-8c47-0c4a415e3bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a721c8e4c564d7fabf4bf8dc44f52e1, user_id=921c9bf8626c4373a747d98aeba26356, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:38.999735 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73c8bf2-cee8-4774-8c47-0c4a415e3bdd admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:39.013096 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1277/2552] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:55:38 2022] PUT /identity/v3/projects/4a721c8e4c564d7fabf4bf8dc44f52e1/users/921c9bf8626c4373a747d98aeba26356/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:55:39.016949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f635d0-6a89-41ac-af6a-042fc87e4ada admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:39.026809 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f635d0-6a89-41ac-af6a-042fc87e4ada admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:39.063391 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:39.083620 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ba52f-be46-457d-8260-e4d274698142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:39.084485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ba52f-be46-457d-8260-e4d274698142 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:39.084769 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ba52f-be46-457d-8260-e4d274698142 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:39.085044 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ba52f-be46-457d-8260-e4d274698142 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:39.085731 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ba52f-be46-457d-8260-e4d274698142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:39.087346 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ba52f-be46-457d-8260-e4d274698142 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:39.096861 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1276/2553] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:55:39.100917 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c8bf2-cee8-4774-8c47-0c4a415e3bdd admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:39.111469 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73c8bf2-cee8-4774-8c47-0c4a415e3bdd admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:39.116012 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc964db-dd83-4d99-a980-7aeffae2d9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:39.116667 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc964db-dd83-4d99-a980-7aeffae2d9d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:39.116952 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc964db-dd83-4d99-a980-7aeffae2d9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:39.117232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc964db-dd83-4d99-a980-7aeffae2d9d8 admin admin] PATH_INFO: `/v3/projects/4a721c8e4c564d7fabf4bf8dc44f52e1/users/921c9bf8626c4373a747d98aeba26356/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:39.119201 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc964db-dd83-4d99-a980-7aeffae2d9d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a721c8e4c564d7fabf4bf8dc44f52e1, user_id=921c9bf8626c4373a747d98aeba26356, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:39.122460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc964db-dd83-4d99-a980-7aeffae2d9d8 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:39.132695 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1278/2554] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:55:39 2022] PUT /identity/v3/projects/4a721c8e4c564d7fabf4bf8dc44f52e1/users/921c9bf8626c4373a747d98aeba26356/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:55:39.142786 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a9cdf-4b61-4f4a-b479-2438e39e047b None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:39.143082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a9cdf-4b61-4f4a-b479-2438e39e047b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:39.143367 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a9cdf-4b61-4f4a-b479-2438e39e047b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:39.172172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-3e8a9cdf-4b61-4f4a-b479-2438e39e047b None None] MFA Rules not processed for user `921c9bf8626c4373a747d98aeba26356`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:55:39.173367 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-3e8a9cdf-4b61-4f4a-b479-2438e39e047b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:39.238656 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1277/2555] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:55:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:55:39.251935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc964db-dd83-4d99-a980-7aeffae2d9d8 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:39.253691 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-cfc964db-dd83-4d99-a980-7aeffae2d9d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:39.282377 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:39.313708 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc964db-dd83-4d99-a980-7aeffae2d9d8 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:39.317337 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb6b4c-ca65-4982-a171-c72f5f882b3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:39.317950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb6b4c-ca65-4982-a171-c72f5f882b3e service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:39.318236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb6b4c-ca65-4982-a171-c72f5f882b3e service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:39.318549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb6b4c-ca65-4982-a171-c72f5f882b3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:39.327742 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb6b4c-ca65-4982-a171-c72f5f882b3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:39.329159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb6b4c-ca65-4982-a171-c72f5f882b3e service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:39.338772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1279/2556] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:55:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:55:39.411799 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a9cdf-4b61-4f4a-b479-2438e39e047b None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:39.421907 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a9cdf-4b61-4f4a-b479-2438e39e047b None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:39.425541 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24a04e-96c8-4ede-83f3-3a0cd10d52c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:39.426148 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24a04e-96c8-4ede-83f3-3a0cd10d52c5 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:39.426466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24a04e-96c8-4ede-83f3-3a0cd10d52c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:39.426743 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24a04e-96c8-4ede-83f3-3a0cd10d52c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:39.483363 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24a04e-96c8-4ede-83f3-3a0cd10d52c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:39.484786 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24a04e-96c8-4ede-83f3-3a0cd10d52c5 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:39.493688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1278/2557] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:55:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:55:46.271788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb6b4c-ca65-4982-a171-c72f5f882b3e service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:46.332646 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb6b4c-ca65-4982-a171-c72f5f882b3e service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:46.337383 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dabea6-a830-4285-b687-4dbc40ec7396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:46.338014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dabea6-a830-4285-b687-4dbc40ec7396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:46.338294 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dabea6-a830-4285-b687-4dbc40ec7396 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:46.338597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dabea6-a830-4285-b687-4dbc40ec7396 admin admin] PATH_INFO: `/v3/users/cbcb17817dab4cd7bbfa9bc895e1ad48` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:46.339729 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dabea6-a830-4285-b687-4dbc40ec7396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbcb17817dab4cd7bbfa9bc895e1ad48)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:46.341610 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dabea6-a830-4285-b687-4dbc40ec7396 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:46.385791 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-08dabea6-a830-4285-b687-4dbc40ec7396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbcb17817dab4cd7bbfa9bc895e1ad48'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:46.386468 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-08dabea6-a830-4285-b687-4dbc40ec7396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbcb17817dab4cd7bbfa9bc895e1ad48'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:46.398786 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-08dabea6-a830-4285-b687-4dbc40ec7396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbcb17817dab4cd7bbfa9bc895e1ad48'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:46.405551 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-08dabea6-a830-4285-b687-4dbc40ec7396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbcb17817dab4cd7bbfa9bc895e1ad48'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:46.412671 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-08dabea6-a830-4285-b687-4dbc40ec7396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbcb17817dab4cd7bbfa9bc895e1ad48'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:46.418741 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1280/2558] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:55:46 2022] DELETE /identity/v3/users/cbcb17817dab4cd7bbfa9bc895e1ad48 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:55:46.423266 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cbd38-8579-43e5-b37a-f876c99966c3 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:46.423750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cbd38-8579-43e5-b37a-f876c99966c3 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:46.423860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cbd38-8579-43e5-b37a-f876c99966c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:46.443515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-bb7cbd38-8579-43e5-b37a-f876c99966c3 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:55:46.444695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-bb7cbd38-8579-43e5-b37a-f876c99966c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:46.493610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=100 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:46.502659 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1279/2559] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:55:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:55:46.512915 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dabea6-a830-4285-b687-4dbc40ec7396 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:46.514434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-08dabea6-a830-4285-b687-4dbc40ec7396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:46.567233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:46.573389 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dabea6-a830-4285-b687-4dbc40ec7396 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:46.578510 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565f683-237d-441b-9e32-6f2331d5db42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:46.579134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565f683-237d-441b-9e32-6f2331d5db42 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:46.579416 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565f683-237d-441b-9e32-6f2331d5db42 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:46.579709 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1565f683-237d-441b-9e32-6f2331d5db42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:46.589148 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565f683-237d-441b-9e32-6f2331d5db42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:46.590621 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1565f683-237d-441b-9e32-6f2331d5db42 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:46.599828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1281/2560] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:55:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:55:46.860554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cbd38-8579-43e5-b37a-f876c99966c3 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:46.862166 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-bb7cbd38-8579-43e5-b37a-f876c99966c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:46.875006 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cbd38-8579-43e5-b37a-f876c99966c3 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:46.880263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746031eb-9bda-44ed-8f81-b4298da99bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:46.880927 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746031eb-9bda-44ed-8f81-b4298da99bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:46.881215 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746031eb-9bda-44ed-8f81-b4298da99bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:46.881500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746031eb-9bda-44ed-8f81-b4298da99bc3 admin admin] PATH_INFO: `/v3/projects/d8e569453e174d74a3d778e9115c6d98` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:46.882718 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746031eb-9bda-44ed-8f81-b4298da99bc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8e569453e174d74a3d778e9115c6d98)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:46.884675 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746031eb-9bda-44ed-8f81-b4298da99bc3 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:46.930567 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-746031eb-9bda-44ed-8f81-b4298da99bc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8e569453e174d74a3d778e9115c6d98', 'request_id': 'req-746031eb-9bda-44ed-8f81-b4298da99bc3'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:46.937130 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-746031eb-9bda-44ed-8f81-b4298da99bc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8e569453e174d74a3d778e9115c6d98', 'request_id': 'req-746031eb-9bda-44ed-8f81-b4298da99bc3'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:46.942807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-746031eb-9bda-44ed-8f81-b4298da99bc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8e569453e174d74a3d778e9115c6d98', 'request_id': 'req-746031eb-9bda-44ed-8f81-b4298da99bc3'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:46.954311 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-746031eb-9bda-44ed-8f81-b4298da99bc3 admin admin] The token cache is being invalidate because project d8e569453e174d74a3d778e9115c6d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:55:46.954651 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-746031eb-9bda-44ed-8f81-b4298da99bc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:46.955273 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-746031eb-9bda-44ed-8f81-b4298da99bc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:46.956784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1280/2561] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:55:46 2022] DELETE /identity/v3/projects/d8e569453e174d74a3d778e9115c6d98 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:55:46.960979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565f683-237d-441b-9e32-6f2331d5db42 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:46.970847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1565f683-237d-441b-9e32-6f2331d5db42 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:47.024778 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9274d9-7304-4212-9ace-73d1a6371ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:47.025418 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9274d9-7304-4212-9ace-73d1a6371ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:47.025706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9274d9-7304-4212-9ace-73d1a6371ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:47.025986 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9274d9-7304-4212-9ace-73d1a6371ea9 admin admin] PATH_INFO: `/v3/users/921c9bf8626c4373a747d98aeba26356` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:47.027178 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9274d9-7304-4212-9ace-73d1a6371ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=921c9bf8626c4373a747d98aeba26356)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:47.029698 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9274d9-7304-4212-9ace-73d1a6371ea9 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:47.073353 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-3d9274d9-7304-4212-9ace-73d1a6371ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '921c9bf8626c4373a747d98aeba26356'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:47.074007 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-3d9274d9-7304-4212-9ace-73d1a6371ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '921c9bf8626c4373a747d98aeba26356'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:47.085894 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-3d9274d9-7304-4212-9ace-73d1a6371ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '921c9bf8626c4373a747d98aeba26356'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:47.093117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-3d9274d9-7304-4212-9ace-73d1a6371ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '921c9bf8626c4373a747d98aeba26356'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:47.100022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-3d9274d9-7304-4212-9ace-73d1a6371ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '921c9bf8626c4373a747d98aeba26356'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:47.106262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1282/2562] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:55:46 2022] DELETE /identity/v3/users/921c9bf8626c4373a747d98aeba26356 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:55:47.372132 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746031eb-9bda-44ed-8f81-b4298da99bc3 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:47.373586 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-746031eb-9bda-44ed-8f81-b4298da99bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:47.388635 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746031eb-9bda-44ed-8f81-b4298da99bc3 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:47.445363 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f143a2-b03f-4de1-8d6e-ca0558871b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:47.445994 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f143a2-b03f-4de1-8d6e-ca0558871b09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:47.446282 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f143a2-b03f-4de1-8d6e-ca0558871b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:47.446595 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f143a2-b03f-4de1-8d6e-ca0558871b09 admin admin] PATH_INFO: `/v3/projects/4a721c8e4c564d7fabf4bf8dc44f52e1` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:47.447760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f143a2-b03f-4de1-8d6e-ca0558871b09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a721c8e4c564d7fabf4bf8dc44f52e1)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:47.450239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f143a2-b03f-4de1-8d6e-ca0558871b09 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:47.496009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d0f143a2-b03f-4de1-8d6e-ca0558871b09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a721c8e4c564d7fabf4bf8dc44f52e1', 'request_id': 'req-d0f143a2-b03f-4de1-8d6e-ca0558871b09'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:47.501972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d0f143a2-b03f-4de1-8d6e-ca0558871b09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a721c8e4c564d7fabf4bf8dc44f52e1', 'request_id': 'req-d0f143a2-b03f-4de1-8d6e-ca0558871b09'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:47.507441 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d0f143a2-b03f-4de1-8d6e-ca0558871b09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a721c8e4c564d7fabf4bf8dc44f52e1', 'request_id': 'req-d0f143a2-b03f-4de1-8d6e-ca0558871b09'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:47.519961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d0f143a2-b03f-4de1-8d6e-ca0558871b09 admin admin] The token cache is being invalidate because project 4a721c8e4c564d7fabf4bf8dc44f52e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:55:47.520253 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d0f143a2-b03f-4de1-8d6e-ca0558871b09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:47.520876 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-d0f143a2-b03f-4de1-8d6e-ca0558871b09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:47.522417 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1281/2563] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:55:47 2022] DELETE /identity/v3/projects/4a721c8e4c564d7fabf4bf8dc44f52e1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:55:47.527363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305f030-c59f-4716-a1af-b853f267ecdc None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:47.528388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305f030-c59f-4716-a1af-b853f267ecdc None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:47.528558 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1305f030-c59f-4716-a1af-b853f267ecdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:47.547737 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-1305f030-c59f-4716-a1af-b853f267ecdc None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:55:47.548933 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-1305f030-c59f-4716-a1af-b853f267ecdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:47.607751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1283/2564] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:55:47.616451 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1789cf7-600b-493f-a82b-9bad9d817369 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:47.616747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1789cf7-600b-493f-a82b-9bad9d817369 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:47.617032 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1789cf7-600b-493f-a82b-9bad9d817369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:47.636482 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-a1789cf7-600b-493f-a82b-9bad9d817369 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:55:47.638167 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a1789cf7-600b-493f-a82b-9bad9d817369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:47.646086 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1282/2565] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:55:47.650085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305f030-c59f-4716-a1af-b853f267ecdc None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:47.660520 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1305f030-c59f-4716-a1af-b853f267ecdc None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:47.665139 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cecd7-dd8f-4477-a843-18e699ca7ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:47.665925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cecd7-dd8f-4477-a843-18e699ca7ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:47.666216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cecd7-dd8f-4477-a843-18e699ca7ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:47.666532 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4cecd7-dd8f-4477-a843-18e699ca7ff8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:47.667265 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cecd7-dd8f-4477-a843-18e699ca7ff8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:55:47.667579 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cecd7-dd8f-4477-a843-18e699ca7ff8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:47.669306 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4cecd7-dd8f-4477-a843-18e699ca7ff8 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:47.671747 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:47.683085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1284/2566] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:55:47.688005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1789cf7-600b-493f-a82b-9bad9d817369 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:47.698794 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1789cf7-600b-493f-a82b-9bad9d817369 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:47.704099 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdd747-b9b7-4a0a-b00f-527f4b99a987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:47.704652 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdd747-b9b7-4a0a-b00f-527f4b99a987 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:47.704939 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdd747-b9b7-4a0a-b00f-527f4b99a987 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:47.705219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcdd747-b9b7-4a0a-b00f-527f4b99a987 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:47.705894 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcdd747-b9b7-4a0a-b00f-527f4b99a987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:47.707892 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcdd747-b9b7-4a0a-b00f-527f4b99a987 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:47.712692 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:47.736811 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1283/2567] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:55:47 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:55:47.740956 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cecd7-dd8f-4477-a843-18e699ca7ff8 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:47.751438 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4cecd7-dd8f-4477-a843-18e699ca7ff8 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:47.806956 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed8984-2f2a-4510-8971-6a034689f2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:47.807558 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed8984-2f2a-4510-8971-6a034689f2de admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:47.807841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed8984-2f2a-4510-8971-6a034689f2de admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:47.808117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed8984-2f2a-4510-8971-6a034689f2de admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:47.810867 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed8984-2f2a-4510-8971-6a034689f2de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:47.812815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed8984-2f2a-4510-8971-6a034689f2de admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:47.851605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1285/2568] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:55:47 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:55:47.855834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdd747-b9b7-4a0a-b00f-527f4b99a987 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:47.865965 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcdd747-b9b7-4a0a-b00f-527f4b99a987 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:47.870576 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e48d8c-e9cd-4bed-aa94-6ad0ef4c3d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:47.871181 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e48d8c-e9cd-4bed-aa94-6ad0ef4c3d5d admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:47.871953 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e48d8c-e9cd-4bed-aa94-6ad0ef4c3d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:47.872227 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e48d8c-e9cd-4bed-aa94-6ad0ef4c3d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:47.872916 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e48d8c-e9cd-4bed-aa94-6ad0ef4c3d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:47.874560 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e48d8c-e9cd-4bed-aa94-6ad0ef4c3d5d admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:47.884334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1284/2569] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:55:47.889054 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed8984-2f2a-4510-8971-6a034689f2de admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:47.899013 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed8984-2f2a-4510-8971-6a034689f2de admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:47.903685 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66262c67-0b41-442b-8f8c-8d0f64073161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:47.904302 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66262c67-0b41-442b-8f8c-8d0f64073161 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:47.904588 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66262c67-0b41-442b-8f8c-8d0f64073161 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:47.904867 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66262c67-0b41-442b-8f8c-8d0f64073161 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:47.905558 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66262c67-0b41-442b-8f8c-8d0f64073161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:47.907174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66262c67-0b41-442b-8f8c-8d0f64073161 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:47.917600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1286/2570] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:55:47.921646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e48d8c-e9cd-4bed-aa94-6ad0ef4c3d5d admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:47.931442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e48d8c-e9cd-4bed-aa94-6ad0ef4c3d5d admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:47.936500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a790b-adfa-4a30-9780-2ee9dda6e18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:47.937146 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a790b-adfa-4a30-9780-2ee9dda6e18c admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:47.937425 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a790b-adfa-4a30-9780-2ee9dda6e18c admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:47.937699 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a790b-adfa-4a30-9780-2ee9dda6e18c admin admin] PATH_INFO: `/v3/projects/8f7c854c737f4e2fa8fe3af5a7293e00/users/f04356b6e5f746c89ee153fb2bdc5a80/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:47.952295 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a790b-adfa-4a30-9780-2ee9dda6e18c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7c854c737f4e2fa8fe3af5a7293e00, user_id=f04356b6e5f746c89ee153fb2bdc5a80, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:47.955004 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a790b-adfa-4a30-9780-2ee9dda6e18c admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:47.968605 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1285/2571] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:55:47 2022] PUT /identity/v3/projects/8f7c854c737f4e2fa8fe3af5a7293e00/users/f04356b6e5f746c89ee153fb2bdc5a80/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:55:47.979379 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885d5f5-ca3f-49a2-81f1-4448d69ca454 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:47.979671 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885d5f5-ca3f-49a2-81f1-4448d69ca454 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:47.979959 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885d5f5-ca3f-49a2-81f1-4448d69ca454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:48.007468 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-7885d5f5-ca3f-49a2-81f1-4448d69ca454 None None] MFA Rules not processed for user `f04356b6e5f746c89ee153fb2bdc5a80`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:55:48.008716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-7885d5f5-ca3f-49a2-81f1-4448d69ca454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:48.070881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1287/2572] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:55:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:55:48.075361 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a790b-adfa-4a30-9780-2ee9dda6e18c admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:48.135577 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a790b-adfa-4a30-9780-2ee9dda6e18c admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:48.140554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b23307-cd02-4cd7-a79d-e6a280a2c2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:48.141172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b23307-cd02-4cd7-a79d-e6a280a2c2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:48.141463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b23307-cd02-4cd7-a79d-e6a280a2c2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:48.141743 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b23307-cd02-4cd7-a79d-e6a280a2c2a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:48.142442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b23307-cd02-4cd7-a79d-e6a280a2c2a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:48.144386 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b23307-cd02-4cd7-a79d-e6a280a2c2a0 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:48.175077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1286/2573] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:55:48 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:55:48.176975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885d5f5-ca3f-49a2-81f1-4448d69ca454 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:48.189409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885d5f5-ca3f-49a2-81f1-4448d69ca454 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:48.247831 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d23b52-2ca3-4a67-ad7e-95434a131749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:48.248371 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d23b52-2ca3-4a67-ad7e-95434a131749 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:48.248661 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d23b52-2ca3-4a67-ad7e-95434a131749 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:48.248948 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d23b52-2ca3-4a67-ad7e-95434a131749 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:48.249613 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d23b52-2ca3-4a67-ad7e-95434a131749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:48.251567 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d23b52-2ca3-4a67-ad7e-95434a131749 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:48.261371 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:48.273231 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1288/2574] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:55:48 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:55:48.277398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b23307-cd02-4cd7-a79d-e6a280a2c2a0 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:48.288049 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b23307-cd02-4cd7-a79d-e6a280a2c2a0 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:48.292732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c17b15-e9b1-4f4f-ba9e-9d373f554613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:48.293853 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c17b15-e9b1-4f4f-ba9e-9d373f554613 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:48.294140 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c17b15-e9b1-4f4f-ba9e-9d373f554613 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:48.294452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c17b15-e9b1-4f4f-ba9e-9d373f554613 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:48.295153 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c17b15-e9b1-4f4f-ba9e-9d373f554613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:48.296750 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c17b15-e9b1-4f4f-ba9e-9d373f554613 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:48.307181 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1287/2575] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:55:48.311814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d23b52-2ca3-4a67-ad7e-95434a131749 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:48.321562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d23b52-2ca3-4a67-ad7e-95434a131749 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:48.326176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473da08b-0344-4dce-a6fe-66c12067ef47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:48.326865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473da08b-0344-4dce-a6fe-66c12067ef47 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:48.327153 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473da08b-0344-4dce-a6fe-66c12067ef47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:48.327434 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473da08b-0344-4dce-a6fe-66c12067ef47 admin admin] PATH_INFO: `/v3/projects/f78e3a0d45944671b6782387fafd8bbb/users/e3b8261e19804274bed8ca7a548fe2eb/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:48.341912 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473da08b-0344-4dce-a6fe-66c12067ef47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78e3a0d45944671b6782387fafd8bbb, user_id=e3b8261e19804274bed8ca7a548fe2eb, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:48.344576 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473da08b-0344-4dce-a6fe-66c12067ef47 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:48.358840 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1289/2576] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:55:48 2022] PUT /identity/v3/projects/f78e3a0d45944671b6782387fafd8bbb/users/e3b8261e19804274bed8ca7a548fe2eb/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:55:48.362676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c17b15-e9b1-4f4f-ba9e-9d373f554613 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:48.373449 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c17b15-e9b1-4f4f-ba9e-9d373f554613 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:48.428130 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8527ec1-c5d5-4297-8c9e-ba7716b8bcac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:48.428753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8527ec1-c5d5-4297-8c9e-ba7716b8bcac admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:48.429041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8527ec1-c5d5-4297-8c9e-ba7716b8bcac admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:48.429323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8527ec1-c5d5-4297-8c9e-ba7716b8bcac admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:48.430022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8527ec1-c5d5-4297-8c9e-ba7716b8bcac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:48.431690 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8527ec1-c5d5-4297-8c9e-ba7716b8bcac admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:48.442328 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1288/2577] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:55:48.446395 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473da08b-0344-4dce-a6fe-66c12067ef47 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:48.456397 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473da08b-0344-4dce-a6fe-66c12067ef47 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:48.461202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc347d-e15d-453f-9b24-8bde53566a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:48.461862 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc347d-e15d-453f-9b24-8bde53566a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:48.462144 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc347d-e15d-453f-9b24-8bde53566a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:48.462447 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc347d-e15d-453f-9b24-8bde53566a5d admin admin] PATH_INFO: `/v3/projects/f78e3a0d45944671b6782387fafd8bbb/users/e3b8261e19804274bed8ca7a548fe2eb/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:48.464368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc347d-e15d-453f-9b24-8bde53566a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f78e3a0d45944671b6782387fafd8bbb, user_id=e3b8261e19804274bed8ca7a548fe2eb, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:48.467495 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc347d-e15d-453f-9b24-8bde53566a5d admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:48.479119 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1290/2578] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:55:48 2022] PUT /identity/v3/projects/f78e3a0d45944671b6782387fafd8bbb/users/e3b8261e19804274bed8ca7a548fe2eb/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:55:48.494248 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54b82a-9a5b-4cc3-b87f-9e46f58470f5 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:48.494779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54b82a-9a5b-4cc3-b87f-9e46f58470f5 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:48.494890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54b82a-9a5b-4cc3-b87f-9e46f58470f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:48.521759 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-5b54b82a-9a5b-4cc3-b87f-9e46f58470f5 None None] MFA Rules not processed for user `e3b8261e19804274bed8ca7a548fe2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:55:48.522929 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5b54b82a-9a5b-4cc3-b87f-9e46f58470f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:48.531422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:48.591461 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1289/2579] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:55:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:55:48.602781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc347d-e15d-453f-9b24-8bde53566a5d admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:48.604581 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-87bc347d-e15d-453f-9b24-8bde53566a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:48.661999 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc347d-e15d-453f-9b24-8bde53566a5d admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:48.665685 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182cf61-30ac-4b1d-9b90-c006f62d65dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:48.666293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182cf61-30ac-4b1d-9b90-c006f62d65dc service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:48.666620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182cf61-30ac-4b1d-9b90-c006f62d65dc service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:48.666902 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182cf61-30ac-4b1d-9b90-c006f62d65dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:48.676398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182cf61-30ac-4b1d-9b90-c006f62d65dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:48.677814 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5182cf61-30ac-4b1d-9b90-c006f62d65dc service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:48.687191 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1291/2580] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:55:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:55:48.825791 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54b82a-9a5b-4cc3-b87f-9e46f58470f5 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:48.888681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54b82a-9a5b-4cc3-b87f-9e46f58470f5 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:48.893181 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12115ef-e67f-4f1f-a7b4-7f745a0c3534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:48.893826 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12115ef-e67f-4f1f-a7b4-7f745a0c3534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:48.894114 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12115ef-e67f-4f1f-a7b4-7f745a0c3534 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:48.894435 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12115ef-e67f-4f1f-a7b4-7f745a0c3534 admin admin] PATH_INFO: `/v3/users/f04356b6e5f746c89ee153fb2bdc5a80` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:48.895616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12115ef-e67f-4f1f-a7b4-7f745a0c3534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04356b6e5f746c89ee153fb2bdc5a80)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:48.897625 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12115ef-e67f-4f1f-a7b4-7f745a0c3534 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:48.942526 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c12115ef-e67f-4f1f-a7b4-7f745a0c3534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04356b6e5f746c89ee153fb2bdc5a80'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:48.943164 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c12115ef-e67f-4f1f-a7b4-7f745a0c3534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04356b6e5f746c89ee153fb2bdc5a80'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:48.950583 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c12115ef-e67f-4f1f-a7b4-7f745a0c3534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04356b6e5f746c89ee153fb2bdc5a80'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:48.962680 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c12115ef-e67f-4f1f-a7b4-7f745a0c3534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04356b6e5f746c89ee153fb2bdc5a80'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:48.963342 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c12115ef-e67f-4f1f-a7b4-7f745a0c3534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04356b6e5f746c89ee153fb2bdc5a80'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:48.976263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1290/2581] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:55:48 2022] DELETE /identity/v3/users/f04356b6e5f746c89ee153fb2bdc5a80 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:55:48.980917 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ec5b1-b1d9-4f60-b9d7-e505018075ae None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:48.981206 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ec5b1-b1d9-4f60-b9d7-e505018075ae None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:48.981484 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ec5b1-b1d9-4f60-b9d7-e505018075ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:48.999985 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-e49ec5b1-b1d9-4f60-b9d7-e505018075ae None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:55:49.001208 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e49ec5b1-b1d9-4f60-b9d7-e505018075ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:49.058308 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1292/2582] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:55:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:55:49.067764 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12115ef-e67f-4f1f-a7b4-7f745a0c3534 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:49.069128 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c12115ef-e67f-4f1f-a7b4-7f745a0c3534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:49.097851 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:49.128504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12115ef-e67f-4f1f-a7b4-7f745a0c3534 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:49.134462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9085f86-4f6d-4f51-95ed-94bc958697d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:49.135744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9085f86-4f6d-4f51-95ed-94bc958697d3 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:49.136237 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9085f86-4f6d-4f51-95ed-94bc958697d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:49.136714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9085f86-4f6d-4f51-95ed-94bc958697d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:49.149079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9085f86-4f6d-4f51-95ed-94bc958697d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:49.151341 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9085f86-4f6d-4f51-95ed-94bc958697d3 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:49.162202 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1291/2583] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:55:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:55:49.422852 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ec5b1-b1d9-4f60-b9d7-e505018075ae None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:49.424425 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e49ec5b1-b1d9-4f60-b9d7-e505018075ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:49.438715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ec5b1-b1d9-4f60-b9d7-e505018075ae None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:49.444329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611a02b-b7ec-47d5-b3ee-368bfdbb15aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:49.445077 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611a02b-b7ec-47d5-b3ee-368bfdbb15aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:49.445595 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611a02b-b7ec-47d5-b3ee-368bfdbb15aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:49.445874 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611a02b-b7ec-47d5-b3ee-368bfdbb15aa admin admin] PATH_INFO: `/v3/projects/8f7c854c737f4e2fa8fe3af5a7293e00` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:49.447091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611a02b-b7ec-47d5-b3ee-368bfdbb15aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f7c854c737f4e2fa8fe3af5a7293e00)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:49.450997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611a02b-b7ec-47d5-b3ee-368bfdbb15aa admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:49.503639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7611a02b-b7ec-47d5-b3ee-368bfdbb15aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f7c854c737f4e2fa8fe3af5a7293e00', 'request_id': 'req-7611a02b-b7ec-47d5-b3ee-368bfdbb15aa'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:49.507369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:49.509855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7611a02b-b7ec-47d5-b3ee-368bfdbb15aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f7c854c737f4e2fa8fe3af5a7293e00', 'request_id': 'req-7611a02b-b7ec-47d5-b3ee-368bfdbb15aa'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:49.518726 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7611a02b-b7ec-47d5-b3ee-368bfdbb15aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f7c854c737f4e2fa8fe3af5a7293e00', 'request_id': 'req-7611a02b-b7ec-47d5-b3ee-368bfdbb15aa'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:49.529875 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7611a02b-b7ec-47d5-b3ee-368bfdbb15aa admin admin] The token cache is being invalidate because project 8f7c854c737f4e2fa8fe3af5a7293e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:55:49.530164 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7611a02b-b7ec-47d5-b3ee-368bfdbb15aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:49.530838 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7611a02b-b7ec-47d5-b3ee-368bfdbb15aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:49.532353 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1293/2584] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:55:49 2022] DELETE /identity/v3/projects/8f7c854c737f4e2fa8fe3af5a7293e00 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:55:49.536338 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9085f86-4f6d-4f51-95ed-94bc958697d3 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:49.546440 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9085f86-4f6d-4f51-95ed-94bc958697d3 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:49.602984 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4031880-3a24-49ff-bfd4-b0d66efa7594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:49.603557 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4031880-3a24-49ff-bfd4-b0d66efa7594 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:49.603845 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4031880-3a24-49ff-bfd4-b0d66efa7594 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:49.604128 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4031880-3a24-49ff-bfd4-b0d66efa7594 admin admin] PATH_INFO: `/v3/users/e3b8261e19804274bed8ca7a548fe2eb` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:49.605319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4031880-3a24-49ff-bfd4-b0d66efa7594 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3b8261e19804274bed8ca7a548fe2eb)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:49.607813 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4031880-3a24-49ff-bfd4-b0d66efa7594 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:49.652418 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b4031880-3a24-49ff-bfd4-b0d66efa7594 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3b8261e19804274bed8ca7a548fe2eb'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:49.653081 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b4031880-3a24-49ff-bfd4-b0d66efa7594 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3b8261e19804274bed8ca7a548fe2eb'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:49.660141 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b4031880-3a24-49ff-bfd4-b0d66efa7594 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3b8261e19804274bed8ca7a548fe2eb'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:49.673455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b4031880-3a24-49ff-bfd4-b0d66efa7594 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3b8261e19804274bed8ca7a548fe2eb'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:49.674518 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b4031880-3a24-49ff-bfd4-b0d66efa7594 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3b8261e19804274bed8ca7a548fe2eb'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:49.688868 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1292/2585] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:55:49 2022] DELETE /identity/v3/users/e3b8261e19804274bed8ca7a548fe2eb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:55:49.965556 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611a02b-b7ec-47d5-b3ee-368bfdbb15aa admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:49.967009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-7611a02b-b7ec-47d5-b3ee-368bfdbb15aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:49.981580 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611a02b-b7ec-47d5-b3ee-368bfdbb15aa admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:50.038466 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1349b-e924-4a33-acf1-ecd8141715bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:50.039111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1349b-e924-4a33-acf1-ecd8141715bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:50.039393 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1349b-e924-4a33-acf1-ecd8141715bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:50.039668 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1349b-e924-4a33-acf1-ecd8141715bf admin admin] PATH_INFO: `/v3/projects/f78e3a0d45944671b6782387fafd8bbb` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:50.040805 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1349b-e924-4a33-acf1-ecd8141715bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f78e3a0d45944671b6782387fafd8bbb)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:50.042723 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a1349b-e924-4a33-acf1-ecd8141715bf admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:50.088694 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a8a1349b-e924-4a33-acf1-ecd8141715bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f78e3a0d45944671b6782387fafd8bbb', 'request_id': 'req-a8a1349b-e924-4a33-acf1-ecd8141715bf'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:50.094637 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a8a1349b-e924-4a33-acf1-ecd8141715bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f78e3a0d45944671b6782387fafd8bbb', 'request_id': 'req-a8a1349b-e924-4a33-acf1-ecd8141715bf'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:50.101623 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a8a1349b-e924-4a33-acf1-ecd8141715bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f78e3a0d45944671b6782387fafd8bbb', 'request_id': 'req-a8a1349b-e924-4a33-acf1-ecd8141715bf'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:50.113023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a8a1349b-e924-4a33-acf1-ecd8141715bf admin admin] The token cache is being invalidate because project f78e3a0d45944671b6782387fafd8bbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:55:50.113313 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a8a1349b-e924-4a33-acf1-ecd8141715bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:50.113946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a8a1349b-e924-4a33-acf1-ecd8141715bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:55:50.115476 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1294/2586] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:55:49 2022] DELETE /identity/v3/projects/f78e3a0d45944671b6782387fafd8bbb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:55:50.121714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee3b7c-dcbd-4094-84ec-55e8864ce0b0 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:50.122009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee3b7c-dcbd-4094-84ec-55e8864ce0b0 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:50.122292 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee3b7c-dcbd-4094-84ec-55e8864ce0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:50.141365 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-d1ee3b7c-dcbd-4094-84ec-55e8864ce0b0 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:55:50.142538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d1ee3b7c-dcbd-4094-84ec-55e8864ce0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:50.184518 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:50.202942 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1293/2587] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:55:50.211312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd690b98-c31e-4ca4-86f1-661dfc520ee4 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:50.211676 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd690b98-c31e-4ca4-86f1-661dfc520ee4 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:50.212029 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd690b98-c31e-4ca4-86f1-661dfc520ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:50.232620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-fd690b98-c31e-4ca4-86f1-661dfc520ee4 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:55:50.233829 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-fd690b98-c31e-4ca4-86f1-661dfc520ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:50.241760 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1295/2588] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:55:50.245921 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee3b7c-dcbd-4094-84ec-55e8864ce0b0 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:50.255693 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee3b7c-dcbd-4094-84ec-55e8864ce0b0 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:50.260244 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199575e-458e-4a0c-9d74-f5f5c76a7a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:50.260858 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199575e-458e-4a0c-9d74-f5f5c76a7a2f admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:50.261147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199575e-458e-4a0c-9d74-f5f5c76a7a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:50.261430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199575e-458e-4a0c-9d74-f5f5c76a7a2f admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:50.262172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199575e-458e-4a0c-9d74-f5f5c76a7a2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:55:50.262519 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199575e-458e-4a0c-9d74-f5f5c76a7a2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:50.264115 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199575e-458e-4a0c-9d74-f5f5c76a7a2f admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:50.275357 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1294/2589] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:55:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:55:50.279973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd690b98-c31e-4ca4-86f1-661dfc520ee4 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:50.289024 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd690b98-c31e-4ca4-86f1-661dfc520ee4 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:50.294297 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25aa74-8fc4-4f84-9a4d-adc5a303aa6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:50.294933 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25aa74-8fc4-4f84-9a4d-adc5a303aa6b admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:50.295223 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25aa74-8fc4-4f84-9a4d-adc5a303aa6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:50.295505 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25aa74-8fc4-4f84-9a4d-adc5a303aa6b admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:50.296166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25aa74-8fc4-4f84-9a4d-adc5a303aa6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:50.298044 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b25aa74-8fc4-4f84-9a4d-adc5a303aa6b admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:50.324195 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1296/2590] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:55:50 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:55:50.328890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199575e-458e-4a0c-9d74-f5f5c76a7a2f admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:50.338995 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199575e-458e-4a0c-9d74-f5f5c76a7a2f admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:50.393563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95a6e-af2d-4f8e-aaa0-080b78c8bc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:50.394206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95a6e-af2d-4f8e-aaa0-080b78c8bc11 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:50.394666 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95a6e-af2d-4f8e-aaa0-080b78c8bc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:50.395103 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95a6e-af2d-4f8e-aaa0-080b78c8bc11 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:50.395758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f95a6e-af2d-4f8e-aaa0-080b78c8bc11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:50.397661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f95a6e-af2d-4f8e-aaa0-080b78c8bc11 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:50.418666 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1295/2591] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:55:50 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:55:50.422900 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25aa74-8fc4-4f84-9a4d-adc5a303aa6b admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:50.432895 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25aa74-8fc4-4f84-9a4d-adc5a303aa6b admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:50.438525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2096f4-ba67-4973-b85f-f3d48e092efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:50.439151 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2096f4-ba67-4973-b85f-f3d48e092efe admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:50.439438 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2096f4-ba67-4973-b85f-f3d48e092efe admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:50.439719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2096f4-ba67-4973-b85f-f3d48e092efe admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:50.440447 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2096f4-ba67-4973-b85f-f3d48e092efe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:50.442068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2096f4-ba67-4973-b85f-f3d48e092efe admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:50.452421 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1297/2592] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:55:50.456257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95a6e-af2d-4f8e-aaa0-080b78c8bc11 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:50.466966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95a6e-af2d-4f8e-aaa0-080b78c8bc11 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:50.471591 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02088bfd-1187-4609-9a48-58ff60993ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:50.472194 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02088bfd-1187-4609-9a48-58ff60993ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:50.472483 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02088bfd-1187-4609-9a48-58ff60993ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:50.472768 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02088bfd-1187-4609-9a48-58ff60993ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:50.473452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02088bfd-1187-4609-9a48-58ff60993ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:50.475070 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02088bfd-1187-4609-9a48-58ff60993ce8 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:50.485588 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1296/2593] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:55:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:55:50.489575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2096f4-ba67-4973-b85f-f3d48e092efe admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:50.499611 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2096f4-ba67-4973-b85f-f3d48e092efe admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:50.504236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cc37e-be13-4c6b-8f81-39c6babf918f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:50.504889 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cc37e-be13-4c6b-8f81-39c6babf918f admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:50.505174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cc37e-be13-4c6b-8f81-39c6babf918f admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:50.505451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962cc37e-be13-4c6b-8f81-39c6babf918f admin admin] PATH_INFO: `/v3/projects/4634f5b96738499c99af93a7d88700fe/users/18ce89e5fc7a41aaa4d511193d00c69b/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:50.520199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cc37e-be13-4c6b-8f81-39c6babf918f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4634f5b96738499c99af93a7d88700fe, user_id=18ce89e5fc7a41aaa4d511193d00c69b, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:50.522848 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962cc37e-be13-4c6b-8f81-39c6babf918f admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:50.535713 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1298/2594] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:55:50 2022] PUT /identity/v3/projects/4634f5b96738499c99af93a7d88700fe/users/18ce89e5fc7a41aaa4d511193d00c69b/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:55:50.545967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048efa9-209d-4a38-b121-ee9b817f7b07 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:50.546467 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048efa9-209d-4a38-b121-ee9b817f7b07 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:50.546588 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7048efa9-209d-4a38-b121-ee9b817f7b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:50.572738 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-7048efa9-209d-4a38-b121-ee9b817f7b07 None None] MFA Rules not processed for user `18ce89e5fc7a41aaa4d511193d00c69b`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:55:50.573956 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-7048efa9-209d-4a38-b121-ee9b817f7b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:50.636146 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1297/2595] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:55:50 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:55:50.647872 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cc37e-be13-4c6b-8f81-39c6babf918f admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:55:50.649500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-962cc37e-be13-4c6b-8f81-39c6babf918f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:55:50.661067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:55:50.707854 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962cc37e-be13-4c6b-8f81-39c6babf918f admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:55:50.711716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7174f532-1cdd-484d-90d0-c82224bea681 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b26c60d08b9f47aca8404e4173290908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:55:50.712325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174f532-1cdd-484d-90d0-c82224bea681 service glance] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:55:50.712606 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174f532-1cdd-484d-90d0-c82224bea681 service glance] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:55:50.712880 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7174f532-1cdd-484d-90d0-c82224bea681 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:55:50.721247 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174f532-1cdd-484d-90d0-c82224bea681 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:55:50.722720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7174f532-1cdd-484d-90d0-c82224bea681 service glance] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:55:50.731605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1299/2596] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:55:50 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:56:00.633259 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:00.727617 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=22 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:17.534308 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048efa9-209d-4a38-b121-ee9b817f7b07 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:17.602461 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7048efa9-209d-4a38-b121-ee9b817f7b07 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:17.606953 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215672fc-aa9a-4f06-aa7d-6c350d47c5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:17.607599 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215672fc-aa9a-4f06-aa7d-6c350d47c5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:17.607884 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215672fc-aa9a-4f06-aa7d-6c350d47c5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:17.608158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215672fc-aa9a-4f06-aa7d-6c350d47c5c8 admin admin] PATH_INFO: `/v3/users/18ce89e5fc7a41aaa4d511193d00c69b` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:17.609970 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215672fc-aa9a-4f06-aa7d-6c350d47c5c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ce89e5fc7a41aaa4d511193d00c69b)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:17.611909 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215672fc-aa9a-4f06-aa7d-6c350d47c5c8 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:17.657747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-215672fc-aa9a-4f06-aa7d-6c350d47c5c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ce89e5fc7a41aaa4d511193d00c69b'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:56:17.658419 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-215672fc-aa9a-4f06-aa7d-6c350d47c5c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ce89e5fc7a41aaa4d511193d00c69b'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:56:17.666031 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-215672fc-aa9a-4f06-aa7d-6c350d47c5c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ce89e5fc7a41aaa4d511193d00c69b'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:56:17.678933 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-215672fc-aa9a-4f06-aa7d-6c350d47c5c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ce89e5fc7a41aaa4d511193d00c69b'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:56:17.679576 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-215672fc-aa9a-4f06-aa7d-6c350d47c5c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ce89e5fc7a41aaa4d511193d00c69b'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:56:17.691540 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1298/2597] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:56:17 2022] DELETE /identity/v3/users/18ce89e5fc7a41aaa4d511193d00c69b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:56:17.696105 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc017943-8b84-471f-b2dd-56fcbb4e7655 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:17.696600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc017943-8b84-471f-b2dd-56fcbb4e7655 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:17.696708 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc017943-8b84-471f-b2dd-56fcbb4e7655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:17.715328 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-fc017943-8b84-471f-b2dd-56fcbb4e7655 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:56:17.716505 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-fc017943-8b84-471f-b2dd-56fcbb4e7655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:56:17.782051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1300/2598] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:56:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:56:17.791801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215672fc-aa9a-4f06-aa7d-6c350d47c5c8 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:17.793393 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-215672fc-aa9a-4f06-aa7d-6c350d47c5c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:56:17.853066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215672fc-aa9a-4f06-aa7d-6c350d47c5c8 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:17.856757 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602ee60-9699-44dc-a659-d93b94b03d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:17.857382 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602ee60-9699-44dc-a659-d93b94b03d7b service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:17.857666 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602ee60-9699-44dc-a659-d93b94b03d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:17.857942 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602ee60-9699-44dc-a659-d93b94b03d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:17.868191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602ee60-9699-44dc-a659-d93b94b03d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:17.869617 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e602ee60-9699-44dc-a659-d93b94b03d7b service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:17.879394 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1299/2599] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:56:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:56:18.150216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc017943-8b84-471f-b2dd-56fcbb4e7655 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:18.151728 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-fc017943-8b84-471f-b2dd-56fcbb4e7655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:56:18.163458 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc017943-8b84-471f-b2dd-56fcbb4e7655 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:18.168222 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8aa53a-7edc-42a2-8724-1d9030540816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:18.168870 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8aa53a-7edc-42a2-8724-1d9030540816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:18.169158 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8aa53a-7edc-42a2-8724-1d9030540816 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:18.169442 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8aa53a-7edc-42a2-8724-1d9030540816 admin admin] PATH_INFO: `/v3/projects/4634f5b96738499c99af93a7d88700fe` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:18.170666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8aa53a-7edc-42a2-8724-1d9030540816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4634f5b96738499c99af93a7d88700fe)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:18.173209 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8aa53a-7edc-42a2-8724-1d9030540816 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:18.220309 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0c8aa53a-7edc-42a2-8724-1d9030540816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4634f5b96738499c99af93a7d88700fe', 'request_id': 'req-0c8aa53a-7edc-42a2-8724-1d9030540816'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:56:18.225809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0c8aa53a-7edc-42a2-8724-1d9030540816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4634f5b96738499c99af93a7d88700fe', 'request_id': 'req-0c8aa53a-7edc-42a2-8724-1d9030540816'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:56:18.232947 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0c8aa53a-7edc-42a2-8724-1d9030540816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4634f5b96738499c99af93a7d88700fe', 'request_id': 'req-0c8aa53a-7edc-42a2-8724-1d9030540816'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:56:18.244773 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0c8aa53a-7edc-42a2-8724-1d9030540816 admin admin] The token cache is being invalidate because project 4634f5b96738499c99af93a7d88700fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:56:18.245062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0c8aa53a-7edc-42a2-8724-1d9030540816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:56:18.245700 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-0c8aa53a-7edc-42a2-8724-1d9030540816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:56:18.247271 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1301/2600] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:56:18 2022] DELETE /identity/v3/projects/4634f5b96738499c99af93a7d88700fe => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:56:18.252774 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ee4f1-503e-4a5d-903b-6cb9d4d8acd0 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:18.253066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ee4f1-503e-4a5d-903b-6cb9d4d8acd0 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:18.253351 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ee4f1-503e-4a5d-903b-6cb9d4d8acd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:18.272723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-f59ee4f1-503e-4a5d-903b-6cb9d4d8acd0 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:56:18.273989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-f59ee4f1-503e-4a5d-903b-6cb9d4d8acd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:56:18.290742 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:18.336232 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1300/2601] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:56:18.344454 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ce201-362a-4458-9365-0f13b9678534 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:18.344744 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ce201-362a-4458-9365-0f13b9678534 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:18.345056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ce201-362a-4458-9365-0f13b9678534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:18.364843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-956ce201-362a-4458-9365-0f13b9678534 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:56:18.366044 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-956ce201-362a-4458-9365-0f13b9678534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:56:18.373923 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1302/2602] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:56:18.378079 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ee4f1-503e-4a5d-903b-6cb9d4d8acd0 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:18.387644 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ee4f1-503e-4a5d-903b-6cb9d4d8acd0 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:18.392267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5aeb8c-aa6f-4056-bd10-1ed17e4f19ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:18.392884 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5aeb8c-aa6f-4056-bd10-1ed17e4f19ac admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:18.393171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5aeb8c-aa6f-4056-bd10-1ed17e4f19ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:18.393451 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5aeb8c-aa6f-4056-bd10-1ed17e4f19ac admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:18.394154 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5aeb8c-aa6f-4056-bd10-1ed17e4f19ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:56:18.394503 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5aeb8c-aa6f-4056-bd10-1ed17e4f19ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:18.396097 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5aeb8c-aa6f-4056-bd10-1ed17e4f19ac admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:18.408145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1301/2603] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:56:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:56:18.412259 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ce201-362a-4458-9365-0f13b9678534 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:18.421981 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ce201-362a-4458-9365-0f13b9678534 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:18.431729 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e24c3-28c0-4d3b-adef-feb05c1fe710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:18.432349 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e24c3-28c0-4d3b-adef-feb05c1fe710 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:18.432637 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e24c3-28c0-4d3b-adef-feb05c1fe710 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:18.432915 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e24c3-28c0-4d3b-adef-feb05c1fe710 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:18.433591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e24c3-28c0-4d3b-adef-feb05c1fe710 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:18.435508 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e24c3-28c0-4d3b-adef-feb05c1fe710 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:18.463173 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1303/2604] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:56:18 2022] POST /identity/v3/projects => generated 363 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:56:18.467492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5aeb8c-aa6f-4056-bd10-1ed17e4f19ac admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:18.477713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5aeb8c-aa6f-4056-bd10-1ed17e4f19ac admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:18.533162 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ae85f-7686-4f28-a7a9-94584f335c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:18.533711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ae85f-7686-4f28-a7a9-94584f335c55 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:18.533998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ae85f-7686-4f28-a7a9-94584f335c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:18.534279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6ae85f-7686-4f28-a7a9-94584f335c55 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:18.534974 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ae85f-7686-4f28-a7a9-94584f335c55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:18.536896 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6ae85f-7686-4f28-a7a9-94584f335c55 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:18.563515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1302/2605] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:56:18 2022] POST /identity/v3/users => generated 282 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:56:18.569396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e24c3-28c0-4d3b-adef-feb05c1fe710 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:18.582673 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e24c3-28c0-4d3b-adef-feb05c1fe710 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:18.599278 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41008496-bf84-4045-9cf7-926ad81d6b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:18.599936 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41008496-bf84-4045-9cf7-926ad81d6b58 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:18.600241 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41008496-bf84-4045-9cf7-926ad81d6b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:18.600501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41008496-bf84-4045-9cf7-926ad81d6b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:18.601216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41008496-bf84-4045-9cf7-926ad81d6b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:18.602997 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41008496-bf84-4045-9cf7-926ad81d6b58 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:18.613217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1304/2606] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:56:18.617606 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ae85f-7686-4f28-a7a9-94584f335c55 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:18.628054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6ae85f-7686-4f28-a7a9-94584f335c55 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:18.632791 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52a60f-5972-4dbc-a4e2-18ca36d4bf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:18.633407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52a60f-5972-4dbc-a4e2-18ca36d4bf51 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:18.633694 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52a60f-5972-4dbc-a4e2-18ca36d4bf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:18.633998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52a60f-5972-4dbc-a4e2-18ca36d4bf51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:18.634726 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52a60f-5972-4dbc-a4e2-18ca36d4bf51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:18.636325 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52a60f-5972-4dbc-a4e2-18ca36d4bf51 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:18.647485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1303/2607] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:56:18.651452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41008496-bf84-4045-9cf7-926ad81d6b58 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:18.661624 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41008496-bf84-4045-9cf7-926ad81d6b58 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:18.666318 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a67966-f8d0-4713-90ae-859365e34641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:18.667051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a67966-f8d0-4713-90ae-859365e34641 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:18.667340 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a67966-f8d0-4713-90ae-859365e34641 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:18.667622 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a67966-f8d0-4713-90ae-859365e34641 admin admin] PATH_INFO: `/v3/projects/cf71e37344464f288534d78eba3d41c9/users/febee130a5b94ad49e3c517fc74aec0a/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:18.683262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a67966-f8d0-4713-90ae-859365e34641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf71e37344464f288534d78eba3d41c9, user_id=febee130a5b94ad49e3c517fc74aec0a, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:18.685923 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a67966-f8d0-4713-90ae-859365e34641 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:18.701049 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1305/2608] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:56:18 2022] PUT /identity/v3/projects/cf71e37344464f288534d78eba3d41c9/users/febee130a5b94ad49e3c517fc74aec0a/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:56:18.711749 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfdb63-f49b-4d23-ab90-2b57f00943f8 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:18.712041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfdb63-f49b-4d23-ab90-2b57f00943f8 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:18.712324 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfdb63-f49b-4d23-ab90-2b57f00943f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:18.740290 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-1dcfdb63-f49b-4d23-ab90-2b57f00943f8 None None] MFA Rules not processed for user `febee130a5b94ad49e3c517fc74aec0a`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:56:18.741509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-1dcfdb63-f49b-4d23-ab90-2b57f00943f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:56:18.803948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1304/2609] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:56:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:56:18.815562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a67966-f8d0-4713-90ae-859365e34641 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:18.817226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-91a67966-f8d0-4713-90ae-859365e34641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:56:18.838689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:18.874862 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a67966-f8d0-4713-90ae-859365e34641 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:18.879368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5a2be-e6d5-4d10-a928-69ed63125cc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:18.879991 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5a2be-e6d5-4d10-a928-69ed63125cc5 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:18.880278 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5a2be-e6d5-4d10-a928-69ed63125cc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:18.880556 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5a2be-e6d5-4d10-a928-69ed63125cc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:18.888880 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5a2be-e6d5-4d10-a928-69ed63125cc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:18.890286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5a2be-e6d5-4d10-a928-69ed63125cc5 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:18.898962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1306/2610] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:56:18 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:56:25.510926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e44cad-7adb-4319-bd48-3f0342f1b20e None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:25.511423 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e44cad-7adb-4319-bd48-3f0342f1b20e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:25.511535 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e44cad-7adb-4319-bd48-3f0342f1b20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:25.531008 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-73e44cad-7adb-4319-bd48-3f0342f1b20e None None] MFA Rules not processed for user `db10ad54ec9948a3bb8b04c708fc4ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:56:25.532194 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-73e44cad-7adb-4319-bd48-3f0342f1b20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:56:25.544753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:25.589345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1305/2611] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 22:56:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:56:25.635473 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5a2be-e6d5-4d10-a928-69ed63125cc5 service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:25.636871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-7bc5a2be-e6d5-4d10-a928-69ed63125cc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:56:25.705062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5a2be-e6d5-4d10-a928-69ed63125cc5 service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:25.710242 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaea57-753d-4b9d-94ee-976baf15c35a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf405258b9d413fae1192e10250b6a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:25.710881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaea57-753d-4b9d-94ee-976baf15c35a service swift] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:25.711164 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaea57-753d-4b9d-94ee-976baf15c35a service swift] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:25.711440 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aaea57-753d-4b9d-94ee-976baf15c35a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:25.719347 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aaea57-753d-4b9d-94ee-976baf15c35a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:25.721454 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aaea57-753d-4b9d-94ee-976baf15c35a service swift] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:25.729540 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1307/2612] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 22:56:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 22:56:35.582250 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=17 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:35.726078 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=49 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:43.389587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a405fd9-e531-4459-9e39-dc8387567f52 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:43.390092 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a405fd9-e531-4459-9e39-dc8387567f52 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:43.390191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a405fd9-e531-4459-9e39-dc8387567f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:43.410592 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-5a405fd9-e531-4459-9e39-dc8387567f52 None None] MFA Rules not processed for user `db10ad54ec9948a3bb8b04c708fc4ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:56:43.411805 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5a405fd9-e531-4459-9e39-dc8387567f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:56:43.419045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1306/2613] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 22:56:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:56:43.430966 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaea57-753d-4b9d-94ee-976baf15c35a service swift] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:43.441963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aaea57-753d-4b9d-94ee-976baf15c35a service swift] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:43.448245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d29f6-0ba7-4bbc-9ffc-baa2ecbe03eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf405258b9d413fae1192e10250b6a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:43.448854 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d29f6-0ba7-4bbc-9ffc-baa2ecbe03eb service swift] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:43.449142 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d29f6-0ba7-4bbc-9ffc-baa2ecbe03eb service swift] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:43.449425 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d29f6-0ba7-4bbc-9ffc-baa2ecbe03eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:43.458374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d29f6-0ba7-4bbc-9ffc-baa2ecbe03eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:43.460423 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d29f6-0ba7-4bbc-9ffc-baa2ecbe03eb service swift] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:43.468516 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1308/2614] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 22:56:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 22:56:53.404405 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:53.465250 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=6 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:55.530895 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a405fd9-e531-4459-9e39-dc8387567f52 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:55.592896 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a405fd9-e531-4459-9e39-dc8387567f52 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:55.598090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206aac18-2d65-4bbb-b697-99f8063c226e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:55.598770 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206aac18-2d65-4bbb-b697-99f8063c226e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:55.599059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206aac18-2d65-4bbb-b697-99f8063c226e admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:55.599341 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206aac18-2d65-4bbb-b697-99f8063c226e admin admin] PATH_INFO: `/v3/users/febee130a5b94ad49e3c517fc74aec0a` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:55.600532 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206aac18-2d65-4bbb-b697-99f8063c226e admin admin] RBAC: Authorizing `identity:delete_user(user_id=febee130a5b94ad49e3c517fc74aec0a)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:55.602485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206aac18-2d65-4bbb-b697-99f8063c226e admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:55.647734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-206aac18-2d65-4bbb-b697-99f8063c226e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'febee130a5b94ad49e3c517fc74aec0a'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:56:55.648376 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-206aac18-2d65-4bbb-b697-99f8063c226e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'febee130a5b94ad49e3c517fc74aec0a'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:56:55.655778 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-206aac18-2d65-4bbb-b697-99f8063c226e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'febee130a5b94ad49e3c517fc74aec0a'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:56:55.669196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-206aac18-2d65-4bbb-b697-99f8063c226e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'febee130a5b94ad49e3c517fc74aec0a'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:56:55.669829 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-206aac18-2d65-4bbb-b697-99f8063c226e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'febee130a5b94ad49e3c517fc74aec0a'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:56:55.681670 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1307/2615] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:56:55 2022] DELETE /identity/v3/users/febee130a5b94ad49e3c517fc74aec0a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:56:55.686299 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eb563-8e55-4203-9e55-aec3bfb67386 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:55.686822 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eb563-8e55-4203-9e55-aec3bfb67386 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:55.686967 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400eb563-8e55-4203-9e55-aec3bfb67386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:55.705363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-400eb563-8e55-4203-9e55-aec3bfb67386 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:56:55.707084 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-400eb563-8e55-4203-9e55-aec3bfb67386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:56:55.764721 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1309/2616] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:56:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:56:55.774980 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206aac18-2d65-4bbb-b697-99f8063c226e admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:55.776488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-206aac18-2d65-4bbb-b697-99f8063c226e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:56:55.836095 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206aac18-2d65-4bbb-b697-99f8063c226e admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:55.839852 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b282602-7064-4dfa-93a2-bb82f706fb05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:55.840570 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b282602-7064-4dfa-93a2-bb82f706fb05 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:55.840921 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b282602-7064-4dfa-93a2-bb82f706fb05 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:55.841265 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b282602-7064-4dfa-93a2-bb82f706fb05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:55.851205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b282602-7064-4dfa-93a2-bb82f706fb05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:55.852742 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b282602-7064-4dfa-93a2-bb82f706fb05 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:55.863231 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1308/2617] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:56:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:56:56.141400 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400eb563-8e55-4203-9e55-aec3bfb67386 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:56.142869 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-400eb563-8e55-4203-9e55-aec3bfb67386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:56:56.155091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400eb563-8e55-4203-9e55-aec3bfb67386 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:56.160337 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95851a-3f3a-4345-8cfc-6a400a028104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:56.161009 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95851a-3f3a-4345-8cfc-6a400a028104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:56.161295 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95851a-3f3a-4345-8cfc-6a400a028104 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:56.161573 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95851a-3f3a-4345-8cfc-6a400a028104 admin admin] PATH_INFO: `/v3/projects/cf71e37344464f288534d78eba3d41c9` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:56.162990 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95851a-3f3a-4345-8cfc-6a400a028104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf71e37344464f288534d78eba3d41c9)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:56.164904 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95851a-3f3a-4345-8cfc-6a400a028104 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:56.211803 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-dc95851a-3f3a-4345-8cfc-6a400a028104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf71e37344464f288534d78eba3d41c9', 'request_id': 'req-dc95851a-3f3a-4345-8cfc-6a400a028104'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:56:56.217185 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-dc95851a-3f3a-4345-8cfc-6a400a028104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf71e37344464f288534d78eba3d41c9', 'request_id': 'req-dc95851a-3f3a-4345-8cfc-6a400a028104'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:56:56.224880 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-dc95851a-3f3a-4345-8cfc-6a400a028104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf71e37344464f288534d78eba3d41c9', 'request_id': 'req-dc95851a-3f3a-4345-8cfc-6a400a028104'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:56:56.235845 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-dc95851a-3f3a-4345-8cfc-6a400a028104 admin admin] The token cache is being invalidate because project cf71e37344464f288534d78eba3d41c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:56:56.236136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-dc95851a-3f3a-4345-8cfc-6a400a028104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:56:56.236767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-dc95851a-3f3a-4345-8cfc-6a400a028104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:56:56.238294 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1310/2618] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:56:56 2022] DELETE /identity/v3/projects/cf71e37344464f288534d78eba3d41c9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:56:56.243273 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6631b79-ea74-40fc-a59f-db8f6d37080c None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:56.243563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6631b79-ea74-40fc-a59f-db8f6d37080c None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:56.243875 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6631b79-ea74-40fc-a59f-db8f6d37080c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:56.262714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-a6631b79-ea74-40fc-a59f-db8f6d37080c None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:56:56.264020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a6631b79-ea74-40fc-a59f-db8f6d37080c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:56:56.281106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:56.325130 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1309/2619] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:56:56.333187 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35926016-739b-4394-a1ac-102caf9af218 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:56.333477 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35926016-739b-4394-a1ac-102caf9af218 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:56.333755 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35926016-739b-4394-a1ac-102caf9af218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:56.353830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-35926016-739b-4394-a1ac-102caf9af218 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:56:56.355059 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-35926016-739b-4394-a1ac-102caf9af218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:56:56.363020 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1311/2620] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:56:56.367081 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6631b79-ea74-40fc-a59f-db8f6d37080c None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:56.376566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6631b79-ea74-40fc-a59f-db8f6d37080c None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:56.381091 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030caa97-51c7-4e4d-92fb-8922745a2211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:56.381690 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030caa97-51c7-4e4d-92fb-8922745a2211 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:56.381970 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030caa97-51c7-4e4d-92fb-8922745a2211 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:56.382241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030caa97-51c7-4e4d-92fb-8922745a2211 admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:56.382964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030caa97-51c7-4e4d-92fb-8922745a2211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:56:56.383265 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030caa97-51c7-4e4d-92fb-8922745a2211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:56.384851 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030caa97-51c7-4e4d-92fb-8922745a2211 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:56.396505 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1310/2621] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:56:56.400517 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35926016-739b-4394-a1ac-102caf9af218 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:56.410103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35926016-739b-4394-a1ac-102caf9af218 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:56.414719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753ad1b-7b9c-4693-8aac-20e59ebbf0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:56.415321 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753ad1b-7b9c-4693-8aac-20e59ebbf0db admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:56.415608 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753ad1b-7b9c-4693-8aac-20e59ebbf0db admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:56.415884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753ad1b-7b9c-4693-8aac-20e59ebbf0db admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:56.416547 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753ad1b-7b9c-4693-8aac-20e59ebbf0db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:56.418462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753ad1b-7b9c-4693-8aac-20e59ebbf0db admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:56.446044 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1312/2622] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:56:56 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:56:56.450199 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030caa97-51c7-4e4d-92fb-8922745a2211 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:56.460785 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030caa97-51c7-4e4d-92fb-8922745a2211 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:56.515178 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c2eff-b53f-4c52-aadc-8257db2f0455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:56.515785 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c2eff-b53f-4c52-aadc-8257db2f0455 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:56.516066 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c2eff-b53f-4c52-aadc-8257db2f0455 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:56.516341 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c2eff-b53f-4c52-aadc-8257db2f0455 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:56.517002 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c2eff-b53f-4c52-aadc-8257db2f0455 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:56.519548 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c2eff-b53f-4c52-aadc-8257db2f0455 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:56.539473 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1311/2623] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:56:56 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:56:56.543562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753ad1b-7b9c-4693-8aac-20e59ebbf0db admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:56.553806 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753ad1b-7b9c-4693-8aac-20e59ebbf0db admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:56.558319 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9600e-5dae-436d-aa97-ab70e1df2511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:56.558957 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9600e-5dae-436d-aa97-ab70e1df2511 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:56.559240 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9600e-5dae-436d-aa97-ab70e1df2511 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:56.559512 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9600e-5dae-436d-aa97-ab70e1df2511 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:56.560195 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9600e-5dae-436d-aa97-ab70e1df2511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:56.561828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c9600e-5dae-436d-aa97-ab70e1df2511 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:56.572401 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1313/2624] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:56:56.576300 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c2eff-b53f-4c52-aadc-8257db2f0455 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:56.587110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c2eff-b53f-4c52-aadc-8257db2f0455 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:56.591735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a98ec-653a-415b-a9ad-4baf5d2f6dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:56.592339 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a98ec-653a-415b-a9ad-4baf5d2f6dbe admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:56.592619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a98ec-653a-415b-a9ad-4baf5d2f6dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:56.592893 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a98ec-653a-415b-a9ad-4baf5d2f6dbe admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:56.593612 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a98ec-653a-415b-a9ad-4baf5d2f6dbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:56.595209 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a98ec-653a-415b-a9ad-4baf5d2f6dbe admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:56.606200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1312/2625] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:56:56.610249 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9600e-5dae-436d-aa97-ab70e1df2511 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:56.620067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9600e-5dae-436d-aa97-ab70e1df2511 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:56.624643 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60faa04-1583-451b-9cd3-912c54b7d027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:56.625294 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60faa04-1583-451b-9cd3-912c54b7d027 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:56.625575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60faa04-1583-451b-9cd3-912c54b7d027 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:56.625851 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60faa04-1583-451b-9cd3-912c54b7d027 admin admin] PATH_INFO: `/v3/projects/016aa869bdc648128c71c05daa33998a/users/56558eb318e34885b42950391568a2a2/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:56.640201 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60faa04-1583-451b-9cd3-912c54b7d027 admin admin] RBAC: Authorizing `identity:create_grant(project_id=016aa869bdc648128c71c05daa33998a, user_id=56558eb318e34885b42950391568a2a2, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:56.642853 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60faa04-1583-451b-9cd3-912c54b7d027 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:56.656529 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1314/2626] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:56:56 2022] PUT /identity/v3/projects/016aa869bdc648128c71c05daa33998a/users/56558eb318e34885b42950391568a2a2/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:56:56.666517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa155d62-040c-4c76-825d-55e0517d2ba8 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:56.666808 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa155d62-040c-4c76-825d-55e0517d2ba8 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:56.667111 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa155d62-040c-4c76-825d-55e0517d2ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:56.695080 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-fa155d62-040c-4c76-825d-55e0517d2ba8 None None] MFA Rules not processed for user `56558eb318e34885b42950391568a2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:56:56.696293 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-fa155d62-040c-4c76-825d-55e0517d2ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:56:56.757629 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1313/2627] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:56:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:56:56.768920 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60faa04-1583-451b-9cd3-912c54b7d027 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:56:56.770670 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d60faa04-1583-451b-9cd3-912c54b7d027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:56:56.791891 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:56:56.827952 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60faa04-1583-451b-9cd3-912c54b7d027 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:56:56.832143 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d84cb5-1430-4cfe-b164-601e2ff78e65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:56:56.832751 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d84cb5-1430-4cfe-b164-601e2ff78e65 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:56.833031 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d84cb5-1430-4cfe-b164-601e2ff78e65 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:56.833306 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d84cb5-1430-4cfe-b164-601e2ff78e65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:56.841576 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d84cb5-1430-4cfe-b164-601e2ff78e65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:56:56.843026 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d84cb5-1430-4cfe-b164-601e2ff78e65 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:56:56.851605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1315/2628] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:56:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:56:58.233693 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f1667-781c-4f73-adf9-edf7841d5a0d None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:56:58.234234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f1667-781c-4f73-adf9-edf7841d5a0d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:56:58.234234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3f1667-781c-4f73-adf9-edf7841d5a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:56:58.253370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-5b3f1667-781c-4f73-adf9-edf7841d5a0d None None] MFA Rules not processed for user `56558eb318e34885b42950391568a2a2`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:56:58.254593 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5b3f1667-781c-4f73-adf9-edf7841d5a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:56:58.261438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1314/2629] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:56:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:02.779591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bd942-cb3f-4af4-a1b0-042b44b9dbb5 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:02.780037 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bd942-cb3f-4af4-a1b0-042b44b9dbb5 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:02.780194 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38bd942-cb3f-4af4-a1b0-042b44b9dbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:02.811463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-f38bd942-cb3f-4af4-a1b0-042b44b9dbb5 None None] MFA Rules not processed for user `db10ad54ec9948a3bb8b04c708fc4ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:02.812673 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-f38bd942-cb3f-4af4-a1b0-042b44b9dbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:02.892494 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1316/2630] 10.222.0.48 () {58 vars in 967 bytes} [Wed Jul 27 22:57:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:02.904463 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f1667-781c-4f73-adf9-edf7841d5a0d None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:02.905980 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5b3f1667-781c-4f73-adf9-edf7841d5a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:02.921577 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:03.012209 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3f1667-781c-4f73-adf9-edf7841d5a0d None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:03.018387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832a706-a95d-4e6b-a5eb-d0e868f8eb63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf405258b9d413fae1192e10250b6a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:03.018988 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832a706-a95d-4e6b-a5eb-d0e868f8eb63 service swift] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:03.019277 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832a706-a95d-4e6b-a5eb-d0e868f8eb63 service swift] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:03.019559 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832a706-a95d-4e6b-a5eb-d0e868f8eb63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:03.028254 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832a706-a95d-4e6b-a5eb-d0e868f8eb63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:03.029875 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832a706-a95d-4e6b-a5eb-d0e868f8eb63 service swift] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:03.038106 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1315/2631] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 22:57:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 22:57:12.890234 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=58 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:13.034773 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=42 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:20.159663 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f234d0-9621-4978-b2f7-58ea7f90473c None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:20.160810 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f234d0-9621-4978-b2f7-58ea7f90473c None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:20.161149 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f234d0-9621-4978-b2f7-58ea7f90473c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:20.190728 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-09f234d0-9621-4978-b2f7-58ea7f90473c None None] MFA Rules not processed for user `db10ad54ec9948a3bb8b04c708fc4ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:20.193375 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-09f234d0-9621-4978-b2f7-58ea7f90473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:20.203580 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1317/2632] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 22:57:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:20.218823 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832a706-a95d-4e6b-a5eb-d0e868f8eb63 service swift] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:20.230074 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832a706-a95d-4e6b-a5eb-d0e868f8eb63 service swift] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:20.235363 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb3e37-b228-4c5d-8ce6-dba1ff1635ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf405258b9d413fae1192e10250b6a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:20.236060 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb3e37-b228-4c5d-8ce6-dba1ff1635ee service swift] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:20.236422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb3e37-b228-4c5d-8ce6-dba1ff1635ee service swift] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:20.236769 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb3e37-b228-4c5d-8ce6-dba1ff1635ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:20.245830 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb3e37-b228-4c5d-8ce6-dba1ff1635ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:20.247525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb3e37-b228-4c5d-8ce6-dba1ff1635ee service swift] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:20.255825 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1316/2633] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 22:57:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 22:57:20.912790 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a1b0e-e7d1-4afe-9cf5-9a1cacf73435 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:20.913081 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a1b0e-e7d1-4afe-9cf5-9a1cacf73435 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:20.913355 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a1b0e-e7d1-4afe-9cf5-9a1cacf73435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:20.934674 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-a13a1b0e-e7d1-4afe-9cf5-9a1cacf73435 None None] MFA Rules not processed for user `db10ad54ec9948a3bb8b04c708fc4ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:20.935888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a13a1b0e-e7d1-4afe-9cf5-9a1cacf73435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:20.944049 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1318/2634] 10.222.0.48 () {58 vars in 967 bytes} [Wed Jul 27 22:57:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:20.956732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb3e37-b228-4c5d-8ce6-dba1ff1635ee service swift] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:20.969615 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb3e37-b228-4c5d-8ce6-dba1ff1635ee service swift] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:20.976105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9252f4-df5b-49cb-a440-cf3c1867143c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf405258b9d413fae1192e10250b6a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:20.976825 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9252f4-df5b-49cb-a440-cf3c1867143c service swift] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:20.977378 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9252f4-df5b-49cb-a440-cf3c1867143c service swift] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:20.977925 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9252f4-df5b-49cb-a440-cf3c1867143c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:20.990609 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9252f4-df5b-49cb-a440-cf3c1867143c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:20.992227 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9252f4-df5b-49cb-a440-cf3c1867143c service swift] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:21.001805 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1317/2635] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 22:57:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 22:57:21.233816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63204d9f-9df0-4b13-9b1d-c7c2e696fb0b None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:21.234307 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63204d9f-9df0-4b13-9b1d-c7c2e696fb0b None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:21.234436 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63204d9f-9df0-4b13-9b1d-c7c2e696fb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:21.254541 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-63204d9f-9df0-4b13-9b1d-c7c2e696fb0b None None] MFA Rules not processed for user `db10ad54ec9948a3bb8b04c708fc4ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:21.255497 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-63204d9f-9df0-4b13-9b1d-c7c2e696fb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:21.262664 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1319/2636] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 22:57:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:21.274673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9252f4-df5b-49cb-a440-cf3c1867143c service swift] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:21.285945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9252f4-df5b-49cb-a440-cf3c1867143c service swift] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:21.291448 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bddb3a-d962-48f8-bd7e-4f73dda1e3ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf405258b9d413fae1192e10250b6a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:21.292089 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bddb3a-d962-48f8-bd7e-4f73dda1e3ec service swift] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:21.292377 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bddb3a-d962-48f8-bd7e-4f73dda1e3ec service swift] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:21.292656 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bddb3a-d962-48f8-bd7e-4f73dda1e3ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:21.302101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bddb3a-d962-48f8-bd7e-4f73dda1e3ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:21.303735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bddb3a-d962-48f8-bd7e-4f73dda1e3ec service swift] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:21.312788 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1318/2637] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 22:57:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 22:57:21.659459 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f31ef9-9652-4700-b111-d2576a23ee1f None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:21.659748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f31ef9-9652-4700-b111-d2576a23ee1f None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:21.660053 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f31ef9-9652-4700-b111-d2576a23ee1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:21.680403 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-92f31ef9-9652-4700-b111-d2576a23ee1f None None] MFA Rules not processed for user `db10ad54ec9948a3bb8b04c708fc4ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:21.681542 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-92f31ef9-9652-4700-b111-d2576a23ee1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:21.688724 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1320/2638] 10.222.0.48 () {58 vars in 967 bytes} [Wed Jul 27 22:57:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:21.701260 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bddb3a-d962-48f8-bd7e-4f73dda1e3ec service swift] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:21.712169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bddb3a-d962-48f8-bd7e-4f73dda1e3ec service swift] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:21.717514 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265913dc-285c-43d7-9a7b-a71adc0be1aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf405258b9d413fae1192e10250b6a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:21.718151 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265913dc-285c-43d7-9a7b-a71adc0be1aa service swift] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:21.718479 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265913dc-285c-43d7-9a7b-a71adc0be1aa service swift] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:21.718765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265913dc-285c-43d7-9a7b-a71adc0be1aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:21.726930 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265913dc-285c-43d7-9a7b-a71adc0be1aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:21.728489 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265913dc-285c-43d7-9a7b-a71adc0be1aa service swift] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:21.736412 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1319/2639] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 22:57:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 22:57:23.874421 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f31ef9-9652-4700-b111-d2576a23ee1f None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:23.961086 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f31ef9-9652-4700-b111-d2576a23ee1f None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:23.965603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3379e03-85cb-4d3c-b4aa-cb6a326b7a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:23.966277 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3379e03-85cb-4d3c-b4aa-cb6a326b7a63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:23.966593 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3379e03-85cb-4d3c-b4aa-cb6a326b7a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:23.966872 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3379e03-85cb-4d3c-b4aa-cb6a326b7a63 admin admin] PATH_INFO: `/v3/users/56558eb318e34885b42950391568a2a2` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:23.968294 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3379e03-85cb-4d3c-b4aa-cb6a326b7a63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56558eb318e34885b42950391568a2a2)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:23.970192 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3379e03-85cb-4d3c-b4aa-cb6a326b7a63 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:24.019097 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a3379e03-85cb-4d3c-b4aa-cb6a326b7a63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56558eb318e34885b42950391568a2a2'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:24.020293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a3379e03-85cb-4d3c-b4aa-cb6a326b7a63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56558eb318e34885b42950391568a2a2'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:24.033081 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a3379e03-85cb-4d3c-b4aa-cb6a326b7a63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56558eb318e34885b42950391568a2a2'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:24.041437 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a3379e03-85cb-4d3c-b4aa-cb6a326b7a63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56558eb318e34885b42950391568a2a2'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:24.053658 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-a3379e03-85cb-4d3c-b4aa-cb6a326b7a63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56558eb318e34885b42950391568a2a2'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:24.060048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1321/2640] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:57:23 2022] DELETE /identity/v3/users/56558eb318e34885b42950391568a2a2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:24.064688 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0766b1-1c4b-43a7-99e9-94428a6f3f98 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:24.065205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0766b1-1c4b-43a7-99e9-94428a6f3f98 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:24.065309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0766b1-1c4b-43a7-99e9-94428a6f3f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:24.121468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-4a0766b1-1c4b-43a7-99e9-94428a6f3f98 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:24.122666 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-4a0766b1-1c4b-43a7-99e9-94428a6f3f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:24.212450 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1320/2641] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:57:24.222523 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3379e03-85cb-4d3c-b4aa-cb6a326b7a63 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:24.224177 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a3379e03-85cb-4d3c-b4aa-cb6a326b7a63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:24.256304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:24.305092 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3379e03-85cb-4d3c-b4aa-cb6a326b7a63 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:24.308954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260c15a-4e07-4f49-97a3-d2b5b7175f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:24.309738 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260c15a-4e07-4f49-97a3-d2b5b7175f89 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:24.310092 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260c15a-4e07-4f49-97a3-d2b5b7175f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:24.310463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260c15a-4e07-4f49-97a3-d2b5b7175f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:24.320183 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260c15a-4e07-4f49-97a3-d2b5b7175f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:24.321604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260c15a-4e07-4f49-97a3-d2b5b7175f89 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:24.331266 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1322/2642] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:57:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:57:24.507860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0766b1-1c4b-43a7-99e9-94428a6f3f98 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:24.509409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-4a0766b1-1c4b-43a7-99e9-94428a6f3f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:24.526507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0766b1-1c4b-43a7-99e9-94428a6f3f98 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:24.531981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1e4a4-1281-43b0-b425-88bea8f4be61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:24.532636 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1e4a4-1281-43b0-b425-88bea8f4be61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:24.533045 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1e4a4-1281-43b0-b425-88bea8f4be61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:24.533200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1e4a4-1281-43b0-b425-88bea8f4be61 admin admin] PATH_INFO: `/v3/projects/016aa869bdc648128c71c05daa33998a` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:24.534482 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1e4a4-1281-43b0-b425-88bea8f4be61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=016aa869bdc648128c71c05daa33998a)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:24.541709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac1e4a4-1281-43b0-b425-88bea8f4be61 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:24.594598 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bac1e4a4-1281-43b0-b425-88bea8f4be61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '016aa869bdc648128c71c05daa33998a', 'request_id': 'req-bac1e4a4-1281-43b0-b425-88bea8f4be61'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:24.600981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bac1e4a4-1281-43b0-b425-88bea8f4be61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '016aa869bdc648128c71c05daa33998a', 'request_id': 'req-bac1e4a4-1281-43b0-b425-88bea8f4be61'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:24.607033 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bac1e4a4-1281-43b0-b425-88bea8f4be61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '016aa869bdc648128c71c05daa33998a', 'request_id': 'req-bac1e4a4-1281-43b0-b425-88bea8f4be61'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:24.619744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bac1e4a4-1281-43b0-b425-88bea8f4be61 admin admin] The token cache is being invalidate because project 016aa869bdc648128c71c05daa33998a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:57:24.620033 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bac1e4a4-1281-43b0-b425-88bea8f4be61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:24.620652 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-bac1e4a4-1281-43b0-b425-88bea8f4be61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:24.622165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1321/2643] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:57:24 2022] DELETE /identity/v3/projects/016aa869bdc648128c71c05daa33998a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:26.411746 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260c15a-4e07-4f49-97a3-d2b5b7175f89 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:26.413127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-b260c15a-4e07-4f49-97a3-d2b5b7175f89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:26.424178 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260c15a-4e07-4f49-97a3-d2b5b7175f89 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:26.472062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e254d7-cb77-49a8-962b-a97382c8bf5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:26.473165 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e254d7-cb77-49a8-962b-a97382c8bf5b service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:26.473449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e254d7-cb77-49a8-962b-a97382c8bf5b service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:26.473727 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e254d7-cb77-49a8-962b-a97382c8bf5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:26.475662 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-f4e254d7-cb77-49a8-962b-a97382c8bf5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:26.539244 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e254d7-cb77-49a8-962b-a97382c8bf5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:26.540665 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e254d7-cb77-49a8-962b-a97382c8bf5b service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:26.550158 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1323/2644] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:57:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:57:29.512145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1e4a4-1281-43b0-b425-88bea8f4be61 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:29.514492 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-bac1e4a4-1281-43b0-b425-88bea8f4be61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:29.535390 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:29.583350 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e254d7-cb77-49a8-962b-a97382c8bf5b service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:29.585712 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-f4e254d7-cb77-49a8-962b-a97382c8bf5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:29.601530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e254d7-cb77-49a8-962b-a97382c8bf5b service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:29.608451 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b12023-4379-4ef4-81b1-27c8e32d6990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:29.609095 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b12023-4379-4ef4-81b1-27c8e32d6990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:29.609383 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b12023-4379-4ef4-81b1-27c8e32d6990 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:29.609662 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b12023-4379-4ef4-81b1-27c8e32d6990 admin admin] PATH_INFO: `/v3/users/0de16e13f2f948698e9174fcf1e0a3a8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:29.610879 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b12023-4379-4ef4-81b1-27c8e32d6990 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de16e13f2f948698e9174fcf1e0a3a8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:29.612798 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b12023-4379-4ef4-81b1-27c8e32d6990 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:29.631614 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1e4a4-1281-43b0-b425-88bea8f4be61 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:29.636915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff37208-d1fc-4c1b-af64-83d3585eee7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a1384f3b34999a75572ee10a1e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:29.637544 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff37208-d1fc-4c1b-af64-83d3585eee7c service placement] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:29.637833 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff37208-d1fc-4c1b-af64-83d3585eee7c service placement] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:29.638117 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff37208-d1fc-4c1b-af64-83d3585eee7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:29.640537 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-fff37208-d1fc-4c1b-af64-83d3585eee7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:29.653541 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff37208-d1fc-4c1b-af64-83d3585eee7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:29.655142 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff37208-d1fc-4c1b-af64-83d3585eee7c service placement] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:29.665033 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1322/2645] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:57:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:57:29.665335 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-c7b12023-4379-4ef4-81b1-27c8e32d6990 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de16e13f2f948698e9174fcf1e0a3a8'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:29.666003 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-c7b12023-4379-4ef4-81b1-27c8e32d6990 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de16e13f2f948698e9174fcf1e0a3a8'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:29.671369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:29.680852 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-c7b12023-4379-4ef4-81b1-27c8e32d6990 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de16e13f2f948698e9174fcf1e0a3a8'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:29.687874 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-c7b12023-4379-4ef4-81b1-27c8e32d6990 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de16e13f2f948698e9174fcf1e0a3a8'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:29.696261 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-c7b12023-4379-4ef4-81b1-27c8e32d6990 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de16e13f2f948698e9174fcf1e0a3a8'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:29.702330 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1324/2646] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:57:29 2022] DELETE /identity/v3/users/0de16e13f2f948698e9174fcf1e0a3a8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:29.879743 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff37208-d1fc-4c1b-af64-83d3585eee7c service placement] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:29.903414 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff37208-d1fc-4c1b-af64-83d3585eee7c service placement] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:30.083891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf7ced-dc33-4de0-9ca6-5ec774d115c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:30.084531 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf7ced-dc33-4de0-9ca6-5ec774d115c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:30.085060 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf7ced-dc33-4de0-9ca6-5ec774d115c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:30.085347 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf7ced-dc33-4de0-9ca6-5ec774d115c3 admin admin] PATH_INFO: `/v3/projects/7af9ae6076964b5c8c776085bb1742d5` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:30.086516 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf7ced-dc33-4de0-9ca6-5ec774d115c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7af9ae6076964b5c8c776085bb1742d5)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:30.088436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf7ced-dc33-4de0-9ca6-5ec774d115c3 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:30.133717 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e2cf7ced-dc33-4de0-9ca6-5ec774d115c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7af9ae6076964b5c8c776085bb1742d5', 'request_id': 'req-e2cf7ced-dc33-4de0-9ca6-5ec774d115c3'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:30.139574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e2cf7ced-dc33-4de0-9ca6-5ec774d115c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7af9ae6076964b5c8c776085bb1742d5', 'request_id': 'req-e2cf7ced-dc33-4de0-9ca6-5ec774d115c3'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:30.145001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e2cf7ced-dc33-4de0-9ca6-5ec774d115c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7af9ae6076964b5c8c776085bb1742d5', 'request_id': 'req-e2cf7ced-dc33-4de0-9ca6-5ec774d115c3'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:30.156820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e2cf7ced-dc33-4de0-9ca6-5ec774d115c3 admin admin] The token cache is being invalidate because project 7af9ae6076964b5c8c776085bb1742d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:57:30.157134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e2cf7ced-dc33-4de0-9ca6-5ec774d115c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:30.157761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e2cf7ced-dc33-4de0-9ca6-5ec774d115c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:30.159317 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1323/2647] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:57:29 2022] DELETE /identity/v3/projects/7af9ae6076964b5c8c776085bb1742d5 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:30.164928 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dcf6c-578e-412c-8346-f241ddb1e51d None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:30.165220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dcf6c-578e-412c-8346-f241ddb1e51d None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:30.165502 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35dcf6c-578e-412c-8346-f241ddb1e51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:30.335574 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-d35dcf6c-578e-412c-8346-f241ddb1e51d None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:30.336772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d35dcf6c-578e-412c-8346-f241ddb1e51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:30.399547 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1325/2648] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:30.407785 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67373a-5f94-4436-a310-d23d928537a9 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:30.408014 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67373a-5f94-4436-a310-d23d928537a9 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:30.408291 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67373a-5f94-4436-a310-d23d928537a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:30.428139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-db67373a-5f94-4436-a310-d23d928537a9 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:30.429326 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-db67373a-5f94-4436-a310-d23d928537a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:30.437053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1324/2649] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:30.441243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dcf6c-578e-412c-8346-f241ddb1e51d None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:30.452888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35dcf6c-578e-412c-8346-f241ddb1e51d None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:30.457759 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e44010-bc15-4d85-94e8-d8f95a48e212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:30.458400 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e44010-bc15-4d85-94e8-d8f95a48e212 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:30.458691 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e44010-bc15-4d85-94e8-d8f95a48e212 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:30.458974 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e44010-bc15-4d85-94e8-d8f95a48e212 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:30.459671 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e44010-bc15-4d85-94e8-d8f95a48e212 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:57:30.460232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e44010-bc15-4d85-94e8-d8f95a48e212 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:30.461817 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e44010-bc15-4d85-94e8-d8f95a48e212 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:30.473742 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1326/2650] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:57:30.477960 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67373a-5f94-4436-a310-d23d928537a9 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:30.487065 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67373a-5f94-4436-a310-d23d928537a9 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:30.492264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c8334-32c5-48e4-93c1-6943ec6072c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:30.492871 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c8334-32c5-48e4-93c1-6943ec6072c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:30.493155 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c8334-32c5-48e4-93c1-6943ec6072c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:30.493434 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c8334-32c5-48e4-93c1-6943ec6072c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:30.494094 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c8334-32c5-48e4-93c1-6943ec6072c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:30.496021 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c8334-32c5-48e4-93c1-6943ec6072c4 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:30.500458 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:30.523966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1325/2651] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:57:30 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:57:30.528077 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e44010-bc15-4d85-94e8-d8f95a48e212 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:30.538287 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e44010-bc15-4d85-94e8-d8f95a48e212 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:30.593424 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcfef7-ce33-489d-8e5a-8920c106a824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:30.594108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcfef7-ce33-489d-8e5a-8920c106a824 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:30.594307 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcfef7-ce33-489d-8e5a-8920c106a824 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:30.594615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcfef7-ce33-489d-8e5a-8920c106a824 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:30.595283 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcfef7-ce33-489d-8e5a-8920c106a824 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:30.597178 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcfef7-ce33-489d-8e5a-8920c106a824 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:30.618029 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1327/2652] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:57:30 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:57:30.622126 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c8334-32c5-48e4-93c1-6943ec6072c4 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:30.632339 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c8334-32c5-48e4-93c1-6943ec6072c4 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:30.637216 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b7cc3-bdc9-4302-b3bc-99e37093ef34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:30.637823 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b7cc3-bdc9-4302-b3bc-99e37093ef34 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:30.638109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b7cc3-bdc9-4302-b3bc-99e37093ef34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:30.638424 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b7cc3-bdc9-4302-b3bc-99e37093ef34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:30.639257 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b7cc3-bdc9-4302-b3bc-99e37093ef34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:30.640854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b7cc3-bdc9-4302-b3bc-99e37093ef34 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:30.651003 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1326/2653] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:57:30.654797 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcfef7-ce33-489d-8e5a-8920c106a824 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:30.665088 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcfef7-ce33-489d-8e5a-8920c106a824 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:30.669515 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f2fae5-479a-457c-a04f-1bfdbba43493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:30.670111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2fae5-479a-457c-a04f-1bfdbba43493 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:30.670425 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2fae5-479a-457c-a04f-1bfdbba43493 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:30.670703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f2fae5-479a-457c-a04f-1bfdbba43493 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:30.671394 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2fae5-479a-457c-a04f-1bfdbba43493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:30.672945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f2fae5-479a-457c-a04f-1bfdbba43493 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:30.682552 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1328/2654] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:57:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:57:30.686358 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b7cc3-bdc9-4302-b3bc-99e37093ef34 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:30.696220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b7cc3-bdc9-4302-b3bc-99e37093ef34 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:30.700805 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cf103-4ea3-42e1-94dc-6a5cfd0c2f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:30.701450 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cf103-4ea3-42e1-94dc-6a5cfd0c2f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:30.701831 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cf103-4ea3-42e1-94dc-6a5cfd0c2f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:30.702116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cf103-4ea3-42e1-94dc-6a5cfd0c2f8c admin admin] PATH_INFO: `/v3/projects/f058570240c944d583b61938672aed00/users/2dba574977be4af980d2bb9728dec81d/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:30.717328 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5cf103-4ea3-42e1-94dc-6a5cfd0c2f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f058570240c944d583b61938672aed00, user_id=2dba574977be4af980d2bb9728dec81d, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:30.719974 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5cf103-4ea3-42e1-94dc-6a5cfd0c2f8c admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:30.733552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1327/2655] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:57:30 2022] PUT /identity/v3/projects/f058570240c944d583b61938672aed00/users/2dba574977be4af980d2bb9728dec81d/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:30.744409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97eb3d-77ed-4b4f-a8c6-4dfdc010d736 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:30.744698 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97eb3d-77ed-4b4f-a8c6-4dfdc010d736 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:30.744975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e97eb3d-77ed-4b4f-a8c6-4dfdc010d736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:30.768804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:30.772435 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-8e97eb3d-77ed-4b4f-a8c6-4dfdc010d736 None None] MFA Rules not processed for user `2dba574977be4af980d2bb9728dec81d`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:30.774214 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8e97eb3d-77ed-4b4f-a8c6-4dfdc010d736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:30.839201 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1329/2656] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:30.851055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cf103-4ea3-42e1-94dc-6a5cfd0c2f8c admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:30.852720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-6a5cf103-4ea3-42e1-94dc-6a5cfd0c2f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:30.944022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cf103-4ea3-42e1-94dc-6a5cfd0c2f8c admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:30.949682 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206dd99-42b6-4a8a-9b4c-3b5f7b180c4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:30.950296 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206dd99-42b6-4a8a-9b4c-3b5f7b180c4b service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:30.952000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206dd99-42b6-4a8a-9b4c-3b5f7b180c4b service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:30.952000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206dd99-42b6-4a8a-9b4c-3b5f7b180c4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:30.959721 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206dd99-42b6-4a8a-9b4c-3b5f7b180c4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:30.961541 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6206dd99-42b6-4a8a-9b4c-3b5f7b180c4b service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:30.970350 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1328/2657] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:57:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:57:31.169618 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97eb3d-77ed-4b4f-a8c6-4dfdc010d736 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:31.230722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e97eb3d-77ed-4b4f-a8c6-4dfdc010d736 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:31.235119 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d9ff2-082b-4ea0-b349-a164eb39462f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:31.235761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d9ff2-082b-4ea0-b349-a164eb39462f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:31.236044 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d9ff2-082b-4ea0-b349-a164eb39462f admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:31.236320 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6d9ff2-082b-4ea0-b349-a164eb39462f admin admin] PATH_INFO: `/v3/users/2dba574977be4af980d2bb9728dec81d` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:31.237471 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d9ff2-082b-4ea0-b349-a164eb39462f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dba574977be4af980d2bb9728dec81d)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:31.239424 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6d9ff2-082b-4ea0-b349-a164eb39462f admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:31.283922 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-5e6d9ff2-082b-4ea0-b349-a164eb39462f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dba574977be4af980d2bb9728dec81d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:31.284574 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-5e6d9ff2-082b-4ea0-b349-a164eb39462f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dba574977be4af980d2bb9728dec81d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:31.295991 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-5e6d9ff2-082b-4ea0-b349-a164eb39462f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dba574977be4af980d2bb9728dec81d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:31.303174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-5e6d9ff2-082b-4ea0-b349-a164eb39462f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dba574977be4af980d2bb9728dec81d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:31.310204 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-5e6d9ff2-082b-4ea0-b349-a164eb39462f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dba574977be4af980d2bb9728dec81d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:31.316102 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1330/2658] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:57:31 2022] DELETE /identity/v3/users/2dba574977be4af980d2bb9728dec81d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:31.321176 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2bdd6-eee6-4ec6-a7e7-932605737fb2 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:31.321465 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2bdd6-eee6-4ec6-a7e7-932605737fb2 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:31.321741 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2bdd6-eee6-4ec6-a7e7-932605737fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:31.339990 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-e5f2bdd6-eee6-4ec6-a7e7-932605737fb2 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:31.341168 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e5f2bdd6-eee6-4ec6-a7e7-932605737fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:31.397540 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1329/2659] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:31.407274 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d9ff2-082b-4ea0-b349-a164eb39462f admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:31.408789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-5e6d9ff2-082b-4ea0-b349-a164eb39462f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:31.435485 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:31.468866 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6d9ff2-082b-4ea0-b349-a164eb39462f admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:31.472453 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1027ca50-3d0f-49c1-8130-d8e87b279f0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:31.473066 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027ca50-3d0f-49c1-8130-d8e87b279f0c service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:31.473345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027ca50-3d0f-49c1-8130-d8e87b279f0c service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:31.473683 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1027ca50-3d0f-49c1-8130-d8e87b279f0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:31.482497 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027ca50-3d0f-49c1-8130-d8e87b279f0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:31.483842 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1027ca50-3d0f-49c1-8130-d8e87b279f0c service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:31.493368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1331/2660] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:57:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:57:31.760013 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2bdd6-eee6-4ec6-a7e7-932605737fb2 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:31.761525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-e5f2bdd6-eee6-4ec6-a7e7-932605737fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:31.777937 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2bdd6-eee6-4ec6-a7e7-932605737fb2 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:31.783595 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bc7cd-8db4-494b-a807-14b9418da5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:31.784720 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bc7cd-8db4-494b-a807-14b9418da5f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:31.785539 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bc7cd-8db4-494b-a807-14b9418da5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:31.786000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bc7cd-8db4-494b-a807-14b9418da5f5 admin admin] PATH_INFO: `/v3/projects/f058570240c944d583b61938672aed00` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:31.787280 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bc7cd-8db4-494b-a807-14b9418da5f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f058570240c944d583b61938672aed00)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:31.789212 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bc7cd-8db4-494b-a807-14b9418da5f5 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:31.801860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:31.839538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-6a6bc7cd-8db4-494b-a807-14b9418da5f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f058570240c944d583b61938672aed00', 'request_id': 'req-6a6bc7cd-8db4-494b-a807-14b9418da5f5'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:31.845640 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-6a6bc7cd-8db4-494b-a807-14b9418da5f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f058570240c944d583b61938672aed00', 'request_id': 'req-6a6bc7cd-8db4-494b-a807-14b9418da5f5'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:31.851938 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-6a6bc7cd-8db4-494b-a807-14b9418da5f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f058570240c944d583b61938672aed00', 'request_id': 'req-6a6bc7cd-8db4-494b-a807-14b9418da5f5'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:31.864345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-6a6bc7cd-8db4-494b-a807-14b9418da5f5 admin admin] The token cache is being invalidate because project f058570240c944d583b61938672aed00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:57:31.864635 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-6a6bc7cd-8db4-494b-a807-14b9418da5f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:31.865256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-6a6bc7cd-8db4-494b-a807-14b9418da5f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:31.866783 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1330/2661] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:57:31 2022] DELETE /identity/v3/projects/f058570240c944d583b61938672aed00 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:31.871603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2519bdc-84e1-4958-ae3b-bfeca2657a6c None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:31.872073 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2519bdc-84e1-4958-ae3b-bfeca2657a6c None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:31.872180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2519bdc-84e1-4958-ae3b-bfeca2657a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:31.890647 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-c2519bdc-84e1-4958-ae3b-bfeca2657a6c None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:31.891963 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-c2519bdc-84e1-4958-ae3b-bfeca2657a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:31.949682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1332/2662] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:31.957500 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d620b6f-fb33-4b6a-968b-0174e220cb67 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:31.957782 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d620b6f-fb33-4b6a-968b-0174e220cb67 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:31.958055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d620b6f-fb33-4b6a-968b-0174e220cb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:31.978090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-8d620b6f-fb33-4b6a-968b-0174e220cb67 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:31.979468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8d620b6f-fb33-4b6a-968b-0174e220cb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:31.987361 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1331/2663] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:31.992264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2519bdc-84e1-4958-ae3b-bfeca2657a6c None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:32.001728 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2519bdc-84e1-4958-ae3b-bfeca2657a6c None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:32.006530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52263bf5-9119-4af8-9af5-2b7887d67cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:32.007077 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52263bf5-9119-4af8-9af5-2b7887d67cbf admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:32.007362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52263bf5-9119-4af8-9af5-2b7887d67cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:32.007636 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52263bf5-9119-4af8-9af5-2b7887d67cbf admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:32.008352 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52263bf5-9119-4af8-9af5-2b7887d67cbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:57:32.008658 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52263bf5-9119-4af8-9af5-2b7887d67cbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:32.010229 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52263bf5-9119-4af8-9af5-2b7887d67cbf admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:32.021361 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1333/2664] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:57:32.025404 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d620b6f-fb33-4b6a-968b-0174e220cb67 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:32.034530 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d620b6f-fb33-4b6a-968b-0174e220cb67 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:32.039613 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35a3c7-a594-4d93-9d5b-165e69aa0af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:32.040219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35a3c7-a594-4d93-9d5b-165e69aa0af8 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:32.040502 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35a3c7-a594-4d93-9d5b-165e69aa0af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:32.040803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35a3c7-a594-4d93-9d5b-165e69aa0af8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:32.041457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35a3c7-a594-4d93-9d5b-165e69aa0af8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:32.043373 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35a3c7-a594-4d93-9d5b-165e69aa0af8 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:32.071980 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1332/2665] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:57:32 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:57:32.076096 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52263bf5-9119-4af8-9af5-2b7887d67cbf admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:32.086578 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52263bf5-9119-4af8-9af5-2b7887d67cbf admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:32.146570 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ab221-5114-4dba-9b08-58e6569e78d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:32.147179 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ab221-5114-4dba-9b08-58e6569e78d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:32.147463 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ab221-5114-4dba-9b08-58e6569e78d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:32.147739 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84ab221-5114-4dba-9b08-58e6569e78d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:32.148398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ab221-5114-4dba-9b08-58e6569e78d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:32.150279 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84ab221-5114-4dba-9b08-58e6569e78d9 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:32.171092 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1334/2666] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:57:32 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:57:32.175181 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35a3c7-a594-4d93-9d5b-165e69aa0af8 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:32.185203 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35a3c7-a594-4d93-9d5b-165e69aa0af8 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:32.189708 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16797b30-8229-434d-af9c-ed796141cf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:32.190310 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16797b30-8229-434d-af9c-ed796141cf7f admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:32.190620 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16797b30-8229-434d-af9c-ed796141cf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:32.190896 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16797b30-8229-434d-af9c-ed796141cf7f admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:32.191615 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16797b30-8229-434d-af9c-ed796141cf7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:32.193191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16797b30-8229-434d-af9c-ed796141cf7f admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:32.203314 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1333/2667] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:57:32.207356 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ab221-5114-4dba-9b08-58e6569e78d9 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:32.217428 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84ab221-5114-4dba-9b08-58e6569e78d9 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:32.221990 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa59ed-8327-48d7-969f-68b532fa12a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:32.223219 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa59ed-8327-48d7-969f-68b532fa12a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:32.223503 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa59ed-8327-48d7-969f-68b532fa12a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:32.223776 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa59ed-8327-48d7-969f-68b532fa12a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:32.224458 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa59ed-8327-48d7-969f-68b532fa12a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:32.226018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aa59ed-8327-48d7-969f-68b532fa12a9 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:32.236085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1335/2668] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:57:32.240293 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16797b30-8229-434d-af9c-ed796141cf7f admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:32.249931 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16797b30-8229-434d-af9c-ed796141cf7f admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:32.254545 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395dc0c-6ba5-42c1-bc4c-36b4d15fbfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:32.255202 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395dc0c-6ba5-42c1-bc4c-36b4d15fbfea admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:32.255486 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395dc0c-6ba5-42c1-bc4c-36b4d15fbfea admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:32.255772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395dc0c-6ba5-42c1-bc4c-36b4d15fbfea admin admin] PATH_INFO: `/v3/projects/c737b7620d69474c9ca9c8bf7ee46969/users/9c4a9fd5304e4d6f83487cda2ff8c940/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:32.270482 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395dc0c-6ba5-42c1-bc4c-36b4d15fbfea admin admin] RBAC: Authorizing `identity:create_grant(project_id=c737b7620d69474c9ca9c8bf7ee46969, user_id=9c4a9fd5304e4d6f83487cda2ff8c940, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:32.273049 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395dc0c-6ba5-42c1-bc4c-36b4d15fbfea admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:32.286223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1334/2669] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:57:32 2022] PUT /identity/v3/projects/c737b7620d69474c9ca9c8bf7ee46969/users/9c4a9fd5304e4d6f83487cda2ff8c940/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:32.296419 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd546b6c-0cc1-41d8-89c2-643287e2819d None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:32.296706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd546b6c-0cc1-41d8-89c2-643287e2819d None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:32.296982 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd546b6c-0cc1-41d8-89c2-643287e2819d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:32.324357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-dd546b6c-0cc1-41d8-89c2-643287e2819d None None] MFA Rules not processed for user `9c4a9fd5304e4d6f83487cda2ff8c940`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:32.325572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-dd546b6c-0cc1-41d8-89c2-643287e2819d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:32.344183 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:32.389718 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1336/2670] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:32 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:32.394690 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395dc0c-6ba5-42c1-bc4c-36b4d15fbfea admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:32.454980 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395dc0c-6ba5-42c1-bc4c-36b4d15fbfea admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:32.460762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c28b3a-770d-4968-b88d-bb7e1e6bdf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:32.461406 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c28b3a-770d-4968-b88d-bb7e1e6bdf74 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:32.461715 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c28b3a-770d-4968-b88d-bb7e1e6bdf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:32.461989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c28b3a-770d-4968-b88d-bb7e1e6bdf74 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:32.462711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c28b3a-770d-4968-b88d-bb7e1e6bdf74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:32.464610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c28b3a-770d-4968-b88d-bb7e1e6bdf74 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:32.491161 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1335/2671] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:57:32 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:57:32.495166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd546b6c-0cc1-41d8-89c2-643287e2819d None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:32.505752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd546b6c-0cc1-41d8-89c2-643287e2819d None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:32.559821 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100baf9-12a7-49bd-bd89-bf68eb5d5be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:32.560372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100baf9-12a7-49bd-bd89-bf68eb5d5be1 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:32.560653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100baf9-12a7-49bd-bd89-bf68eb5d5be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:32.560927 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c100baf9-12a7-49bd-bd89-bf68eb5d5be1 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:32.561585 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100baf9-12a7-49bd-bd89-bf68eb5d5be1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:32.563510 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c100baf9-12a7-49bd-bd89-bf68eb5d5be1 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:32.584326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1337/2672] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:57:32 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:57:32.588608 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c28b3a-770d-4968-b88d-bb7e1e6bdf74 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:32.599252 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c28b3a-770d-4968-b88d-bb7e1e6bdf74 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:32.604055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3428fd-ec0d-49de-9074-139d93f5bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:32.604674 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3428fd-ec0d-49de-9074-139d93f5bcfc admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:32.605321 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3428fd-ec0d-49de-9074-139d93f5bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:32.605321 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3428fd-ec0d-49de-9074-139d93f5bcfc admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:32.605901 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3428fd-ec0d-49de-9074-139d93f5bcfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:32.607552 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3428fd-ec0d-49de-9074-139d93f5bcfc admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:32.618707 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1336/2673] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:57:32.622906 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100baf9-12a7-49bd-bd89-bf68eb5d5be1 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:32.632647 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c100baf9-12a7-49bd-bd89-bf68eb5d5be1 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:32.637181 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf08180-5792-4e29-8a1c-cae96feffd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:32.637832 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf08180-5792-4e29-8a1c-cae96feffd20 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:32.638113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf08180-5792-4e29-8a1c-cae96feffd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:32.638411 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf08180-5792-4e29-8a1c-cae96feffd20 admin admin] PATH_INFO: `/v3/projects/d11caf1fdf784a9daca1f3b85c1058f0/users/0a480fa57c1e4791914e0f619f3b1747/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:32.652462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf08180-5792-4e29-8a1c-cae96feffd20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11caf1fdf784a9daca1f3b85c1058f0, user_id=0a480fa57c1e4791914e0f619f3b1747, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:32.655083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf08180-5792-4e29-8a1c-cae96feffd20 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:32.668405 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1338/2674] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:57:32 2022] PUT /identity/v3/projects/d11caf1fdf784a9daca1f3b85c1058f0/users/0a480fa57c1e4791914e0f619f3b1747/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:32.672241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3428fd-ec0d-49de-9074-139d93f5bcfc admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:32.682687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3428fd-ec0d-49de-9074-139d93f5bcfc admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:32.687224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:32.739997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ced65-3334-4a88-8049-e4e07f0dfa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:32.740613 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ced65-3334-4a88-8049-e4e07f0dfa06 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:32.740895 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ced65-3334-4a88-8049-e4e07f0dfa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:32.741172 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ced65-3334-4a88-8049-e4e07f0dfa06 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:32.741861 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ced65-3334-4a88-8049-e4e07f0dfa06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:32.743473 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ced65-3334-4a88-8049-e4e07f0dfa06 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:32.752884 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1337/2675] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:57:32 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:57:32.757145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf08180-5792-4e29-8a1c-cae96feffd20 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:32.767168 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf08180-5792-4e29-8a1c-cae96feffd20 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:32.771740 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c2fdc-4209-4e0b-9672-851b76d65ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:32.772398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c2fdc-4209-4e0b-9672-851b76d65ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:32.772678 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c2fdc-4209-4e0b-9672-851b76d65ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:32.772954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037c2fdc-4209-4e0b-9672-851b76d65ba2 admin admin] PATH_INFO: `/v3/projects/d11caf1fdf784a9daca1f3b85c1058f0/users/0a480fa57c1e4791914e0f619f3b1747/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:32.774909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c2fdc-4209-4e0b-9672-851b76d65ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d11caf1fdf784a9daca1f3b85c1058f0, user_id=0a480fa57c1e4791914e0f619f3b1747, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:32.777482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037c2fdc-4209-4e0b-9672-851b76d65ba2 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:32.787888 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1339/2676] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:57:32 2022] PUT /identity/v3/projects/d11caf1fdf784a9daca1f3b85c1058f0/users/0a480fa57c1e4791914e0f619f3b1747/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:32.799137 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e5346-68d0-488f-9a04-a1f460b02d30 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:32.799610 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e5346-68d0-488f-9a04-a1f460b02d30 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:32.799728 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2e5346-68d0-488f-9a04-a1f460b02d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:32.827758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-8d2e5346-68d0-488f-9a04-a1f460b02d30 None None] MFA Rules not processed for user `0a480fa57c1e4791914e0f619f3b1747`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:32.828885 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-8d2e5346-68d0-488f-9a04-a1f460b02d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:32.893537 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1338/2677] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:32.904798 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c2fdc-4209-4e0b-9672-851b76d65ba2 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:32.906615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-037c2fdc-4209-4e0b-9672-851b76d65ba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:32.983425 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037c2fdc-4209-4e0b-9672-851b76d65ba2 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:32.987047 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee8006-2483-411f-9d9e-d2e5142862fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:32.987653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee8006-2483-411f-9d9e-d2e5142862fd service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:32.987964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee8006-2483-411f-9d9e-d2e5142862fd service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:32.988240 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee8006-2483-411f-9d9e-d2e5142862fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:32.994960 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:32.997357 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee8006-2483-411f-9d9e-d2e5142862fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:32.999591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fee8006-2483-411f-9d9e-d2e5142862fd service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:33.009106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1340/2678] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:57:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:57:34.317830 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e5346-68d0-488f-9a04-a1f460b02d30 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:34.377667 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2e5346-68d0-488f-9a04-a1f460b02d30 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:34.382907 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532cd22-38ef-4a10-b2d5-c6d58205a7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:34.383566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532cd22-38ef-4a10-b2d5-c6d58205a7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:34.383832 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532cd22-38ef-4a10-b2d5-c6d58205a7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:34.384109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c532cd22-38ef-4a10-b2d5-c6d58205a7bd admin admin] PATH_INFO: `/v3/users/9c4a9fd5304e4d6f83487cda2ff8c940` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:34.385264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532cd22-38ef-4a10-b2d5-c6d58205a7bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c4a9fd5304e4d6f83487cda2ff8c940)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:34.387242 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c532cd22-38ef-4a10-b2d5-c6d58205a7bd admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:34.420166 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:34.433314 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c532cd22-38ef-4a10-b2d5-c6d58205a7bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c4a9fd5304e4d6f83487cda2ff8c940'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:34.433989 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c532cd22-38ef-4a10-b2d5-c6d58205a7bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c4a9fd5304e4d6f83487cda2ff8c940'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:34.440927 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c532cd22-38ef-4a10-b2d5-c6d58205a7bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c4a9fd5304e4d6f83487cda2ff8c940'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:34.453514 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c532cd22-38ef-4a10-b2d5-c6d58205a7bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c4a9fd5304e4d6f83487cda2ff8c940'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:34.454173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c532cd22-38ef-4a10-b2d5-c6d58205a7bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c4a9fd5304e4d6f83487cda2ff8c940'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:34.466146 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1339/2679] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:57:34 2022] DELETE /identity/v3/users/9c4a9fd5304e4d6f83487cda2ff8c940 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:34.470592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18023896-d14e-475a-85a2-eee762f4ba1d None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:34.471062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18023896-d14e-475a-85a2-eee762f4ba1d None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:34.471161 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18023896-d14e-475a-85a2-eee762f4ba1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:34.489650 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-18023896-d14e-475a-85a2-eee762f4ba1d None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:34.490870 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-18023896-d14e-475a-85a2-eee762f4ba1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:34.547317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1341/2680] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:34.557293 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532cd22-38ef-4a10-b2d5-c6d58205a7bd admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:34.558709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c532cd22-38ef-4a10-b2d5-c6d58205a7bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:34.614939 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c532cd22-38ef-4a10-b2d5-c6d58205a7bd admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:34.618572 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2412a4-2d6d-4406-902c-457a6c01d829 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:34.619190 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2412a4-2d6d-4406-902c-457a6c01d829 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:34.619474 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2412a4-2d6d-4406-902c-457a6c01d829 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:34.619751 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2412a4-2d6d-4406-902c-457a6c01d829 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:34.629849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2412a4-2d6d-4406-902c-457a6c01d829 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:34.631256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2412a4-2d6d-4406-902c-457a6c01d829 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:34.640708 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1340/2681] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:57:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:57:34.901722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18023896-d14e-475a-85a2-eee762f4ba1d None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:34.903630 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-18023896-d14e-475a-85a2-eee762f4ba1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:34.919749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18023896-d14e-475a-85a2-eee762f4ba1d None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:34.924498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b2e8e-1d0a-4c21-86c1-e782ff85ef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:34.925039 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b2e8e-1d0a-4c21-86c1-e782ff85ef90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:34.925384 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b2e8e-1d0a-4c21-86c1-e782ff85ef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:34.926195 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b2e8e-1d0a-4c21-86c1-e782ff85ef90 admin admin] PATH_INFO: `/v3/projects/c737b7620d69474c9ca9c8bf7ee46969` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:34.927481 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b2e8e-1d0a-4c21-86c1-e782ff85ef90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c737b7620d69474c9ca9c8bf7ee46969)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:34.929278 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b2e8e-1d0a-4c21-86c1-e782ff85ef90 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:34.974398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-c50b2e8e-1d0a-4c21-86c1-e782ff85ef90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c737b7620d69474c9ca9c8bf7ee46969', 'request_id': 'req-c50b2e8e-1d0a-4c21-86c1-e782ff85ef90'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:34.979787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-c50b2e8e-1d0a-4c21-86c1-e782ff85ef90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c737b7620d69474c9ca9c8bf7ee46969', 'request_id': 'req-c50b2e8e-1d0a-4c21-86c1-e782ff85ef90'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:34.988716 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-c50b2e8e-1d0a-4c21-86c1-e782ff85ef90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c737b7620d69474c9ca9c8bf7ee46969', 'request_id': 'req-c50b2e8e-1d0a-4c21-86c1-e782ff85ef90'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:34.999317 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-c50b2e8e-1d0a-4c21-86c1-e782ff85ef90 admin admin] The token cache is being invalidate because project c737b7620d69474c9ca9c8bf7ee46969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:57:34.999609 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-c50b2e8e-1d0a-4c21-86c1-e782ff85ef90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:35.000237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-c50b2e8e-1d0a-4c21-86c1-e782ff85ef90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:35.001700 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1342/2682] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:57:34 2022] DELETE /identity/v3/projects/c737b7620d69474c9ca9c8bf7ee46969 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:35.006239 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2412a4-2d6d-4406-902c-457a6c01d829 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:35.015801 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2412a4-2d6d-4406-902c-457a6c01d829 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:35.071919 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b000542-b6e9-4ff2-ab29-0b34955c3d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:35.072568 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b000542-b6e9-4ff2-ab29-0b34955c3d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:35.072852 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b000542-b6e9-4ff2-ab29-0b34955c3d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:35.073134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b000542-b6e9-4ff2-ab29-0b34955c3d66 admin admin] PATH_INFO: `/v3/users/0a480fa57c1e4791914e0f619f3b1747` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:35.074285 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b000542-b6e9-4ff2-ab29-0b34955c3d66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a480fa57c1e4791914e0f619f3b1747)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:35.076222 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b000542-b6e9-4ff2-ab29-0b34955c3d66 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:35.120741 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-9b000542-b6e9-4ff2-ab29-0b34955c3d66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a480fa57c1e4791914e0f619f3b1747'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:35.121387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-9b000542-b6e9-4ff2-ab29-0b34955c3d66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a480fa57c1e4791914e0f619f3b1747'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:35.128115 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-9b000542-b6e9-4ff2-ab29-0b34955c3d66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a480fa57c1e4791914e0f619f3b1747'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:35.129535 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:35.143019 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-9b000542-b6e9-4ff2-ab29-0b34955c3d66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a480fa57c1e4791914e0f619f3b1747'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:35.143640 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-9b000542-b6e9-4ff2-ab29-0b34955c3d66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a480fa57c1e4791914e0f619f3b1747'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:35.156087 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1341/2683] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:57:35 2022] DELETE /identity/v3/users/0a480fa57c1e4791914e0f619f3b1747 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:35.419942 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b2e8e-1d0a-4c21-86c1-e782ff85ef90 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:35.421945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-c50b2e8e-1d0a-4c21-86c1-e782ff85ef90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:35.444429 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b2e8e-1d0a-4c21-86c1-e782ff85ef90 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:35.504174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90e7c5-c0cc-4ff6-9f1a-11d62f726d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:35.504859 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90e7c5-c0cc-4ff6-9f1a-11d62f726d66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:35.505098 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90e7c5-c0cc-4ff6-9f1a-11d62f726d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:35.505377 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90e7c5-c0cc-4ff6-9f1a-11d62f726d66 admin admin] PATH_INFO: `/v3/projects/d11caf1fdf784a9daca1f3b85c1058f0` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:35.506560 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90e7c5-c0cc-4ff6-9f1a-11d62f726d66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d11caf1fdf784a9daca1f3b85c1058f0)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:35.508648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90e7c5-c0cc-4ff6-9f1a-11d62f726d66 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:35.531342 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:35.554574 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7b90e7c5-c0cc-4ff6-9f1a-11d62f726d66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd11caf1fdf784a9daca1f3b85c1058f0', 'request_id': 'req-7b90e7c5-c0cc-4ff6-9f1a-11d62f726d66'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:35.559976 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7b90e7c5-c0cc-4ff6-9f1a-11d62f726d66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd11caf1fdf784a9daca1f3b85c1058f0', 'request_id': 'req-7b90e7c5-c0cc-4ff6-9f1a-11d62f726d66'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:35.569486 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7b90e7c5-c0cc-4ff6-9f1a-11d62f726d66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd11caf1fdf784a9daca1f3b85c1058f0', 'request_id': 'req-7b90e7c5-c0cc-4ff6-9f1a-11d62f726d66'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:35.582655 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7b90e7c5-c0cc-4ff6-9f1a-11d62f726d66 admin admin] The token cache is being invalidate because project d11caf1fdf784a9daca1f3b85c1058f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:57:35.582943 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7b90e7c5-c0cc-4ff6-9f1a-11d62f726d66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:35.583600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7b90e7c5-c0cc-4ff6-9f1a-11d62f726d66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:35.585410 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1343/2684] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:57:35 2022] DELETE /identity/v3/projects/d11caf1fdf784a9daca1f3b85c1058f0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:35.590264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115afa4-b529-422e-b277-6d8356b2db93 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:35.590754 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115afa4-b529-422e-b277-6d8356b2db93 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:35.591588 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115afa4-b529-422e-b277-6d8356b2db93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:35.613921 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-0115afa4-b529-422e-b277-6d8356b2db93 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:35.615189 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-0115afa4-b529-422e-b277-6d8356b2db93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:35.672569 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1342/2685] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:35.680280 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a59a2-6cd8-4080-acb8-ac67fe73c991 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:35.680575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a59a2-6cd8-4080-acb8-ac67fe73c991 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:35.680855 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30a59a2-6cd8-4080-acb8-ac67fe73c991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:35.700783 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-e30a59a2-6cd8-4080-acb8-ac67fe73c991 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:35.701974 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e30a59a2-6cd8-4080-acb8-ac67fe73c991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:35.710692 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1344/2686] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:35.714794 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115afa4-b529-422e-b277-6d8356b2db93 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:35.724356 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115afa4-b529-422e-b277-6d8356b2db93 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:35.728922 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534a454-19e7-479f-a9b8-a1425805f8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:35.729526 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a454-19e7-479f-a9b8-a1425805f8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:35.729810 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a454-19e7-479f-a9b8-a1425805f8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:35.730085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a454-19e7-479f-a9b8-a1425805f8b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:35.730816 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534a454-19e7-479f-a9b8-a1425805f8b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:57:35.731121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534a454-19e7-479f-a9b8-a1425805f8b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:35.732698 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534a454-19e7-479f-a9b8-a1425805f8b9 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:35.743964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1343/2687] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:57:35.748113 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a59a2-6cd8-4080-acb8-ac67fe73c991 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:35.757829 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30a59a2-6cd8-4080-acb8-ac67fe73c991 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:35.762497 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27a399-cb06-4559-bd73-a72cc714a9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:35.763106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a399-cb06-4559-bd73-a72cc714a9bd admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:35.763391 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a399-cb06-4559-bd73-a72cc714a9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:35.763669 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca27a399-cb06-4559-bd73-a72cc714a9bd admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:35.764326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27a399-cb06-4559-bd73-a72cc714a9bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:35.766261 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca27a399-cb06-4559-bd73-a72cc714a9bd admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:35.792849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1345/2688] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:57:35 2022] POST /identity/v3/projects => generated 387 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:57:35.796891 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534a454-19e7-479f-a9b8-a1425805f8b9 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:35.807620 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534a454-19e7-479f-a9b8-a1425805f8b9 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:35.860898 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab863cb-c5ef-46f6-b45e-8f93a13cf053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:35.861520 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab863cb-c5ef-46f6-b45e-8f93a13cf053 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:35.861808 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab863cb-c5ef-46f6-b45e-8f93a13cf053 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:35.862088 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab863cb-c5ef-46f6-b45e-8f93a13cf053 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:35.863303 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab863cb-c5ef-46f6-b45e-8f93a13cf053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:35.865213 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab863cb-c5ef-46f6-b45e-8f93a13cf053 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:35.886566 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1344/2689] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:57:35 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:57:35.890750 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27a399-cb06-4559-bd73-a72cc714a9bd admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:35.900769 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca27a399-cb06-4559-bd73-a72cc714a9bd admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:35.905292 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cf307-5853-43b9-9ce4-284820566d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:35.905897 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cf307-5853-43b9-9ce4-284820566d42 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:35.906183 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cf307-5853-43b9-9ce4-284820566d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:35.906507 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426cf307-5853-43b9-9ce4-284820566d42 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:35.907205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cf307-5853-43b9-9ce4-284820566d42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:35.908775 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426cf307-5853-43b9-9ce4-284820566d42 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:35.918403 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1346/2690] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:57:35.922219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab863cb-c5ef-46f6-b45e-8f93a13cf053 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:35.932606 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab863cb-c5ef-46f6-b45e-8f93a13cf053 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:35.948591 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb92e99-2813-40a4-958f-53fc450efc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:35.949814 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb92e99-2813-40a4-958f-53fc450efc39 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:35.950526 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb92e99-2813-40a4-958f-53fc450efc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:35.951143 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb92e99-2813-40a4-958f-53fc450efc39 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:35.952235 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb92e99-2813-40a4-958f-53fc450efc39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:35.954174 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb92e99-2813-40a4-958f-53fc450efc39 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:35.969424 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1345/2691] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:57:35.973609 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cf307-5853-43b9-9ce4-284820566d42 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:35.983596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426cf307-5853-43b9-9ce4-284820566d42 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:35.988610 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a9f6f-3a1d-4456-baa8-c5366f92630e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:35.989265 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a9f6f-3a1d-4456-baa8-c5366f92630e admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:35.989549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a9f6f-3a1d-4456-baa8-c5366f92630e admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:35.989828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a9f6f-3a1d-4456-baa8-c5366f92630e admin admin] PATH_INFO: `/v3/projects/99dedf2e7dc74f69a700a403c54e2e12/users/ced91d4dd5ea4cf7aca6b04cddf8dc01/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:36.004497 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a9f6f-3a1d-4456-baa8-c5366f92630e admin admin] RBAC: Authorizing `identity:create_grant(project_id=99dedf2e7dc74f69a700a403c54e2e12, user_id=ced91d4dd5ea4cf7aca6b04cddf8dc01, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:36.007164 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a9f6f-3a1d-4456-baa8-c5366f92630e admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:36.019707 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1347/2692] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:57:35 2022] PUT /identity/v3/projects/99dedf2e7dc74f69a700a403c54e2e12/users/ced91d4dd5ea4cf7aca6b04cddf8dc01/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:36.031081 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9c9ea-e8cc-4518-8166-cad9eba7114e None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:36.031399 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9c9ea-e8cc-4518-8166-cad9eba7114e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:36.031678 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc9c9ea-e8cc-4518-8166-cad9eba7114e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:36.059105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-ddc9c9ea-e8cc-4518-8166-cad9eba7114e None None] MFA Rules not processed for user `ced91d4dd5ea4cf7aca6b04cddf8dc01`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:36.060314 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ddc9c9ea-e8cc-4518-8166-cad9eba7114e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:36.086465 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:36.130679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1346/2693] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:36.135290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a9f6f-3a1d-4456-baa8-c5366f92630e admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:36.195876 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a9f6f-3a1d-4456-baa8-c5366f92630e admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:36.200399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33795e9c-a2fe-45a4-82a9-3b9462c3b67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:36.201035 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33795e9c-a2fe-45a4-82a9-3b9462c3b67a admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:36.201329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33795e9c-a2fe-45a4-82a9-3b9462c3b67a admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:36.201607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33795e9c-a2fe-45a4-82a9-3b9462c3b67a admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:36.202275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33795e9c-a2fe-45a4-82a9-3b9462c3b67a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:36.204173 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33795e9c-a2fe-45a4-82a9-3b9462c3b67a admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:36.230846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1348/2694] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:57:36 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:57:36.234977 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9c9ea-e8cc-4518-8166-cad9eba7114e None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:36.246808 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc9c9ea-e8cc-4518-8166-cad9eba7114e None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:36.307400 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388de433-1dbc-4112-bb53-2220621f9fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:36.308048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388de433-1dbc-4112-bb53-2220621f9fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:36.308334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388de433-1dbc-4112-bb53-2220621f9fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:36.308614 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388de433-1dbc-4112-bb53-2220621f9fc4 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:36.309276 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388de433-1dbc-4112-bb53-2220621f9fc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:36.311208 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388de433-1dbc-4112-bb53-2220621f9fc4 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:36.331502 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1347/2695] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:57:36 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:57:36.335754 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33795e9c-a2fe-45a4-82a9-3b9462c3b67a admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:36.345832 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33795e9c-a2fe-45a4-82a9-3b9462c3b67a admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:36.350929 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f70795-aa5f-4dd2-9483-f3adc799aba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:36.351540 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f70795-aa5f-4dd2-9483-f3adc799aba6 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:36.351827 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f70795-aa5f-4dd2-9483-f3adc799aba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:36.352107 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f70795-aa5f-4dd2-9483-f3adc799aba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:36.352797 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f70795-aa5f-4dd2-9483-f3adc799aba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:36.354401 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f70795-aa5f-4dd2-9483-f3adc799aba6 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:36.365673 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1349/2696] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:57:36.369476 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388de433-1dbc-4112-bb53-2220621f9fc4 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:36.379234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388de433-1dbc-4112-bb53-2220621f9fc4 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:36.383807 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e8b88-6339-474a-b2e2-846dd5b92de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:36.384456 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e8b88-6339-474a-b2e2-846dd5b92de9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:36.384742 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e8b88-6339-474a-b2e2-846dd5b92de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:36.385023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e8b88-6339-474a-b2e2-846dd5b92de9 admin admin] PATH_INFO: `/v3/projects/3f46d4ec3f2b4c589024026ef64d00e9/users/2149154cc4d34d3d989d04a2dde9cd4f/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:36.399541 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e8b88-6339-474a-b2e2-846dd5b92de9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f46d4ec3f2b4c589024026ef64d00e9, user_id=2149154cc4d34d3d989d04a2dde9cd4f, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:36.402157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e8b88-6339-474a-b2e2-846dd5b92de9 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:36.415359 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1348/2697] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:57:36 2022] PUT /identity/v3/projects/3f46d4ec3f2b4c589024026ef64d00e9/users/2149154cc4d34d3d989d04a2dde9cd4f/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:57:36.419249 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f70795-aa5f-4dd2-9483-f3adc799aba6 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:36.429781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f70795-aa5f-4dd2-9483-f3adc799aba6 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:36.446083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:36.487645 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a2bf6-55ad-4915-9b41-c6d1ad1e3cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:36.488865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a2bf6-55ad-4915-9b41-c6d1ad1e3cbe admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:36.489152 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a2bf6-55ad-4915-9b41-c6d1ad1e3cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:36.489428 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a2bf6-55ad-4915-9b41-c6d1ad1e3cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:36.490111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a2bf6-55ad-4915-9b41-c6d1ad1e3cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:36.491726 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a2bf6-55ad-4915-9b41-c6d1ad1e3cbe admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:36.501088 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1350/2698] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:57:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:57:36.505227 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e8b88-6339-474a-b2e2-846dd5b92de9 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:36.515365 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e8b88-6339-474a-b2e2-846dd5b92de9 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:36.520949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df1835-625a-4a08-8548-f020fe232711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:36.521618 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df1835-625a-4a08-8548-f020fe232711 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:36.521903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df1835-625a-4a08-8548-f020fe232711 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:36.522183 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df1835-625a-4a08-8548-f020fe232711 admin admin] PATH_INFO: `/v3/projects/3f46d4ec3f2b4c589024026ef64d00e9/users/2149154cc4d34d3d989d04a2dde9cd4f/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:36.524264 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df1835-625a-4a08-8548-f020fe232711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f46d4ec3f2b4c589024026ef64d00e9, user_id=2149154cc4d34d3d989d04a2dde9cd4f, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:36.526935 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df1835-625a-4a08-8548-f020fe232711 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:36.539084 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1349/2699] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:57:36 2022] PUT /identity/v3/projects/3f46d4ec3f2b4c589024026ef64d00e9/users/2149154cc4d34d3d989d04a2dde9cd4f/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:36.549268 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92903bb-b1b1-49a6-baa0-1c3369ad05c0 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:36.549808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92903bb-b1b1-49a6-baa0-1c3369ad05c0 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:36.549808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92903bb-b1b1-49a6-baa0-1c3369ad05c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:36.577822 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-a92903bb-b1b1-49a6-baa0-1c3369ad05c0 None None] MFA Rules not processed for user `2149154cc4d34d3d989d04a2dde9cd4f`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:36.579059 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a92903bb-b1b1-49a6-baa0-1c3369ad05c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:36.649045 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1351/2700] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:36.660936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df1835-625a-4a08-8548-f020fe232711 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:36.662742 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d8df1835-625a-4a08-8548-f020fe232711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:36.717798 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df1835-625a-4a08-8548-f020fe232711 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:36.721623 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1a2e2-5729-443a-b0ae-a3320bf2baaf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:36.722901 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1a2e2-5729-443a-b0ae-a3320bf2baaf service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:36.723188 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1a2e2-5729-443a-b0ae-a3320bf2baaf service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:36.723472 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1a2e2-5729-443a-b0ae-a3320bf2baaf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:36.732410 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1a2e2-5729-443a-b0ae-a3320bf2baaf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:36.733817 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1a2e2-5729-443a-b0ae-a3320bf2baaf service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:36.743022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1350/2701] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:57:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:57:36.771174 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92903bb-b1b1-49a6-baa0-1c3369ad05c0 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:36.830589 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92903bb-b1b1-49a6-baa0-1c3369ad05c0 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:36.836018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fee44-eb9b-44ef-8d09-3c1db2633a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:36.836822 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fee44-eb9b-44ef-8d09-3c1db2633a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:36.837116 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fee44-eb9b-44ef-8d09-3c1db2633a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:36.837404 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254fee44-eb9b-44ef-8d09-3c1db2633a4f admin admin] PATH_INFO: `/v3/users/ced91d4dd5ea4cf7aca6b04cddf8dc01` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:36.838607 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254fee44-eb9b-44ef-8d09-3c1db2633a4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ced91d4dd5ea4cf7aca6b04cddf8dc01)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:36.840551 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254fee44-eb9b-44ef-8d09-3c1db2633a4f admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:36.882938 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:36.885834 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-254fee44-eb9b-44ef-8d09-3c1db2633a4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ced91d4dd5ea4cf7aca6b04cddf8dc01'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:36.886988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-254fee44-eb9b-44ef-8d09-3c1db2633a4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ced91d4dd5ea4cf7aca6b04cddf8dc01'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:36.900140 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-254fee44-eb9b-44ef-8d09-3c1db2633a4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ced91d4dd5ea4cf7aca6b04cddf8dc01'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:36.907498 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-254fee44-eb9b-44ef-8d09-3c1db2633a4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ced91d4dd5ea4cf7aca6b04cddf8dc01'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:36.920040 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-254fee44-eb9b-44ef-8d09-3c1db2633a4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ced91d4dd5ea4cf7aca6b04cddf8dc01'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:36.928223 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1352/2702] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:57:36 2022] DELETE /identity/v3/users/ced91d4dd5ea4cf7aca6b04cddf8dc01 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:36.932711 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922aac0-d1ff-423e-89c3-5bf7091226df None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:36.933001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922aac0-d1ff-423e-89c3-5bf7091226df None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:36.933282 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9922aac0-d1ff-423e-89c3-5bf7091226df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:36.952047 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-9922aac0-d1ff-423e-89c3-5bf7091226df None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:36.953236 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-9922aac0-d1ff-423e-89c3-5bf7091226df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:36.970406 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:37.014789 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1351/2703] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:37.024908 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fee44-eb9b-44ef-8d09-3c1db2633a4f admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:37.026275 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-254fee44-eb9b-44ef-8d09-3c1db2633a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:37.083591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254fee44-eb9b-44ef-8d09-3c1db2633a4f admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:37.087454 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c2b2e-6f37-4a74-9c8a-c9208f754951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:37.088069 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c2b2e-6f37-4a74-9c8a-c9208f754951 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:37.088352 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c2b2e-6f37-4a74-9c8a-c9208f754951 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:37.088629 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140c2b2e-6f37-4a74-9c8a-c9208f754951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:37.097375 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c2b2e-6f37-4a74-9c8a-c9208f754951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:37.098804 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140c2b2e-6f37-4a74-9c8a-c9208f754951 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:37.107955 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1353/2704] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:57:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:57:37.382602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922aac0-d1ff-423e-89c3-5bf7091226df None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:37.384344 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-9922aac0-d1ff-423e-89c3-5bf7091226df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:37.401575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9922aac0-d1ff-423e-89c3-5bf7091226df None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:37.406542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb8dd3-97dc-400d-a178-bfb488986ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:37.407709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb8dd3-97dc-400d-a178-bfb488986ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:37.408034 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb8dd3-97dc-400d-a178-bfb488986ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:37.408427 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb8dd3-97dc-400d-a178-bfb488986ae3 admin admin] PATH_INFO: `/v3/projects/99dedf2e7dc74f69a700a403c54e2e12` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:37.409969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb8dd3-97dc-400d-a178-bfb488986ae3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99dedf2e7dc74f69a700a403c54e2e12)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:37.411962 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb8dd3-97dc-400d-a178-bfb488986ae3 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:37.460853 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-a6eb8dd3-97dc-400d-a178-bfb488986ae3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99dedf2e7dc74f69a700a403c54e2e12', 'request_id': 'req-a6eb8dd3-97dc-400d-a178-bfb488986ae3'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:37.466982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-a6eb8dd3-97dc-400d-a178-bfb488986ae3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99dedf2e7dc74f69a700a403c54e2e12', 'request_id': 'req-a6eb8dd3-97dc-400d-a178-bfb488986ae3'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:37.472584 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-a6eb8dd3-97dc-400d-a178-bfb488986ae3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99dedf2e7dc74f69a700a403c54e2e12', 'request_id': 'req-a6eb8dd3-97dc-400d-a178-bfb488986ae3'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:37.485528 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-a6eb8dd3-97dc-400d-a178-bfb488986ae3 admin admin] The token cache is being invalidate because project 99dedf2e7dc74f69a700a403c54e2e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:57:37.485820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-a6eb8dd3-97dc-400d-a178-bfb488986ae3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:37.486480 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-a6eb8dd3-97dc-400d-a178-bfb488986ae3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:37.488538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1352/2705] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:57:37 2022] DELETE /identity/v3/projects/99dedf2e7dc74f69a700a403c54e2e12 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:37.492639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c2b2e-6f37-4a74-9c8a-c9208f754951 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:37.502197 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140c2b2e-6f37-4a74-9c8a-c9208f754951 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:37.557781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473eba3-21ce-48ae-8a40-5f627c5378d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:37.567321 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473eba3-21ce-48ae-8a40-5f627c5378d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:37.567611 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473eba3-21ce-48ae-8a40-5f627c5378d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:37.567893 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473eba3-21ce-48ae-8a40-5f627c5378d7 admin admin] PATH_INFO: `/v3/users/2149154cc4d34d3d989d04a2dde9cd4f` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:37.569289 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473eba3-21ce-48ae-8a40-5f627c5378d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2149154cc4d34d3d989d04a2dde9cd4f)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:37.571264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473eba3-21ce-48ae-8a40-5f627c5378d7 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:37.619655 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7473eba3-21ce-48ae-8a40-5f627c5378d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2149154cc4d34d3d989d04a2dde9cd4f'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:37.620303 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7473eba3-21ce-48ae-8a40-5f627c5378d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2149154cc4d34d3d989d04a2dde9cd4f'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:37.632474 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7473eba3-21ce-48ae-8a40-5f627c5378d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2149154cc4d34d3d989d04a2dde9cd4f'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:37.633631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:37.640654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7473eba3-21ce-48ae-8a40-5f627c5378d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2149154cc4d34d3d989d04a2dde9cd4f'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:37.648189 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7473eba3-21ce-48ae-8a40-5f627c5378d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2149154cc4d34d3d989d04a2dde9cd4f'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:37.653996 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1354/2706] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:57:37 2022] DELETE /identity/v3/users/2149154cc4d34d3d989d04a2dde9cd4f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:37.928440 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb8dd3-97dc-400d-a178-bfb488986ae3 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:37.929985 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a6eb8dd3-97dc-400d-a178-bfb488986ae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:37.944927 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb8dd3-97dc-400d-a178-bfb488986ae3 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:38.001487 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac430c-55da-474d-a44f-985690edf779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:38.002137 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac430c-55da-474d-a44f-985690edf779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:38.002457 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac430c-55da-474d-a44f-985690edf779 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:38.002741 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac430c-55da-474d-a44f-985690edf779 admin admin] PATH_INFO: `/v3/projects/3f46d4ec3f2b4c589024026ef64d00e9` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:38.003914 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac430c-55da-474d-a44f-985690edf779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f46d4ec3f2b4c589024026ef64d00e9)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:38.005865 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac430c-55da-474d-a44f-985690edf779 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:38.054256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:38.055529 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e4ac430c-55da-474d-a44f-985690edf779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f46d4ec3f2b4c589024026ef64d00e9', 'request_id': 'req-e4ac430c-55da-474d-a44f-985690edf779'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:38.063450 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e4ac430c-55da-474d-a44f-985690edf779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f46d4ec3f2b4c589024026ef64d00e9', 'request_id': 'req-e4ac430c-55da-474d-a44f-985690edf779'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:38.069137 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e4ac430c-55da-474d-a44f-985690edf779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f46d4ec3f2b4c589024026ef64d00e9', 'request_id': 'req-e4ac430c-55da-474d-a44f-985690edf779'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:38.081053 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e4ac430c-55da-474d-a44f-985690edf779 admin admin] The token cache is being invalidate because project 3f46d4ec3f2b4c589024026ef64d00e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:57:38.081346 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e4ac430c-55da-474d-a44f-985690edf779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:38.082459 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e4ac430c-55da-474d-a44f-985690edf779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:38.083937 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1353/2707] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:57:37 2022] DELETE /identity/v3/projects/3f46d4ec3f2b4c589024026ef64d00e9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:57:38.089871 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc59d3-4cb7-431f-a220-2cc081782372 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:38.090156 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc59d3-4cb7-431f-a220-2cc081782372 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:38.090467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecc59d3-4cb7-431f-a220-2cc081782372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:38.109840 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-eecc59d3-4cb7-431f-a220-2cc081782372 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:38.111052 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-eecc59d3-4cb7-431f-a220-2cc081782372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:38.170646 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1355/2708] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:38.178382 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c811b10-c238-4492-8fab-f296be499b8f None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:38.178675 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c811b10-c238-4492-8fab-f296be499b8f None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:38.178951 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c811b10-c238-4492-8fab-f296be499b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:38.197937 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-7c811b10-c238-4492-8fab-f296be499b8f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:38.199173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-7c811b10-c238-4492-8fab-f296be499b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:38.208266 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1354/2709] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:38.212718 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc59d3-4cb7-431f-a220-2cc081782372 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:38.224960 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecc59d3-4cb7-431f-a220-2cc081782372 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:38.230191 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32d9b5-ebf0-4246-aa5a-170a033c3a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:38.230867 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32d9b5-ebf0-4246-aa5a-170a033c3a6a admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:38.231265 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32d9b5-ebf0-4246-aa5a-170a033c3a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:38.231550 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba32d9b5-ebf0-4246-aa5a-170a033c3a6a admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:38.232267 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32d9b5-ebf0-4246-aa5a-170a033c3a6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:57:38.232578 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32d9b5-ebf0-4246-aa5a-170a033c3a6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:38.234171 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba32d9b5-ebf0-4246-aa5a-170a033c3a6a admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:38.246096 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1356/2710] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:57:38.250432 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c811b10-c238-4492-8fab-f296be499b8f None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:38.259560 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c811b10-c238-4492-8fab-f296be499b8f None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:38.264136 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38f54a-8f29-4e01-aaac-1d43eb4512db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:38.264743 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38f54a-8f29-4e01-aaac-1d43eb4512db admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:38.265026 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38f54a-8f29-4e01-aaac-1d43eb4512db admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:38.265301 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38f54a-8f29-4e01-aaac-1d43eb4512db admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:38.265969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38f54a-8f29-4e01-aaac-1d43eb4512db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:38.267875 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe38f54a-8f29-4e01-aaac-1d43eb4512db admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:38.295850 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1355/2711] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:57:38 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:57:38.299962 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32d9b5-ebf0-4246-aa5a-170a033c3a6a admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:38.309789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba32d9b5-ebf0-4246-aa5a-170a033c3a6a admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:38.366653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30f96c-1017-4b60-8cd2-fa7d569adfa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:38.367270 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30f96c-1017-4b60-8cd2-fa7d569adfa0 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:38.367559 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30f96c-1017-4b60-8cd2-fa7d569adfa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:38.367838 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30f96c-1017-4b60-8cd2-fa7d569adfa0 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:38.368493 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30f96c-1017-4b60-8cd2-fa7d569adfa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:38.370405 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30f96c-1017-4b60-8cd2-fa7d569adfa0 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:38.389944 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1357/2712] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:57:38 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:57:38.394657 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38f54a-8f29-4e01-aaac-1d43eb4512db admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:38.404793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38f54a-8f29-4e01-aaac-1d43eb4512db admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:38.409555 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7771110-9cac-4be1-b278-5e7de2af3ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:38.410739 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7771110-9cac-4be1-b278-5e7de2af3ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:38.411027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7771110-9cac-4be1-b278-5e7de2af3ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:38.411418 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7771110-9cac-4be1-b278-5e7de2af3ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:38.412122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7771110-9cac-4be1-b278-5e7de2af3ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:38.414139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7771110-9cac-4be1-b278-5e7de2af3ca8 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:38.424020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1356/2713] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:57:38.427893 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30f96c-1017-4b60-8cd2-fa7d569adfa0 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:38.437863 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30f96c-1017-4b60-8cd2-fa7d569adfa0 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:38.443199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a940d34-2300-4578-b631-30bad7f8e050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:38.443809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a940d34-2300-4578-b631-30bad7f8e050 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:38.444094 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a940d34-2300-4578-b631-30bad7f8e050 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:38.444378 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a940d34-2300-4578-b631-30bad7f8e050 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:38.445264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a940d34-2300-4578-b631-30bad7f8e050 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:38.447215 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a940d34-2300-4578-b631-30bad7f8e050 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:38.458553 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1358/2714] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:57:38.462811 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7771110-9cac-4be1-b278-5e7de2af3ca8 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:38.472890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7771110-9cac-4be1-b278-5e7de2af3ca8 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:38.477512 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c50bc-00b1-42de-92ce-26b3d3861bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:38.478169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c50bc-00b1-42de-92ce-26b3d3861bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:38.478489 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c50bc-00b1-42de-92ce-26b3d3861bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:38.478770 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8c50bc-00b1-42de-92ce-26b3d3861bc4 admin admin] PATH_INFO: `/v3/projects/5710de125d7c481ca0a7306932a44819/users/aba9083b7d214b72846d0290bafc742e/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:38.493183 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c50bc-00b1-42de-92ce-26b3d3861bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5710de125d7c481ca0a7306932a44819, user_id=aba9083b7d214b72846d0290bafc742e, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:38.495887 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8c50bc-00b1-42de-92ce-26b3d3861bc4 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:38.509222 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1357/2715] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:57:38 2022] PUT /identity/v3/projects/5710de125d7c481ca0a7306932a44819/users/aba9083b7d214b72846d0290bafc742e/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:38.521752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f80083-2cfa-4c0b-a974-ec6155c33424 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:38.522064 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f80083-2cfa-4c0b-a974-ec6155c33424 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:38.522460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f80083-2cfa-4c0b-a974-ec6155c33424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:38.549577 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-f4f80083-2cfa-4c0b-a974-ec6155c33424 None None] MFA Rules not processed for user `aba9083b7d214b72846d0290bafc742e`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:38.550799 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-f4f80083-2cfa-4c0b-a974-ec6155c33424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:38.588948 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:38.623603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1359/2716] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:38.629223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c50bc-00b1-42de-92ce-26b3d3861bc4 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:38.688568 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8c50bc-00b1-42de-92ce-26b3d3861bc4 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:38.693660 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752d920-d706-4800-a86e-f0775b751400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:38.694276 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752d920-d706-4800-a86e-f0775b751400 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:38.694640 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752d920-d706-4800-a86e-f0775b751400 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:38.694923 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9752d920-d706-4800-a86e-f0775b751400 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:38.695598 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752d920-d706-4800-a86e-f0775b751400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:38.697568 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9752d920-d706-4800-a86e-f0775b751400 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:38.724508 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1358/2717] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:57:38 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:57:38.728601 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f80083-2cfa-4c0b-a974-ec6155c33424 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:38.739116 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f80083-2cfa-4c0b-a974-ec6155c33424 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:38.792797 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07ca4f-341f-4f01-baf1-d31796f52ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:38.793338 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07ca4f-341f-4f01-baf1-d31796f52ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:38.793616 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07ca4f-341f-4f01-baf1-d31796f52ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:38.793918 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07ca4f-341f-4f01-baf1-d31796f52ba2 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:38.794615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07ca4f-341f-4f01-baf1-d31796f52ba2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:38.796510 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07ca4f-341f-4f01-baf1-d31796f52ba2 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:38.818257 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1360/2718] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:57:38 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:57:38.822284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752d920-d706-4800-a86e-f0775b751400 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:38.832975 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9752d920-d706-4800-a86e-f0775b751400 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:38.837748 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746edfc-90d0-43bf-b379-e3fc66d522bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:38.838388 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746edfc-90d0-43bf-b379-e3fc66d522bc admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:38.838681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746edfc-90d0-43bf-b379-e3fc66d522bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:38.838957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9746edfc-90d0-43bf-b379-e3fc66d522bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:38.839655 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746edfc-90d0-43bf-b379-e3fc66d522bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:38.841230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9746edfc-90d0-43bf-b379-e3fc66d522bc admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:38.852020 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1359/2719] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:57:38.855823 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07ca4f-341f-4f01-baf1-d31796f52ba2 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:38.865374 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07ca4f-341f-4f01-baf1-d31796f52ba2 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:38.869840 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00aa07e-b49b-4cc7-963b-fa5f2cacd448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:38.870525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aa07e-b49b-4cc7-963b-fa5f2cacd448 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:38.870836 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aa07e-b49b-4cc7-963b-fa5f2cacd448 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:38.871111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00aa07e-b49b-4cc7-963b-fa5f2cacd448 admin admin] PATH_INFO: `/v3/projects/c4fbd114821940c4a399d254600bb6bb/users/4effb534793743fc8277c1cfc8a40bf6/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:38.885094 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00aa07e-b49b-4cc7-963b-fa5f2cacd448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4fbd114821940c4a399d254600bb6bb, user_id=4effb534793743fc8277c1cfc8a40bf6, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:38.887735 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00aa07e-b49b-4cc7-963b-fa5f2cacd448 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:38.901248 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1361/2720] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:57:38 2022] PUT /identity/v3/projects/c4fbd114821940c4a399d254600bb6bb/users/4effb534793743fc8277c1cfc8a40bf6/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:57:38.905445 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746edfc-90d0-43bf-b379-e3fc66d522bc admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:38.918298 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9746edfc-90d0-43bf-b379-e3fc66d522bc admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:38.969992 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:38.985413 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa882871-fb7d-4edc-9019-80734ed53bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:38.986040 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa882871-fb7d-4edc-9019-80734ed53bca admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:38.986329 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa882871-fb7d-4edc-9019-80734ed53bca admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:38.986656 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa882871-fb7d-4edc-9019-80734ed53bca admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:38.987331 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa882871-fb7d-4edc-9019-80734ed53bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:38.988928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa882871-fb7d-4edc-9019-80734ed53bca admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:38.998568 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1360/2721] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:57:38 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:57:39.002758 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00aa07e-b49b-4cc7-963b-fa5f2cacd448 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:39.012710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00aa07e-b49b-4cc7-963b-fa5f2cacd448 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:39.017273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0fb82-e836-462b-8e67-3092f77eb449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:39.017922 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0fb82-e836-462b-8e67-3092f77eb449 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:39.018202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0fb82-e836-462b-8e67-3092f77eb449 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:39.018508 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0fb82-e836-462b-8e67-3092f77eb449 admin admin] PATH_INFO: `/v3/projects/c4fbd114821940c4a399d254600bb6bb/users/4effb534793743fc8277c1cfc8a40bf6/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:39.020921 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0fb82-e836-462b-8e67-3092f77eb449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4fbd114821940c4a399d254600bb6bb, user_id=4effb534793743fc8277c1cfc8a40bf6, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:39.023544 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0fb82-e836-462b-8e67-3092f77eb449 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:39.033444 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1362/2722] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:57:39 2022] PUT /identity/v3/projects/c4fbd114821940c4a399d254600bb6bb/users/4effb534793743fc8277c1cfc8a40bf6/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:57:39.043887 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6989c9-0e82-4f93-a63d-5171dfe88579 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:39.044116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6989c9-0e82-4f93-a63d-5171dfe88579 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:39.044400 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6989c9-0e82-4f93-a63d-5171dfe88579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:39.071023 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-6c6989c9-0e82-4f93-a63d-5171dfe88579 None None] MFA Rules not processed for user `4effb534793743fc8277c1cfc8a40bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:39.072231 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-6c6989c9-0e82-4f93-a63d-5171dfe88579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:39.139421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1361/2723] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:57:39.150635 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0fb82-e836-462b-8e67-3092f77eb449 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:39.152323 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-c2e0fb82-e836-462b-8e67-3092f77eb449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:39.209318 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0fb82-e836-462b-8e67-3092f77eb449 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:39.213170 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b907648-75fa-4c50-bf7c-c272e46c7815 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:39.213769 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b907648-75fa-4c50-bf7c-c272e46c7815 service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:39.214048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b907648-75fa-4c50-bf7c-c272e46c7815 service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:39.214322 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b907648-75fa-4c50-bf7c-c272e46c7815 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:39.223049 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b907648-75fa-4c50-bf7c-c272e46c7815 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:39.224439 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b907648-75fa-4c50-bf7c-c272e46c7815 service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:39.233961 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1363/2724] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:57:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:57:39.619957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6989c9-0e82-4f93-a63d-5171dfe88579 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:39.679714 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6989c9-0e82-4f93-a63d-5171dfe88579 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:39.684117 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723d18b-3adf-44f2-90a7-9357d993fee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:39.684752 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723d18b-3adf-44f2-90a7-9357d993fee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:39.685035 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723d18b-3adf-44f2-90a7-9357d993fee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:39.685310 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7723d18b-3adf-44f2-90a7-9357d993fee7 admin admin] PATH_INFO: `/v3/users/aba9083b7d214b72846d0290bafc742e` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:39.686467 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723d18b-3adf-44f2-90a7-9357d993fee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aba9083b7d214b72846d0290bafc742e)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:39.688355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7723d18b-3adf-44f2-90a7-9357d993fee7 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:39.735768 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7723d18b-3adf-44f2-90a7-9357d993fee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aba9083b7d214b72846d0290bafc742e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:39.736439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7723d18b-3adf-44f2-90a7-9357d993fee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aba9083b7d214b72846d0290bafc742e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:39.743717 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7723d18b-3adf-44f2-90a7-9357d993fee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aba9083b7d214b72846d0290bafc742e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:39.755851 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:39.757055 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7723d18b-3adf-44f2-90a7-9357d993fee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aba9083b7d214b72846d0290bafc742e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:39.757703 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-7723d18b-3adf-44f2-90a7-9357d993fee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aba9083b7d214b72846d0290bafc742e'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:39.771823 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1362/2725] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:57:39 2022] DELETE /identity/v3/users/aba9083b7d214b72846d0290bafc742e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:39.776245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf042b6-e292-445a-ad5d-200b4cb757ed None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:39.776658 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf042b6-e292-445a-ad5d-200b4cb757ed None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:39.776809 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf042b6-e292-445a-ad5d-200b4cb757ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:39.794988 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-6bf042b6-e292-445a-ad5d-200b4cb757ed None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:39.796178 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6bf042b6-e292-445a-ad5d-200b4cb757ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:39.827059 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:39.864533 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1364/2726] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:39.874093 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723d18b-3adf-44f2-90a7-9357d993fee7 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:39.875507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-7723d18b-3adf-44f2-90a7-9357d993fee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:39.931563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7723d18b-3adf-44f2-90a7-9357d993fee7 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:39.935196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cdf6f-511b-4c24-88dd-5f242d699009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:39.935803 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cdf6f-511b-4c24-88dd-5f242d699009 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:39.936082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cdf6f-511b-4c24-88dd-5f242d699009 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:39.936355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442cdf6f-511b-4c24-88dd-5f242d699009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:39.945131 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cdf6f-511b-4c24-88dd-5f242d699009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:39.946571 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442cdf6f-511b-4c24-88dd-5f242d699009 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:39.955726 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1363/2727] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:57:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:57:40.215808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf042b6-e292-445a-ad5d-200b4cb757ed None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:40.217262 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6bf042b6-e292-445a-ad5d-200b4cb757ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:40.230776 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf042b6-e292-445a-ad5d-200b4cb757ed None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:40.235643 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a3699-71de-4449-b261-70dc428f4057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:40.236353 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a3699-71de-4449-b261-70dc428f4057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:40.236702 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a3699-71de-4449-b261-70dc428f4057 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:40.237041 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a3699-71de-4449-b261-70dc428f4057 admin admin] PATH_INFO: `/v3/projects/5710de125d7c481ca0a7306932a44819` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:40.238892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a3699-71de-4449-b261-70dc428f4057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5710de125d7c481ca0a7306932a44819)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:40.240980 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a3699-71de-4449-b261-70dc428f4057 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:40.286627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-490a3699-71de-4449-b261-70dc428f4057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5710de125d7c481ca0a7306932a44819', 'request_id': 'req-490a3699-71de-4449-b261-70dc428f4057'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:40.292062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-490a3699-71de-4449-b261-70dc428f4057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5710de125d7c481ca0a7306932a44819', 'request_id': 'req-490a3699-71de-4449-b261-70dc428f4057'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:40.299417 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-490a3699-71de-4449-b261-70dc428f4057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5710de125d7c481ca0a7306932a44819', 'request_id': 'req-490a3699-71de-4449-b261-70dc428f4057'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:40.310880 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-490a3699-71de-4449-b261-70dc428f4057 admin admin] The token cache is being invalidate because project 5710de125d7c481ca0a7306932a44819 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:57:40.311048 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-490a3699-71de-4449-b261-70dc428f4057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:40.311699 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-490a3699-71de-4449-b261-70dc428f4057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:40.313181 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1365/2728] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:57:40 2022] DELETE /identity/v3/projects/5710de125d7c481ca0a7306932a44819 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:40.317136 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cdf6f-511b-4c24-88dd-5f242d699009 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:40.326555 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442cdf6f-511b-4c24-88dd-5f242d699009 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:40.381201 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe5c32-14f8-4a7d-bbc6-f41f2b1fd222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:40.381774 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe5c32-14f8-4a7d-bbc6-f41f2b1fd222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:40.382058 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe5c32-14f8-4a7d-bbc6-f41f2b1fd222 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:40.382334 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe5c32-14f8-4a7d-bbc6-f41f2b1fd222 admin admin] PATH_INFO: `/v3/users/4effb534793743fc8277c1cfc8a40bf6` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:40.383510 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe5c32-14f8-4a7d-bbc6-f41f2b1fd222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4effb534793743fc8277c1cfc8a40bf6)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:40.385414 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe5c32-14f8-4a7d-bbc6-f41f2b1fd222 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:40.429905 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e6fe5c32-14f8-4a7d-bbc6-f41f2b1fd222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4effb534793743fc8277c1cfc8a40bf6'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:40.430574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e6fe5c32-14f8-4a7d-bbc6-f41f2b1fd222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4effb534793743fc8277c1cfc8a40bf6'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:40.438028 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e6fe5c32-14f8-4a7d-bbc6-f41f2b1fd222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4effb534793743fc8277c1cfc8a40bf6'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:40.450805 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e6fe5c32-14f8-4a7d-bbc6-f41f2b1fd222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4effb534793743fc8277c1cfc8a40bf6'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:40.451451 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-e6fe5c32-14f8-4a7d-bbc6-f41f2b1fd222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4effb534793743fc8277c1cfc8a40bf6'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:40.464030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1364/2729] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:57:40 2022] DELETE /identity/v3/users/4effb534793743fc8277c1cfc8a40bf6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:40.727555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a3699-71de-4449-b261-70dc428f4057 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:40.728978 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-490a3699-71de-4449-b261-70dc428f4057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:40.745790 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a3699-71de-4449-b261-70dc428f4057 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:40.801423 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4b4c6-fe0f-4444-9a93-81acf11de6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:40.802068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4b4c6-fe0f-4444-9a93-81acf11de6d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:40.802326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4b4c6-fe0f-4444-9a93-81acf11de6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:40.802626 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4b4c6-fe0f-4444-9a93-81acf11de6d2 admin admin] PATH_INFO: `/v3/projects/c4fbd114821940c4a399d254600bb6bb` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:40.803756 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4b4c6-fe0f-4444-9a93-81acf11de6d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4fbd114821940c4a399d254600bb6bb)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:40.805627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4b4c6-fe0f-4444-9a93-81acf11de6d2 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:40.850710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-22e4b4c6-fe0f-4444-9a93-81acf11de6d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4fbd114821940c4a399d254600bb6bb', 'request_id': 'req-22e4b4c6-fe0f-4444-9a93-81acf11de6d2'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:40.856095 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-22e4b4c6-fe0f-4444-9a93-81acf11de6d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4fbd114821940c4a399d254600bb6bb', 'request_id': 'req-22e4b4c6-fe0f-4444-9a93-81acf11de6d2'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:40.857701 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:40.863989 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-22e4b4c6-fe0f-4444-9a93-81acf11de6d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4fbd114821940c4a399d254600bb6bb', 'request_id': 'req-22e4b4c6-fe0f-4444-9a93-81acf11de6d2'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:40.875507 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-22e4b4c6-fe0f-4444-9a93-81acf11de6d2 admin admin] The token cache is being invalidate because project c4fbd114821940c4a399d254600bb6bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:57:40.875795 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-22e4b4c6-fe0f-4444-9a93-81acf11de6d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:40.876435 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-22e4b4c6-fe0f-4444-9a93-81acf11de6d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:40.877990 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1366/2730] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:57:40 2022] DELETE /identity/v3/projects/c4fbd114821940c4a399d254600bb6bb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:40.883510 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224d3cf-888c-4944-9407-a371a0b2bfb4 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:40.883796 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224d3cf-888c-4944-9407-a371a0b2bfb4 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:40.884073 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224d3cf-888c-4944-9407-a371a0b2bfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:40.903886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-6224d3cf-888c-4944-9407-a371a0b2bfb4 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:40.904999 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-6224d3cf-888c-4944-9407-a371a0b2bfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:40.909101 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:40.965582 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1365/2731] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:40.973382 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea4ef9-2ccf-4532-917d-014108622b9b None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:40.973670 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea4ef9-2ccf-4532-917d-014108622b9b None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:40.973945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caea4ef9-2ccf-4532-917d-014108622b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:40.992936 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-caea4ef9-2ccf-4532-917d-014108622b9b None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:40.994122 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-caea4ef9-2ccf-4532-917d-014108622b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:41.001829 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1367/2732] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:41.006294 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224d3cf-888c-4944-9407-a371a0b2bfb4 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:41.015739 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224d3cf-888c-4944-9407-a371a0b2bfb4 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:41.020834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58052c6-c6ea-441d-b452-36928afdb47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:41.021439 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58052c6-c6ea-441d-b452-36928afdb47f admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:41.021723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58052c6-c6ea-441d-b452-36928afdb47f admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:41.022001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58052c6-c6ea-441d-b452-36928afdb47f admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:41.022728 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58052c6-c6ea-441d-b452-36928afdb47f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:57:41.023036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58052c6-c6ea-441d-b452-36928afdb47f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:41.024629 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58052c6-c6ea-441d-b452-36928afdb47f admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:41.035925 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1366/2733] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:57:41.039979 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea4ef9-2ccf-4532-917d-014108622b9b None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:41.048887 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caea4ef9-2ccf-4532-917d-014108622b9b None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:41.053902 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7b772-180a-43be-b933-97770b75f231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:41.054536 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7b772-180a-43be-b933-97770b75f231 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:41.054820 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7b772-180a-43be-b933-97770b75f231 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:41.055095 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7b772-180a-43be-b933-97770b75f231 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:41.055745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7b772-180a-43be-b933-97770b75f231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:41.057608 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7b772-180a-43be-b933-97770b75f231 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:41.084280 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1368/2734] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:57:41 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:57:41.088705 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58052c6-c6ea-441d-b452-36928afdb47f admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:41.098851 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58052c6-c6ea-441d-b452-36928afdb47f admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:41.155453 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45226677-d63d-4872-ae80-1c9bc21d3501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:41.155991 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45226677-d63d-4872-ae80-1c9bc21d3501 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:41.156271 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45226677-d63d-4872-ae80-1c9bc21d3501 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:41.156547 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45226677-d63d-4872-ae80-1c9bc21d3501 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:41.157194 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45226677-d63d-4872-ae80-1c9bc21d3501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:41.159113 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45226677-d63d-4872-ae80-1c9bc21d3501 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:41.179632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1367/2735] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:57:41 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:57:41.183755 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7b772-180a-43be-b933-97770b75f231 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:41.194548 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7b772-180a-43be-b933-97770b75f231 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:41.199189 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd337969-e08e-4c93-9b0f-ca037dd06463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:41.199799 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd337969-e08e-4c93-9b0f-ca037dd06463 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:41.200085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd337969-e08e-4c93-9b0f-ca037dd06463 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:41.200366 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd337969-e08e-4c93-9b0f-ca037dd06463 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:41.201118 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd337969-e08e-4c93-9b0f-ca037dd06463 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:41.202774 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd337969-e08e-4c93-9b0f-ca037dd06463 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:41.213386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1369/2736] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:57:41.217514 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45226677-d63d-4872-ae80-1c9bc21d3501 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:41.228054 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45226677-d63d-4872-ae80-1c9bc21d3501 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:41.232659 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b89826-59b8-4b78-a079-b411260397bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:41.233278 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89826-59b8-4b78-a079-b411260397bf admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:41.233575 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89826-59b8-4b78-a079-b411260397bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:41.233853 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b89826-59b8-4b78-a079-b411260397bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:41.234571 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b89826-59b8-4b78-a079-b411260397bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:41.236145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b89826-59b8-4b78-a079-b411260397bf admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:41.246307 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1368/2737] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:57:41.250150 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd337969-e08e-4c93-9b0f-ca037dd06463 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:41.260043 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd337969-e08e-4c93-9b0f-ca037dd06463 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:41.264634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d5341-66d0-4a9e-a0a8-db429eb27fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:41.265286 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d5341-66d0-4a9e-a0a8-db429eb27fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:41.265572 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d5341-66d0-4a9e-a0a8-db429eb27fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:41.265852 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d5341-66d0-4a9e-a0a8-db429eb27fd3 admin admin] PATH_INFO: `/v3/projects/0cff9c4dcb3043e3be487d99f4a8ea8f/users/453c25c073854ee798dd3fe0f3c4a52f/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:41.280641 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d5341-66d0-4a9e-a0a8-db429eb27fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cff9c4dcb3043e3be487d99f4a8ea8f, user_id=453c25c073854ee798dd3fe0f3c4a52f, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:41.283310 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2d5341-66d0-4a9e-a0a8-db429eb27fd3 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:41.296487 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1370/2738] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:57:41 2022] PUT /identity/v3/projects/0cff9c4dcb3043e3be487d99f4a8ea8f/users/453c25c073854ee798dd3fe0f3c4a52f/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:41.307491 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c13416-c886-41ca-b964-cd84c57015d6 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:41.307863 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c13416-c886-41ca-b964-cd84c57015d6 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:41.308147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c13416-c886-41ca-b964-cd84c57015d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:41.335902 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-79c13416-c886-41ca-b964-cd84c57015d6 None None] MFA Rules not processed for user `453c25c073854ee798dd3fe0f3c4a52f`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:41.337086 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-79c13416-c886-41ca-b964-cd84c57015d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:41.398263 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1369/2739] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:41.409281 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d5341-66d0-4a9e-a0a8-db429eb27fd3 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:41.411536 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ec2d5341-66d0-4a9e-a0a8-db429eb27fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:41.466555 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d5341-66d0-4a9e-a0a8-db429eb27fd3 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:41.470099 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6fb012-49d0-41bb-b178-cdf68ad5136b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:41.470743 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fb012-49d0-41bb-b178-cdf68ad5136b service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:41.471025 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fb012-49d0-41bb-b178-cdf68ad5136b service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:41.471298 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6fb012-49d0-41bb-b178-cdf68ad5136b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:41.479182 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6fb012-49d0-41bb-b178-cdf68ad5136b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:41.480582 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6fb012-49d0-41bb-b178-cdf68ad5136b service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:41.489066 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1371/2740] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:57:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:57:41.511265 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c13416-c886-41ca-b964-cd84c57015d6 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:41.516607 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:41.573771 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c13416-c886-41ca-b964-cd84c57015d6 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:41.579169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b47f91-50a5-4234-9f72-bb8e3db7614f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:41.579846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b47f91-50a5-4234-9f72-bb8e3db7614f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:41.580183 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b47f91-50a5-4234-9f72-bb8e3db7614f admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:41.580417 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b47f91-50a5-4234-9f72-bb8e3db7614f admin admin] PATH_INFO: `/v3/users/453c25c073854ee798dd3fe0f3c4a52f` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:41.582531 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b47f91-50a5-4234-9f72-bb8e3db7614f admin admin] RBAC: Authorizing `identity:delete_user(user_id=453c25c073854ee798dd3fe0f3c4a52f)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:41.584468 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b47f91-50a5-4234-9f72-bb8e3db7614f admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:41.630464 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-92b47f91-50a5-4234-9f72-bb8e3db7614f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453c25c073854ee798dd3fe0f3c4a52f'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:41.631166 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-92b47f91-50a5-4234-9f72-bb8e3db7614f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453c25c073854ee798dd3fe0f3c4a52f'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:41.638717 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-92b47f91-50a5-4234-9f72-bb8e3db7614f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453c25c073854ee798dd3fe0f3c4a52f'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:41.651811 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-92b47f91-50a5-4234-9f72-bb8e3db7614f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453c25c073854ee798dd3fe0f3c4a52f'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:41.652539 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-92b47f91-50a5-4234-9f72-bb8e3db7614f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453c25c073854ee798dd3fe0f3c4a52f'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:41.666090 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1370/2741] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:57:41 2022] DELETE /identity/v3/users/453c25c073854ee798dd3fe0f3c4a52f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:41.670587 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180ea81-3060-4dad-a65c-ca58799a4397 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:41.670879 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180ea81-3060-4dad-a65c-ca58799a4397 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:41.671185 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180ea81-3060-4dad-a65c-ca58799a4397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:41.689698 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-c180ea81-3060-4dad-a65c-ca58799a4397 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:41.691603 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-c180ea81-3060-4dad-a65c-ca58799a4397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:41.749331 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1372/2742] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:41.759319 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b47f91-50a5-4234-9f72-bb8e3db7614f admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:41.760728 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-92b47f91-50a5-4234-9f72-bb8e3db7614f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:41.825208 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b47f91-50a5-4234-9f72-bb8e3db7614f admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:41.828872 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69e7b87-6216-4c71-ad52-1cc1183bdc48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:41.829488 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e7b87-6216-4c71-ad52-1cc1183bdc48 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:41.829774 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e7b87-6216-4c71-ad52-1cc1183bdc48 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:41.830051 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69e7b87-6216-4c71-ad52-1cc1183bdc48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:41.839205 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e7b87-6216-4c71-ad52-1cc1183bdc48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:41.840631 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69e7b87-6216-4c71-ad52-1cc1183bdc48 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:41.849969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1371/2743] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:57:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:57:42.112061 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180ea81-3060-4dad-a65c-ca58799a4397 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:42.114474 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-c180ea81-3060-4dad-a65c-ca58799a4397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:42.129205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180ea81-3060-4dad-a65c-ca58799a4397 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:42.133866 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571fcf8-adb5-424d-ae23-ffc2b7469a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:42.134554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571fcf8-adb5-424d-ae23-ffc2b7469a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:42.134843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571fcf8-adb5-424d-ae23-ffc2b7469a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:42.135126 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571fcf8-adb5-424d-ae23-ffc2b7469a0d admin admin] PATH_INFO: `/v3/projects/0cff9c4dcb3043e3be487d99f4a8ea8f` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:42.136295 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571fcf8-adb5-424d-ae23-ffc2b7469a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cff9c4dcb3043e3be487d99f4a8ea8f)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:42.138195 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7571fcf8-adb5-424d-ae23-ffc2b7469a0d admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:42.165108 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:42.188609 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7571fcf8-adb5-424d-ae23-ffc2b7469a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cff9c4dcb3043e3be487d99f4a8ea8f', 'request_id': 'req-7571fcf8-adb5-424d-ae23-ffc2b7469a0d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:42.193903 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7571fcf8-adb5-424d-ae23-ffc2b7469a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cff9c4dcb3043e3be487d99f4a8ea8f', 'request_id': 'req-7571fcf8-adb5-424d-ae23-ffc2b7469a0d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:42.200891 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7571fcf8-adb5-424d-ae23-ffc2b7469a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cff9c4dcb3043e3be487d99f4a8ea8f', 'request_id': 'req-7571fcf8-adb5-424d-ae23-ffc2b7469a0d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:42.212092 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7571fcf8-adb5-424d-ae23-ffc2b7469a0d admin admin] The token cache is being invalidate because project 0cff9c4dcb3043e3be487d99f4a8ea8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:57:42.212380 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7571fcf8-adb5-424d-ae23-ffc2b7469a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:42.213006 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-7571fcf8-adb5-424d-ae23-ffc2b7469a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:57:42.214512 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1373/2744] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:57:42 2022] DELETE /identity/v3/projects/0cff9c4dcb3043e3be487d99f4a8ea8f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:42.221208 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd57b6b-3108-4ad6-9f30-1216e8b7713d None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:42.221503 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd57b6b-3108-4ad6-9f30-1216e8b7713d None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:42.221787 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd57b6b-3108-4ad6-9f30-1216e8b7713d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:42.241746 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-6cd57b6b-3108-4ad6-9f30-1216e8b7713d None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:42.242966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-6cd57b6b-3108-4ad6-9f30-1216e8b7713d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:42.263005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:42.303022 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1372/2745] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:57:42.310837 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a881b3-8d1d-47d0-aa76-5738f309326a None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:42.311128 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a881b3-8d1d-47d0-aa76-5738f309326a None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:42.311408 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a881b3-8d1d-47d0-aa76-5738f309326a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:42.330583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-92a881b3-8d1d-47d0-aa76-5738f309326a None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:42.331778 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-92a881b3-8d1d-47d0-aa76-5738f309326a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:42.339790 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1374/2746] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:42.343790 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd57b6b-3108-4ad6-9f30-1216e8b7713d None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:42.353854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd57b6b-3108-4ad6-9f30-1216e8b7713d None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:42.358394 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87902a23-36f2-422e-86b7-aba23d7a5965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:42.359002 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87902a23-36f2-422e-86b7-aba23d7a5965 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:42.359287 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87902a23-36f2-422e-86b7-aba23d7a5965 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:42.359563 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87902a23-36f2-422e-86b7-aba23d7a5965 admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:42.360259 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87902a23-36f2-422e-86b7-aba23d7a5965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:57:42.360567 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87902a23-36f2-422e-86b7-aba23d7a5965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:42.362145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87902a23-36f2-422e-86b7-aba23d7a5965 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:42.373967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1373/2747] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:57:42.378066 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a881b3-8d1d-47d0-aa76-5738f309326a None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:42.387016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a881b3-8d1d-47d0-aa76-5738f309326a None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:42.391641 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ab04f-a126-4284-a133-0b5344aaa5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:42.392240 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ab04f-a126-4284-a133-0b5344aaa5cb admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:42.392522 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ab04f-a126-4284-a133-0b5344aaa5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:42.392796 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ab04f-a126-4284-a133-0b5344aaa5cb admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:42.393446 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ab04f-a126-4284-a133-0b5344aaa5cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:42.395337 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ab04f-a126-4284-a133-0b5344aaa5cb admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:42.421923 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1375/2748] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:57:42 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:57:42.425899 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87902a23-36f2-422e-86b7-aba23d7a5965 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:42.436273 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87902a23-36f2-422e-86b7-aba23d7a5965 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:42.492812 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7cef5-0eaa-4b14-b0bf-d2f588e7cbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:42.493365 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7cef5-0eaa-4b14-b0bf-d2f588e7cbfa admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:42.493654 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7cef5-0eaa-4b14-b0bf-d2f588e7cbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:42.493932 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd7cef5-0eaa-4b14-b0bf-d2f588e7cbfa admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:42.494633 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7cef5-0eaa-4b14-b0bf-d2f588e7cbfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:42.496534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd7cef5-0eaa-4b14-b0bf-d2f588e7cbfa admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:42.519532 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1374/2749] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:57:42 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:57:42.520750 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ab04f-a126-4284-a133-0b5344aaa5cb admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:42.531029 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ab04f-a126-4284-a133-0b5344aaa5cb admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:42.536081 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33b885-9aae-448c-83ff-60f938a0bdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:42.536693 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33b885-9aae-448c-83ff-60f938a0bdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:42.536973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33b885-9aae-448c-83ff-60f938a0bdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:42.537247 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33b885-9aae-448c-83ff-60f938a0bdb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:42.537936 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33b885-9aae-448c-83ff-60f938a0bdb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:42.539545 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33b885-9aae-448c-83ff-60f938a0bdb5 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:42.549068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1376/2750] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:57:42.553430 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7cef5-0eaa-4b14-b0bf-d2f588e7cbfa admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:42.563279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd7cef5-0eaa-4b14-b0bf-d2f588e7cbfa admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:42.567961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6648e257-75cd-46e3-8638-739e03e95b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:42.568570 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648e257-75cd-46e3-8638-739e03e95b80 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:42.568859 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648e257-75cd-46e3-8638-739e03e95b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:42.569134 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6648e257-75cd-46e3-8638-739e03e95b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:42.569861 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648e257-75cd-46e3-8638-739e03e95b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:42.571470 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6648e257-75cd-46e3-8638-739e03e95b80 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:42.582667 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1375/2751] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:57:42.587027 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33b885-9aae-448c-83ff-60f938a0bdb5 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:42.596842 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33b885-9aae-448c-83ff-60f938a0bdb5 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:42.602031 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e61ae-6fa6-4ce1-b723-e8a47ad85995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:42.602718 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e61ae-6fa6-4ce1-b723-e8a47ad85995 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:42.603002 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e61ae-6fa6-4ce1-b723-e8a47ad85995 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:42.603279 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e61ae-6fa6-4ce1-b723-e8a47ad85995 admin admin] PATH_INFO: `/v3/projects/3157a2e82f9246e0881710c3ee3bed28/users/2ebc27c1b1ca4a01b516e3c399259dfd/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:42.617682 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e61ae-6fa6-4ce1-b723-e8a47ad85995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3157a2e82f9246e0881710c3ee3bed28, user_id=2ebc27c1b1ca4a01b516e3c399259dfd, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:42.620329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e61ae-6fa6-4ce1-b723-e8a47ad85995 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:42.633336 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1377/2752] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:57:42 2022] PUT /identity/v3/projects/3157a2e82f9246e0881710c3ee3bed28/users/2ebc27c1b1ca4a01b516e3c399259dfd/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:42.638227 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37b5e4-a8c1-4ff0-8afd-e79e8bef3ef4 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:42.638540 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37b5e4-a8c1-4ff0-8afd-e79e8bef3ef4 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:42.638818 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37b5e4-a8c1-4ff0-8afd-e79e8bef3ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:42.657823 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-2e37b5e4-a8c1-4ff0-8afd-e79e8bef3ef4 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:42.659039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-2e37b5e4-a8c1-4ff0-8afd-e79e8bef3ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:42.715385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1376/2753] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:42.726083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e61ae-6fa6-4ce1-b723-e8a47ad85995 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:42.727847 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-9d9e61ae-6fa6-4ce1-b723-e8a47ad85995 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:42.782454 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e61ae-6fa6-4ce1-b723-e8a47ad85995 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:42.786616 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6692dc-fb5a-4de2-aac0-59b539784943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:42.787227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6692dc-fb5a-4de2-aac0-59b539784943 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:42.787511 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6692dc-fb5a-4de2-aac0-59b539784943 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:42.787787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6692dc-fb5a-4de2-aac0-59b539784943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:42.796532 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6692dc-fb5a-4de2-aac0-59b539784943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:42.797941 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6692dc-fb5a-4de2-aac0-59b539784943 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:42.807170 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1378/2754] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:57:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:57:46.559321 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0e3de-7f7a-47a9-93c7-3bf7b23021b9 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:46.560052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0e3de-7f7a-47a9-93c7-3bf7b23021b9 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:46.560052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0e3de-7f7a-47a9-93c7-3bf7b23021b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:46.591383 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-1ce0e3de-7f7a-47a9-93c7-3bf7b23021b9 None None] MFA Rules not processed for user `2ebc27c1b1ca4a01b516e3c399259dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:46.592620 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-1ce0e3de-7f7a-47a9-93c7-3bf7b23021b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:46.623402 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:46.674169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1377/2755] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:46.678728 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6692dc-fb5a-4de2-aac0-59b539784943 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:46.688736 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6692dc-fb5a-4de2-aac0-59b539784943 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:46.694155 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1567a-115b-42da-9593-be389e18e1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:46.694812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1567a-115b-42da-9593-be389e18e1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:46.695100 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1567a-115b-42da-9593-be389e18e1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:46.695380 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a1567a-115b-42da-9593-be389e18e1b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:46.696061 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1567a-115b-42da-9593-be389e18e1b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:46.698001 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a1567a-115b-42da-9593-be389e18e1b4 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:46.728250 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1379/2756] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:57:46 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:57:46.732297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0e3de-7f7a-47a9-93c7-3bf7b23021b9 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:46.744035 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0e3de-7f7a-47a9-93c7-3bf7b23021b9 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:46.802573 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a690449-5e5d-4b48-87a5-c0cb4db70d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:46.803199 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a690449-5e5d-4b48-87a5-c0cb4db70d89 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:46.803478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a690449-5e5d-4b48-87a5-c0cb4db70d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:46.803749 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a690449-5e5d-4b48-87a5-c0cb4db70d89 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:46.804421 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a690449-5e5d-4b48-87a5-c0cb4db70d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:46.806328 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a690449-5e5d-4b48-87a5-c0cb4db70d89 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:46.833682 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1378/2757] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:57:46 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:57:46.835450 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1567a-115b-42da-9593-be389e18e1b4 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:46.845745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a1567a-115b-42da-9593-be389e18e1b4 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:46.851501 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ad9e1-cdd5-40bb-bb43-133c23622845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:46.852136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ad9e1-cdd5-40bb-bb43-133c23622845 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:46.852452 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ad9e1-cdd5-40bb-bb43-133c23622845 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:46.852763 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350ad9e1-cdd5-40bb-bb43-133c23622845 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:46.853469 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ad9e1-cdd5-40bb-bb43-133c23622845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:46.855159 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350ad9e1-cdd5-40bb-bb43-133c23622845 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:46.866124 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1380/2758] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:57:46.870413 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a690449-5e5d-4b48-87a5-c0cb4db70d89 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:46.881025 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a690449-5e5d-4b48-87a5-c0cb4db70d89 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:46.887964 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48e0ef-3f6b-4773-b6ed-d211ba7e633e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:46.888680 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48e0ef-3f6b-4773-b6ed-d211ba7e633e admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:46.889109 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48e0ef-3f6b-4773-b6ed-d211ba7e633e admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:46.889398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48e0ef-3f6b-4773-b6ed-d211ba7e633e admin admin] PATH_INFO: `/v3/projects/fb14f6aff9b44f529186686cfdd156ff/users/54611a60a85f47d3b9cceba1a2073fcf/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:46.906462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48e0ef-3f6b-4773-b6ed-d211ba7e633e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb14f6aff9b44f529186686cfdd156ff, user_id=54611a60a85f47d3b9cceba1a2073fcf, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:46.909100 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48e0ef-3f6b-4773-b6ed-d211ba7e633e admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:46.924577 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1379/2759] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:57:46 2022] PUT /identity/v3/projects/fb14f6aff9b44f529186686cfdd156ff/users/54611a60a85f47d3b9cceba1a2073fcf/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:46.927538 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ad9e1-cdd5-40bb-bb43-133c23622845 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:46.937530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350ad9e1-cdd5-40bb-bb43-133c23622845 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:46.949339 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:46.995611 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930b942-662c-4349-9a59-d747f4206c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:46.996233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930b942-662c-4349-9a59-d747f4206c25 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:46.996521 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930b942-662c-4349-9a59-d747f4206c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:46.996798 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930b942-662c-4349-9a59-d747f4206c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:46.997495 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930b942-662c-4349-9a59-d747f4206c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:46.999236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b930b942-662c-4349-9a59-d747f4206c25 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:47.009651 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1381/2760] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:57:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:57:47.013998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48e0ef-3f6b-4773-b6ed-d211ba7e633e admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:47.024850 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48e0ef-3f6b-4773-b6ed-d211ba7e633e admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:47.029982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391551cf-1432-43ab-9346-3198ccc4b0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:47.030682 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391551cf-1432-43ab-9346-3198ccc4b0b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:47.030966 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391551cf-1432-43ab-9346-3198ccc4b0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:47.031246 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391551cf-1432-43ab-9346-3198ccc4b0b0 admin admin] PATH_INFO: `/v3/projects/fb14f6aff9b44f529186686cfdd156ff/users/54611a60a85f47d3b9cceba1a2073fcf/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:47.033224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391551cf-1432-43ab-9346-3198ccc4b0b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb14f6aff9b44f529186686cfdd156ff, user_id=54611a60a85f47d3b9cceba1a2073fcf, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:47.035893 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391551cf-1432-43ab-9346-3198ccc4b0b0 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:47.045875 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1380/2761] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:57:47 2022] PUT /identity/v3/projects/fb14f6aff9b44f529186686cfdd156ff/users/54611a60a85f47d3b9cceba1a2073fcf/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:57:51.874302 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb76188-8684-407f-b8f1-135ca45a933e None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:51.874800 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb76188-8684-407f-b8f1-135ca45a933e None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:51.874899 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb76188-8684-407f-b8f1-135ca45a933e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:51.908409 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-ffb76188-8684-407f-b8f1-135ca45a933e None None] MFA Rules not processed for user `54611a60a85f47d3b9cceba1a2073fcf`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:51.910291 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ffb76188-8684-407f-b8f1-135ca45a933e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:51.995103 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1382/2762] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:51 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:57:52.013098 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391551cf-1432-43ab-9346-3198ccc4b0b0 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:57:52.015440 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-391551cf-1432-43ab-9346-3198ccc4b0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:52.107638 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391551cf-1432-43ab-9346-3198ccc4b0b0 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:57:52.115313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc2f14-fb92-4339-872a-46b3fe15d570 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:57:52.116353 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc2f14-fb92-4339-872a-46b3fe15d570 service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:52.116353 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc2f14-fb92-4339-872a-46b3fe15d570 service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:52.116564 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc2f14-fb92-4339-872a-46b3fe15d570 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:52.128315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:57:52.185667 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc2f14-fb92-4339-872a-46b3fe15d570 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:57:52.187321 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc2f14-fb92-4339-872a-46b3fe15d570 service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:57:52.197617 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1381/2763] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:57:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:57:53.183197 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc67d00-eac4-4ad0-91a9-47a9937eed9f None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:57:53.183694 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc67d00-eac4-4ad0-91a9-47a9937eed9f None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:57:53.183790 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc67d00-eac4-4ad0-91a9-47a9937eed9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:57:53.202832 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-9cc67d00-eac4-4ad0-91a9-47a9937eed9f None None] MFA Rules not processed for user `2ebc27c1b1ca4a01b516e3c399259dfd`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:57:53.204022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-9cc67d00-eac4-4ad0-91a9-47a9937eed9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:57:53.211022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1383/2764] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:57:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:58:02.193219 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=22 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:03.197664 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=59 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:03.650150 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc2f14-fb92-4339-872a-46b3fe15d570 service nova] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:58:03.651741 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-b4dc2f14-fb92-4339-872a-46b3fe15d570 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:58:03.726409 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc2f14-fb92-4339-872a-46b3fe15d570 service nova] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:58:03.731434 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e6432-72db-4522-bd2c-b1524e9cf7f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a1384f3b34999a75572ee10a1e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:58:03.732051 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e6432-72db-4522-bd2c-b1524e9cf7f1 service placement] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:58:03.732335 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e6432-72db-4522-bd2c-b1524e9cf7f1 service placement] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:58:03.732739 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e6432-72db-4522-bd2c-b1524e9cf7f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:58:03.734517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-421e6432-72db-4522-bd2c-b1524e9cf7f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:58:03.746316 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e6432-72db-4522-bd2c-b1524e9cf7f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:58:03.747873 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e6432-72db-4522-bd2c-b1524e9cf7f1 service placement] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:58:03.757920 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1382/2765] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:58:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:58:07.450293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc67d00-eac4-4ad0-91a9-47a9937eed9f None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:58:07.451802 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-9cc67d00-eac4-4ad0-91a9-47a9937eed9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:58:07.507226 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc67d00-eac4-4ad0-91a9-47a9937eed9f None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:58:07.510754 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ac299-458e-44ca-8bb9-081dc32cfea1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:58:07.511375 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ac299-458e-44ca-8bb9-081dc32cfea1 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:58:07.511772 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ac299-458e-44ca-8bb9-081dc32cfea1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:58:07.512055 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ac299-458e-44ca-8bb9-081dc32cfea1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:58:07.513755 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ce8ac299-458e-44ca-8bb9-081dc32cfea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:58:07.574944 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ac299-458e-44ca-8bb9-081dc32cfea1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:58:07.576371 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ac299-458e-44ca-8bb9-081dc32cfea1 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:58:07.587162 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1384/2766] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:58:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:58:10.622982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e6432-72db-4522-bd2c-b1524e9cf7f1 service placement] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:58:10.624451 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-421e6432-72db-4522-bd2c-b1524e9cf7f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:58:10.637703 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e6432-72db-4522-bd2c-b1524e9cf7f1 service placement] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:58:10.651993 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb1613-9b4f-418e-9274-cbba7c86eaf6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a1384f3b34999a75572ee10a1e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:58:10.652677 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb1613-9b4f-418e-9274-cbba7c86eaf6 service placement] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:58:10.653419 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb1613-9b4f-418e-9274-cbba7c86eaf6 service placement] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:58:10.653419 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb1613-9b4f-418e-9274-cbba7c86eaf6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:58:10.655182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-0bdb1613-9b4f-418e-9274-cbba7c86eaf6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:58:10.669077 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb1613-9b4f-418e-9274-cbba7c86eaf6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:58:10.671021 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb1613-9b4f-418e-9274-cbba7c86eaf6 service placement] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:58:10.683104 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1383/2767] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:58:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:58:10.697136 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ac299-458e-44ca-8bb9-081dc32cfea1 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:58:10.698491 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-ce8ac299-458e-44ca-8bb9-081dc32cfea1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:58:10.712222 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ac299-458e-44ca-8bb9-081dc32cfea1 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:58:10.721657 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7cbb9c-0422-4138-b530-cd41f0ecbe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:58:10.722422 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cbb9c-0422-4138-b530-cd41f0ecbe25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:58:10.722776 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cbb9c-0422-4138-b530-cd41f0ecbe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:58:10.723397 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7cbb9c-0422-4138-b530-cd41f0ecbe25 admin admin] PATH_INFO: `/v3/users/7276ed630a694d0f844aa402169b938d` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:58:10.724721 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7cbb9c-0422-4138-b530-cd41f0ecbe25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7276ed630a694d0f844aa402169b938d)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:58:10.726663 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7cbb9c-0422-4138-b530-cd41f0ecbe25 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:58:10.776112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ab7cbb9c-0422-4138-b530-cd41f0ecbe25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7276ed630a694d0f844aa402169b938d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:58:10.776707 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ab7cbb9c-0422-4138-b530-cd41f0ecbe25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7276ed630a694d0f844aa402169b938d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:58:10.790014 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ab7cbb9c-0422-4138-b530-cd41f0ecbe25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7276ed630a694d0f844aa402169b938d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:58:10.798835 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ab7cbb9c-0422-4138-b530-cd41f0ecbe25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7276ed630a694d0f844aa402169b938d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:58:10.806557 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-ab7cbb9c-0422-4138-b530-cd41f0ecbe25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7276ed630a694d0f844aa402169b938d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:58:10.812811 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1385/2768] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 22:58:10 2022] DELETE /identity/v3/users/7276ed630a694d0f844aa402169b938d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:58:10.990452 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb1613-9b4f-418e-9274-cbba7c86eaf6 service placement] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:58:11.002998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb1613-9b4f-418e-9274-cbba7c86eaf6 service placement] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:58:11.063367 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b540e879-4950-45b9-88cc-092851e6c7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:58:11.064026 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540e879-4950-45b9-88cc-092851e6c7b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:58:11.064309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540e879-4950-45b9-88cc-092851e6c7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:58:11.064590 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540e879-4950-45b9-88cc-092851e6c7b7 admin admin] PATH_INFO: `/v3/projects/fafb887ff5214294811fe568697481ae` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:58:11.066407 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540e879-4950-45b9-88cc-092851e6c7b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fafb887ff5214294811fe568697481ae)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:58:11.068305 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b540e879-4950-45b9-88cc-092851e6c7b7 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:58:11.122450 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b540e879-4950-45b9-88cc-092851e6c7b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fafb887ff5214294811fe568697481ae', 'request_id': 'req-b540e879-4950-45b9-88cc-092851e6c7b7'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:58:11.129371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b540e879-4950-45b9-88cc-092851e6c7b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fafb887ff5214294811fe568697481ae', 'request_id': 'req-b540e879-4950-45b9-88cc-092851e6c7b7'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:58:11.134986 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b540e879-4950-45b9-88cc-092851e6c7b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fafb887ff5214294811fe568697481ae', 'request_id': 'req-b540e879-4950-45b9-88cc-092851e6c7b7'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:58:11.148970 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b540e879-4950-45b9-88cc-092851e6c7b7 admin admin] The token cache is being invalidate because project fafb887ff5214294811fe568697481ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 22:58:11.149268 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b540e879-4950-45b9-88cc-092851e6c7b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:58:11.149914 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-b540e879-4950-45b9-88cc-092851e6c7b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 22:58:11.155013 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1384/2769] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 22:58:10 2022] DELETE /identity/v3/projects/fafb887ff5214294811fe568697481ae => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 22:58:11.156604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7188c0-a13d-4276-8231-73189dd8f158 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:58:11.156964 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7188c0-a13d-4276-8231-73189dd8f158 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:58:11.157338 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7188c0-a13d-4276-8231-73189dd8f158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:58:11.177365 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-9e7188c0-a13d-4276-8231-73189dd8f158 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:58:11.178591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-9e7188c0-a13d-4276-8231-73189dd8f158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:58:11.196071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:11.242276 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1386/2770] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 22:58:11.250619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c2f1-baf1-4740-a528-7516fab54244 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:58:11.250972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c2f1-baf1-4740-a528-7516fab54244 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:58:11.251311 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786c2f1-baf1-4740-a528-7516fab54244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:58:11.266147 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:11.271834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-6786c2f1-baf1-4740-a528-7516fab54244 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:58:11.273524 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-6786c2f1-baf1-4740-a528-7516fab54244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:58:11.287389 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1385/2771] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:58:11.292297 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7188c0-a13d-4276-8231-73189dd8f158 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:58:11.304470 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7188c0-a13d-4276-8231-73189dd8f158 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:58:11.310425 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec340b2-4e70-4abc-b797-7e3aaab9b713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:58:11.311186 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec340b2-4e70-4abc-b797-7e3aaab9b713 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:58:11.311525 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec340b2-4e70-4abc-b797-7e3aaab9b713 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:58:11.311883 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec340b2-4e70-4abc-b797-7e3aaab9b713 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:58:11.312779 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec340b2-4e70-4abc-b797-7e3aaab9b713 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 22:58:11.313269 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec340b2-4e70-4abc-b797-7e3aaab9b713 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:58:11.316901 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec340b2-4e70-4abc-b797-7e3aaab9b713 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:58:11.331500 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1387/2772] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 22:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 22:58:11.336241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786c2f1-baf1-4740-a528-7516fab54244 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:58:11.350956 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786c2f1-baf1-4740-a528-7516fab54244 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:58:11.356013 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193b7da-1d72-410d-a4d4-114be6cda1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:58:11.356673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193b7da-1d72-410d-a4d4-114be6cda1ac admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:58:11.356963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193b7da-1d72-410d-a4d4-114be6cda1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:58:11.357245 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193b7da-1d72-410d-a4d4-114be6cda1ac admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:58:11.357918 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193b7da-1d72-410d-a4d4-114be6cda1ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:58:11.359850 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3193b7da-1d72-410d-a4d4-114be6cda1ac admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:58:11.397089 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1386/2773] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 22:58:11 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 22:58:11.401164 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec340b2-4e70-4abc-b797-7e3aaab9b713 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:58:11.412917 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec340b2-4e70-4abc-b797-7e3aaab9b713 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:58:11.476230 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b623de8-53ac-4738-b8fe-b70fc83b7c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:58:11.476975 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b623de8-53ac-4738-b8fe-b70fc83b7c32 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:58:11.477324 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b623de8-53ac-4738-b8fe-b70fc83b7c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:58:11.477666 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b623de8-53ac-4738-b8fe-b70fc83b7c32 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:58:11.478487 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b623de8-53ac-4738-b8fe-b70fc83b7c32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:58:11.480462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b623de8-53ac-4738-b8fe-b70fc83b7c32 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:58:11.503696 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1388/2774] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 22:58:11 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 22:58:11.507599 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193b7da-1d72-410d-a4d4-114be6cda1ac admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:58:11.518698 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193b7da-1d72-410d-a4d4-114be6cda1ac admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:58:11.524138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268a116-142e-45a6-8945-538d6246071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:58:11.524885 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268a116-142e-45a6-8945-538d6246071a admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:58:11.525176 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268a116-142e-45a6-8945-538d6246071a admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:58:11.525455 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0268a116-142e-45a6-8945-538d6246071a admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:58:11.526157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268a116-142e-45a6-8945-538d6246071a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:58:11.527816 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0268a116-142e-45a6-8945-538d6246071a admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:58:11.539747 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1387/2775] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 22:58:11.544017 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b623de8-53ac-4738-b8fe-b70fc83b7c32 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:58:11.554932 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b623de8-53ac-4738-b8fe-b70fc83b7c32 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:58:11.559609 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7008b-f375-4621-9c33-83f51fb3c1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:58:11.560233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7008b-f375-4621-9c33-83f51fb3c1ab admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:58:11.560511 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7008b-f375-4621-9c33-83f51fb3c1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:58:11.560786 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7008b-f375-4621-9c33-83f51fb3c1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:58:11.561470 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7008b-f375-4621-9c33-83f51fb3c1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:58:11.563238 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7008b-f375-4621-9c33-83f51fb3c1ab admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:58:11.575641 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1389/2776] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 22:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 22:58:11.579605 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268a116-142e-45a6-8945-538d6246071a admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:58:11.592812 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0268a116-142e-45a6-8945-538d6246071a admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:58:11.602988 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3d820-afb0-4708-bb8e-5a3577185cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:58:11.603828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3d820-afb0-4708-bb8e-5a3577185cf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:58:11.603952 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3d820-afb0-4708-bb8e-5a3577185cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:58:11.604244 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3d820-afb0-4708-bb8e-5a3577185cf3 admin admin] PATH_INFO: `/v3/projects/c15cf3c604a34c268d7a9efe1151f9a4/users/7482d0ac5d5d4b659f5c00acccd7f647/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:58:11.620408 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3d820-afb0-4708-bb8e-5a3577185cf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c15cf3c604a34c268d7a9efe1151f9a4, user_id=7482d0ac5d5d4b659f5c00acccd7f647, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:58:11.623328 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3d820-afb0-4708-bb8e-5a3577185cf3 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:58:11.638033 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1388/2777] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 22:58:11 2022] PUT /identity/v3/projects/c15cf3c604a34c268d7a9efe1151f9a4/users/7482d0ac5d5d4b659f5c00acccd7f647/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 22:58:11.644554 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f9193-55a1-4103-bd54-23cfab26e256 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:58:11.644729 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f9193-55a1-4103-bd54-23cfab26e256 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:58:11.645012 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f9193-55a1-4103-bd54-23cfab26e256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:58:11.665592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-792f9193-55a1-4103-bd54-23cfab26e256 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:58:11.666487 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-792f9193-55a1-4103-bd54-23cfab26e256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:58:11.729344 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1390/2778] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:58:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:58:11.739742 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3d820-afb0-4708-bb8e-5a3577185cf3 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:58:11.741507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-fcd3d820-afb0-4708-bb8e-5a3577185cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:58:11.802128 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3d820-afb0-4708-bb8e-5a3577185cf3 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:58:11.806742 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36a094-a244-4561-88c3-0c530b770e80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:58:11.807259 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36a094-a244-4561-88c3-0c530b770e80 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:58:11.807576 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36a094-a244-4561-88c3-0c530b770e80 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:58:11.807945 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36a094-a244-4561-88c3-0c530b770e80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:58:11.820226 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36a094-a244-4561-88c3-0c530b770e80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:58:11.821682 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36a094-a244-4561-88c3-0c530b770e80 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:58:11.833387 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1389/2779] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:58:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:58:16.304062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f92e2-39be-4659-9626-50f5ade48ce9 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:58:16.304062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f92e2-39be-4659-9626-50f5ade48ce9 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:58:16.304549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f92e2-39be-4659-9626-50f5ade48ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:58:16.345782 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-fc2f92e2-39be-4659-9626-50f5ade48ce9 None None] MFA Rules not processed for user `7482d0ac5d5d4b659f5c00acccd7f647`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:58:16.348538 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-fc2f92e2-39be-4659-9626-50f5ade48ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:58:16.385075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:16.462493 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1391/2780] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:58:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:58:16.477349 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36a094-a244-4561-88c3-0c530b770e80 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:58:16.479233 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-af36a094-a244-4561-88c3-0c530b770e80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:58:16.569509 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36a094-a244-4561-88c3-0c530b770e80 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:58:16.580048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4c3cd-bf61-45be-9eac-65740436a48d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:58:16.580729 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4c3cd-bf61-45be-9eac-65740436a48d service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:58:16.581009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4c3cd-bf61-45be-9eac-65740436a48d service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:58:16.581284 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff4c3cd-bf61-45be-9eac-65740436a48d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:58:16.591044 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4c3cd-bf61-45be-9eac-65740436a48d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:58:16.592631 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff4c3cd-bf61-45be-9eac-65740436a48d service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:58:16.602574 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1390/2781] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:58:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:58:17.940973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1a2ce-d211-4c48-a339-f451b5e50718 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:58:17.941474 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1a2ce-d211-4c48-a339-f451b5e50718 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:58:17.941584 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1a2ce-d211-4c48-a339-f451b5e50718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:58:17.963470 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-cda1a2ce-d211-4c48-a339-f451b5e50718 None None] MFA Rules not processed for user `7482d0ac5d5d4b659f5c00acccd7f647`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:58:17.965606 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-cda1a2ce-d211-4c48-a339-f451b5e50718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:58:17.974816 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1392/2782] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:58:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:58:26.552326 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4c3cd-bf61-45be-9eac-65740436a48d service nova] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:58:26.561555 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff4c3cd-bf61-45be-9eac-65740436a48d service nova] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:58:26.565890 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123ee02-3e32-4d89-8440-9b25e0a3e36a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:58:26.566561 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123ee02-3e32-4d89-8440-9b25e0a3e36a service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:58:26.566879 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123ee02-3e32-4d89-8440-9b25e0a3e36a service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:58:26.567157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123ee02-3e32-4d89-8440-9b25e0a3e36a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:58:26.568885 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a123ee02-3e32-4d89-8440-9b25e0a3e36a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:58:26.599357 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:26.633073 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123ee02-3e32-4d89-8440-9b25e0a3e36a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:58:26.634741 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a123ee02-3e32-4d89-8440-9b25e0a3e36a service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:58:26.645614 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1391/2783] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:58:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:58:27.957518 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=22 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:58:36.640477 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=16 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 22:59:47.855134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1a2ce-d211-4c48-a339-f451b5e50718 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:59:47.856581 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-cda1a2ce-d211-4c48-a339-f451b5e50718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:59:47.912703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1a2ce-d211-4c48-a339-f451b5e50718 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:59:47.916351 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6709f-dcc9-435b-80da-5832cd93c25b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:59:47.916973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6709f-dcc9-435b-80da-5832cd93c25b service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:59:47.917259 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6709f-dcc9-435b-80da-5832cd93c25b service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:59:47.917541 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6709f-dcc9-435b-80da-5832cd93c25b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:59:47.919311 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a0e6709f-dcc9-435b-80da-5832cd93c25b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:59:47.933295 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6709f-dcc9-435b-80da-5832cd93c25b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:59:47.934748 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e6709f-dcc9-435b-80da-5832cd93c25b service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:59:47.946008 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1393/2784] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:59:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:59:51.621608 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fd12e-edf9-48d8-a518-47d64fe3a063 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:59:51.622131 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fd12e-edf9-48d8-a518-47d64fe3a063 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:59:51.622232 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fd12e-edf9-48d8-a518-47d64fe3a063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:59:51.641027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-f52fd12e-edf9-48d8-a518-47d64fe3a063 None None] MFA Rules not processed for user `7482d0ac5d5d4b659f5c00acccd7f647`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 22:59:51.642967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-f52fd12e-edf9-48d8-a518-47d64fe3a063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:59:51.650141 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1392/2785] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 22:59:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 22:59:52.259605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6709f-dcc9-435b-80da-5832cd93c25b service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:59:52.261288 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a0e6709f-dcc9-435b-80da-5832cd93c25b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:59:52.265768 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fd12e-edf9-48d8-a518-47d64fe3a063 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:59:52.267156 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-f52fd12e-edf9-48d8-a518-47d64fe3a063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:59:52.279243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fd12e-edf9-48d8-a518-47d64fe3a063 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:59:52.282889 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6258f-c8a6-47c5-a705-6fadc2a4fb0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:59:52.283508 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6258f-c8a6-47c5-a705-6fadc2a4fb0a service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:59:52.283788 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6258f-c8a6-47c5-a705-6fadc2a4fb0a service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:59:52.284063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b6258f-c8a6-47c5-a705-6fadc2a4fb0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:59:52.285780 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a9b6258f-c8a6-47c5-a705-6fadc2a4fb0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:59:52.299963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6258f-c8a6-47c5-a705-6fadc2a4fb0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:59:52.301325 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b6258f-c8a6-47c5-a705-6fadc2a4fb0a service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:59:52.312160 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1393/2786] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:59:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 22:59:52.330844 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6709f-dcc9-435b-80da-5832cd93c25b service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:59:52.336323 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dd93b-355a-4ca1-b301-6c58d4fe2ffd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a1384f3b34999a75572ee10a1e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:59:52.336947 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dd93b-355a-4ca1-b301-6c58d4fe2ffd service placement] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:59:52.337236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dd93b-355a-4ca1-b301-6c58d4fe2ffd service placement] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:59:52.337513 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0dd93b-355a-4ca1-b301-6c58d4fe2ffd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:59:52.339306 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-8e0dd93b-355a-4ca1-b301-6c58d4fe2ffd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:59:52.359175 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0dd93b-355a-4ca1-b301-6c58d4fe2ffd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:59:52.359175 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0dd93b-355a-4ca1-b301-6c58d4fe2ffd service placement] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:59:52.365559 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1394/2787] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:59:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:59:54.214333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6258f-c8a6-47c5-a705-6fadc2a4fb0a service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:59:54.223727 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b6258f-c8a6-47c5-a705-6fadc2a4fb0a service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:59:54.227607 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b1dc1-5ce6-4b5b-91f5-dc42ef02d747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:59:54.228305 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b1dc1-5ce6-4b5b-91f5-dc42ef02d747 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:59:54.228660 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b1dc1-5ce6-4b5b-91f5-dc42ef02d747 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:59:54.229009 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b1dc1-5ce6-4b5b-91f5-dc42ef02d747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:59:54.230990 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-353b1dc1-5ce6-4b5b-91f5-dc42ef02d747 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:59:54.241755 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b1dc1-5ce6-4b5b-91f5-dc42ef02d747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:59:54.243210 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b1dc1-5ce6-4b5b-91f5-dc42ef02d747 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:59:54.254397 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1394/2788] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:59:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 22:59:54.882562 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dd93b-355a-4ca1-b301-6c58d4fe2ffd service placement] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 22:59:54.898150 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0dd93b-355a-4ca1-b301-6c58d4fe2ffd service placement] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 22:59:54.904340 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742cf901-9a29-475c-8b32-436220c2df3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 22:59:54.905056 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cf901-9a29-475c-8b32-436220c2df3f service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 22:59:54.905413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cf901-9a29-475c-8b32-436220c2df3f service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 22:59:54.905769 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742cf901-9a29-475c-8b32-436220c2df3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 22:59:54.908538 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-742cf901-9a29-475c-8b32-436220c2df3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 22:59:54.923129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742cf901-9a29-475c-8b32-436220c2df3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 22:59:54.924947 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742cf901-9a29-475c-8b32-436220c2df3f service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 22:59:54.937643 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1395/2789] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 22:59:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:00:04.249591 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=15 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:00:04.932846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=64 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:01:05.866840 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b1dc1-5ce6-4b5b-91f5-dc42ef02d747 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:01:05.875982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b1dc1-5ce6-4b5b-91f5-dc42ef02d747 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:01:05.879561 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2790b42-5e4a-4266-8931-5037b51a1d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:01:05.880167 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2790b42-5e4a-4266-8931-5037b51a1d5c service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:01:05.880459 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2790b42-5e4a-4266-8931-5037b51a1d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:01:05.880736 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2790b42-5e4a-4266-8931-5037b51a1d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:01:05.882503 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c2790b42-5e4a-4266-8931-5037b51a1d5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:01:05.892800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2790b42-5e4a-4266-8931-5037b51a1d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:01:05.894424 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2790b42-5e4a-4266-8931-5037b51a1d5c service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:01:05.902442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1395/2790] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:01:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:01:07.035640 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892947e-c8f7-476e-912a-1a80b897b04f None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:01:07.036232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892947e-c8f7-476e-912a-1a80b897b04f None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:01:07.036232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892947e-c8f7-476e-912a-1a80b897b04f None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:01:07.037548 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1396/2791] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 23:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 23:01:07.043363 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3301043-928b-4e7b-aaad-235f77e949f7 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:01:07.043823 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3301043-928b-4e7b-aaad-235f77e949f7 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:01:07.043960 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3301043-928b-4e7b-aaad-235f77e949f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:01:07.083149 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-a3301043-928b-4e7b-aaad-235f77e949f7 None None] MFA Rules not processed for user `c266721767004428b9b54dd200f3cd6b`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:01:07.084368 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a3301043-928b-4e7b-aaad-235f77e949f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:01:07.091784 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1396/2792] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 23:01:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 23:01:07.104202 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892947e-c8f7-476e-912a-1a80b897b04f None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:01:07.115109 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892947e-c8f7-476e-912a-1a80b897b04f None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:01:07.119128 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01d00fd-db71-48ba-af6f-523b31aa3f62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:01:07.119760 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d00fd-db71-48ba-af6f-523b31aa3f62 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:01:07.120041 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d00fd-db71-48ba-af6f-523b31aa3f62 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:01:07.120315 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01d00fd-db71-48ba-af6f-523b31aa3f62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:01:07.127787 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d00fd-db71-48ba-af6f-523b31aa3f62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:01:07.129193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01d00fd-db71-48ba-af6f-523b31aa3f62 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:01:07.138033 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1397/2793] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:01:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:01:07.868571 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3301043-928b-4e7b-aaad-235f77e949f7 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:01:07.869953 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-a3301043-928b-4e7b-aaad-235f77e949f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:01:07.887214 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3301043-928b-4e7b-aaad-235f77e949f7 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:01:07.892743 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c7239-c0b7-48d7-8bd7-62eef9f2b755 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:01:07.893369 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c7239-c0b7-48d7-8bd7-62eef9f2b755 service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:01:07.893655 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c7239-c0b7-48d7-8bd7-62eef9f2b755 service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:01:07.893935 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c7239-c0b7-48d7-8bd7-62eef9f2b755 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:01:07.895741 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-d86c7239-c0b7-48d7-8bd7-62eef9f2b755 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:01:07.908573 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c7239-c0b7-48d7-8bd7-62eef9f2b755 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:01:07.910155 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c7239-c0b7-48d7-8bd7-62eef9f2b755 service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:01:07.922240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1397/2794] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:01:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:01:08.238570 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edb8bf-dd89-45bf-bb6b-54c0595ba2af None None] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:01:08.239131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edb8bf-dd89-45bf-bb6b-54c0595ba2af None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:01:08.239131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5edb8bf-dd89-45bf-bb6b-54c0595ba2af None None] PATH_INFO: `/` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:01:08.240427 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1398/2795] 10.222.0.48 () {54 vars in 921 bytes} [Wed Jul 27 23:01:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 23:01:08.246151 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c7b7f-6ae6-4877-8633-6da875056b75 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:01:08.246660 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c7b7f-6ae6-4877-8633-6da875056b75 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:01:08.246885 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c7b7f-6ae6-4877-8633-6da875056b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:01:08.297904 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-081c7b7f-6ae6-4877-8633-6da875056b75 None None] MFA Rules not processed for user `c621601261e44ca8a7938862d6578639`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:01:08.299194 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-081c7b7f-6ae6-4877-8633-6da875056b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:01:08.308557 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1398/2796] 10.222.0.48 () {58 vars in 1018 bytes} [Wed Jul 27 23:01:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 23:01:08.319911 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edb8bf-dd89-45bf-bb6b-54c0595ba2af None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:01:08.331634 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5edb8bf-dd89-45bf-bb6b-54c0595ba2af None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:01:08.336062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753ef29-7aa3-4c12-9dd6-6de0b62e1344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:01:08.336672 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753ef29-7aa3-4c12-9dd6-6de0b62e1344 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:01:08.337585 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753ef29-7aa3-4c12-9dd6-6de0b62e1344 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:01:08.337870 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753ef29-7aa3-4c12-9dd6-6de0b62e1344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:01:08.348368 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753ef29-7aa3-4c12-9dd6-6de0b62e1344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:01:08.349777 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753ef29-7aa3-4c12-9dd6-6de0b62e1344 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:01:08.360898 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1399/2797] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:01:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 23:01:18.295276 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=30 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:01:18.356358 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=12 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:01:30.388191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399ccf4-e828-496d-998a-9aa47d2044c9 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:01:30.388735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399ccf4-e828-496d-998a-9aa47d2044c9 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:01:30.388735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399ccf4-e828-496d-998a-9aa47d2044c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:01:30.407288 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-5399ccf4-e828-496d-998a-9aa47d2044c9 None None] MFA Rules not processed for user `7482d0ac5d5d4b659f5c00acccd7f647`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:01:30.408483 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5399ccf4-e828-496d-998a-9aa47d2044c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:01:30.415533 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1399/2798] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:01:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:01:30.714324 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753ef29-7aa3-4c12-9dd6-6de0b62e1344 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:01:30.722889 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753ef29-7aa3-4c12-9dd6-6de0b62e1344 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:01:30.726579 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f895d7-388d-4d04-ab49-b1a2eafebaef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:01:30.727704 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f895d7-388d-4d04-ab49-b1a2eafebaef service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:01:30.727985 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f895d7-388d-4d04-ab49-b1a2eafebaef service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:01:30.728264 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f895d7-388d-4d04-ab49-b1a2eafebaef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:01:30.729989 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-39f895d7-388d-4d04-ab49-b1a2eafebaef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:01:30.739307 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f895d7-388d-4d04-ab49-b1a2eafebaef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:01:30.740753 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f895d7-388d-4d04-ab49-b1a2eafebaef service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:01:30.749238 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1400/2799] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:01:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:01:40.402549 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:01:40.745695 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=6 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:03:05.188173 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399ccf4-e828-496d-998a-9aa47d2044c9 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:03:05.200822 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399ccf4-e828-496d-998a-9aa47d2044c9 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:03:05.206947 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0977877-64b7-43c1-b463-49c9bdf921fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a1384f3b34999a75572ee10a1e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:03:05.207981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0977877-64b7-43c1-b463-49c9bdf921fc service placement] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:03:05.208448 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0977877-64b7-43c1-b463-49c9bdf921fc service placement] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:03:05.208732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0977877-64b7-43c1-b463-49c9bdf921fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:03:05.210856 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-f0977877-64b7-43c1-b463-49c9bdf921fc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:03:05.223902 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0977877-64b7-43c1-b463-49c9bdf921fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:03:05.225519 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0977877-64b7-43c1-b463-49c9bdf921fc service placement] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:03:05.238436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1400/2800] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:03:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 23:03:05.266024 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f895d7-388d-4d04-ab49-b1a2eafebaef service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:03:05.274569 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f895d7-388d-4d04-ab49-b1a2eafebaef service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:03:05.278631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4986bd5-6a01-4b23-a7fb-403a91827825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:03:05.279322 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986bd5-6a01-4b23-a7fb-403a91827825 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:03:05.279675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986bd5-6a01-4b23-a7fb-403a91827825 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:03:05.280018 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4986bd5-6a01-4b23-a7fb-403a91827825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:03:05.281854 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e4986bd5-6a01-4b23-a7fb-403a91827825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:03:05.345642 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4986bd5-6a01-4b23-a7fb-403a91827825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:03:05.347127 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4986bd5-6a01-4b23-a7fb-403a91827825 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:03:05.362720 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1401/2801] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:03:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 23:03:09.535884 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39abc03-178b-4ac8-81e5-0de582d4d931 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:03:09.536447 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39abc03-178b-4ac8-81e5-0de582d4d931 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:03:09.536580 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39abc03-178b-4ac8-81e5-0de582d4d931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:03:09.557960 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-f39abc03-178b-4ac8-81e5-0de582d4d931 None None] MFA Rules not processed for user `7482d0ac5d5d4b659f5c00acccd7f647`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:03:09.559351 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-f39abc03-178b-4ac8-81e5-0de582d4d931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:03:09.567530 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1401/2802] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:03:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 23:03:10.411671 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4986bd5-6a01-4b23-a7fb-403a91827825 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:03:10.422388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4986bd5-6a01-4b23-a7fb-403a91827825 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:03:10.426312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac4d86-742b-46d3-873f-98570bec0a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:03:10.427003 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac4d86-742b-46d3-873f-98570bec0a2b service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:03:10.427293 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac4d86-742b-46d3-873f-98570bec0a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:03:10.427808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac4d86-742b-46d3-873f-98570bec0a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:03:10.429600 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-feac4d86-742b-46d3-873f-98570bec0a2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:03:10.443617 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac4d86-742b-46d3-873f-98570bec0a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:03:10.445074 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac4d86-742b-46d3-873f-98570bec0a2b service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:03:10.455496 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1402/2803] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:03:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:03:13.771346 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39abc03-178b-4ac8-81e5-0de582d4d931 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:03:13.785420 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39abc03-178b-4ac8-81e5-0de582d4d931 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:03:13.793461 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8b827-4709-459f-aad1-36c2551e9c98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a1384f3b34999a75572ee10a1e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:03:13.794110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8b827-4709-459f-aad1-36c2551e9c98 service placement] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:03:13.794428 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8b827-4709-459f-aad1-36c2551e9c98 service placement] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:03:13.794713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8b827-4709-459f-aad1-36c2551e9c98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:03:13.796676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-9ac8b827-4709-459f-aad1-36c2551e9c98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:03:13.809479 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8b827-4709-459f-aad1-36c2551e9c98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:03:13.811164 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8b827-4709-459f-aad1-36c2551e9c98 service placement] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:03:13.824250 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1402/2804] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:03:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:03:17.181507 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac4d86-742b-46d3-873f-98570bec0a2b service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:03:17.182909 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-feac4d86-742b-46d3-873f-98570bec0a2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:03:17.197227 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac4d86-742b-46d3-873f-98570bec0a2b service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:03:17.202597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34b25c-8b32-4661-b113-89a5124ce8e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a1384f3b34999a75572ee10a1e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:03:17.203443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34b25c-8b32-4661-b113-89a5124ce8e2 service placement] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:03:17.203880 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34b25c-8b32-4661-b113-89a5124ce8e2 service placement] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:03:17.204310 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34b25c-8b32-4661-b113-89a5124ce8e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:03:17.206219 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-0e34b25c-8b32-4661-b113-89a5124ce8e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:03:17.220110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34b25c-8b32-4661-b113-89a5124ce8e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:03:17.222085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34b25c-8b32-4661-b113-89a5124ce8e2 service placement] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:03:17.234890 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1403/2805] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:03:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:03:17.235540 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8b827-4709-459f-aad1-36c2551e9c98 service placement] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:03:17.236947 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-9ac8b827-4709-459f-aad1-36c2551e9c98 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:03:17.252217 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8b827-4709-459f-aad1-36c2551e9c98 service placement] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:03:17.257667 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3a85f-b37f-4db5-a9f4-e5a989b99222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:03:17.258866 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3a85f-b37f-4db5-a9f4-e5a989b99222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:03:17.259146 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3a85f-b37f-4db5-a9f4-e5a989b99222 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:03:17.259423 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3a85f-b37f-4db5-a9f4-e5a989b99222 admin admin] PATH_INFO: `/v3/users/2ebc27c1b1ca4a01b516e3c399259dfd` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:03:17.260587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3a85f-b37f-4db5-a9f4-e5a989b99222 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ebc27c1b1ca4a01b516e3c399259dfd)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:03:17.262513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3a85f-b37f-4db5-a9f4-e5a989b99222 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:03:17.318122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-74a3a85f-b37f-4db5-a9f4-e5a989b99222 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ebc27c1b1ca4a01b516e3c399259dfd'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:03:17.319177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-74a3a85f-b37f-4db5-a9f4-e5a989b99222 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ebc27c1b1ca4a01b516e3c399259dfd'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:03:17.328414 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-74a3a85f-b37f-4db5-a9f4-e5a989b99222 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ebc27c1b1ca4a01b516e3c399259dfd'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:03:17.341191 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-74a3a85f-b37f-4db5-a9f4-e5a989b99222 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ebc27c1b1ca4a01b516e3c399259dfd'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:03:17.341779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-74a3a85f-b37f-4db5-a9f4-e5a989b99222 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ebc27c1b1ca4a01b516e3c399259dfd'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:03:17.354425 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1403/2806] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 23:03:17 2022] DELETE /identity/v3/users/2ebc27c1b1ca4a01b516e3c399259dfd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 23:03:17.521590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34b25c-8b32-4661-b113-89a5124ce8e2 service placement] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:03:17.532877 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34b25c-8b32-4661-b113-89a5124ce8e2 service placement] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:03:17.594073 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62c105-aa56-4ec0-89e5-86788e91db51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:03:17.594701 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62c105-aa56-4ec0-89e5-86788e91db51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:03:17.594985 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62c105-aa56-4ec0-89e5-86788e91db51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:03:17.595348 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f62c105-aa56-4ec0-89e5-86788e91db51 admin admin] PATH_INFO: `/v3/projects/3157a2e82f9246e0881710c3ee3bed28` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:03:17.596543 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62c105-aa56-4ec0-89e5-86788e91db51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3157a2e82f9246e0881710c3ee3bed28)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:03:17.598503 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f62c105-aa56-4ec0-89e5-86788e91db51 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:03:17.606308 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3a85f-b37f-4db5-a9f4-e5a989b99222 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:03:17.608804 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-74a3a85f-b37f-4db5-a9f4-e5a989b99222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:03:17.648291 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-2f62c105-aa56-4ec0-89e5-86788e91db51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3157a2e82f9246e0881710c3ee3bed28', 'request_id': 'req-2f62c105-aa56-4ec0-89e5-86788e91db51'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:03:17.654246 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-2f62c105-aa56-4ec0-89e5-86788e91db51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3157a2e82f9246e0881710c3ee3bed28', 'request_id': 'req-2f62c105-aa56-4ec0-89e5-86788e91db51'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:03:17.662429 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-2f62c105-aa56-4ec0-89e5-86788e91db51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3157a2e82f9246e0881710c3ee3bed28', 'request_id': 'req-2f62c105-aa56-4ec0-89e5-86788e91db51'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:03:17.675234 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-2f62c105-aa56-4ec0-89e5-86788e91db51 admin admin] The token cache is being invalidate because project 3157a2e82f9246e0881710c3ee3bed28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 23:03:17.675524 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-2f62c105-aa56-4ec0-89e5-86788e91db51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:03:17.676162 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-2f62c105-aa56-4ec0-89e5-86788e91db51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:03:17.677677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1404/2807] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 23:03:17 2022] DELETE /identity/v3/projects/3157a2e82f9246e0881710c3ee3bed28 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:03:17.681717 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62c105-aa56-4ec0-89e5-86788e91db51 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:03:17.683068 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-2f62c105-aa56-4ec0-89e5-86788e91db51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:03:17.687628 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3a85f-b37f-4db5-a9f4-e5a989b99222 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:03:17.687889 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:03:17.723085 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:03:17.751469 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f62c105-aa56-4ec0-89e5-86788e91db51 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:03:17.755961 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78836054-a9c3-4644-b88e-657c7357d7d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:03:17.756110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ed678-a433-41b2-85a5-075cb0ede2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:03:17.756600 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78836054-a9c3-4644-b88e-657c7357d7d8 service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:03:17.756735 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ed678-a433-41b2-85a5-075cb0ede2c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:03:17.756882 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78836054-a9c3-4644-b88e-657c7357d7d8 service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:03:17.757019 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ed678-a433-41b2-85a5-075cb0ede2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:03:17.757158 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78836054-a9c3-4644-b88e-657c7357d7d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:03:17.757318 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ed678-a433-41b2-85a5-075cb0ede2c2 admin admin] PATH_INFO: `/v3/users/54611a60a85f47d3b9cceba1a2073fcf` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:03:17.758487 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ed678-a433-41b2-85a5-075cb0ede2c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54611a60a85f47d3b9cceba1a2073fcf)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:03:17.758957 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-78836054-a9c3-4644-b88e-657c7357d7d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:03:17.760367 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ed678-a433-41b2-85a5-075cb0ede2c2 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:03:17.808781 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f61ed678-a433-41b2-85a5-075cb0ede2c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54611a60a85f47d3b9cceba1a2073fcf'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:03:17.809492 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f61ed678-a433-41b2-85a5-075cb0ede2c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54611a60a85f47d3b9cceba1a2073fcf'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:03:17.817959 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78836054-a9c3-4644-b88e-657c7357d7d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:03:17.819612 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78836054-a9c3-4644-b88e-657c7357d7d8 service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:03:17.822207 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f61ed678-a433-41b2-85a5-075cb0ede2c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54611a60a85f47d3b9cceba1a2073fcf'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:03:17.828602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1404/2808] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:03:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 23:03:17.829819 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f61ed678-a433-41b2-85a5-075cb0ede2c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54611a60a85f47d3b9cceba1a2073fcf'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:03:17.838582 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f61ed678-a433-41b2-85a5-075cb0ede2c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54611a60a85f47d3b9cceba1a2073fcf'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:03:17.845526 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1405/2809] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 23:03:17 2022] DELETE /identity/v3/users/54611a60a85f47d3b9cceba1a2073fcf => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 23:03:18.028771 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78836054-a9c3-4644-b88e-657c7357d7d8 service nova] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:03:18.041390 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78836054-a9c3-4644-b88e-657c7357d7d8 service nova] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:03:18.100853 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aca136-6bb7-4a7b-8e5d-a518753e0c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:03:18.101432 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aca136-6bb7-4a7b-8e5d-a518753e0c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:03:18.101731 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aca136-6bb7-4a7b-8e5d-a518753e0c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:03:18.102529 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aca136-6bb7-4a7b-8e5d-a518753e0c21 admin admin] PATH_INFO: `/v3/projects/fb14f6aff9b44f529186686cfdd156ff` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:03:18.103668 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aca136-6bb7-4a7b-8e5d-a518753e0c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb14f6aff9b44f529186686cfdd156ff)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:03:18.105555 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aca136-6bb7-4a7b-8e5d-a518753e0c21 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:03:18.149267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-41aca136-6bb7-4a7b-8e5d-a518753e0c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb14f6aff9b44f529186686cfdd156ff', 'request_id': 'req-41aca136-6bb7-4a7b-8e5d-a518753e0c21'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:03:18.155220 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-41aca136-6bb7-4a7b-8e5d-a518753e0c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb14f6aff9b44f529186686cfdd156ff', 'request_id': 'req-41aca136-6bb7-4a7b-8e5d-a518753e0c21'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:03:18.160581 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-41aca136-6bb7-4a7b-8e5d-a518753e0c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb14f6aff9b44f529186686cfdd156ff', 'request_id': 'req-41aca136-6bb7-4a7b-8e5d-a518753e0c21'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:03:18.172832 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-41aca136-6bb7-4a7b-8e5d-a518753e0c21 admin admin] The token cache is being invalidate because project fb14f6aff9b44f529186686cfdd156ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 23:03:18.173121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-41aca136-6bb7-4a7b-8e5d-a518753e0c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:03:18.173734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-41aca136-6bb7-4a7b-8e5d-a518753e0c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:03:18.175279 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1405/2810] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 23:03:18 2022] DELETE /identity/v3/projects/fb14f6aff9b44f529186686cfdd156ff => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:03:27.841436 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=52,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:03:28.169875 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:04:52.246145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ed678-a433-41b2-85a5-075cb0ede2c2 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:52.247591 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-f61ed678-a433-41b2-85a5-075cb0ede2c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:04:52.302954 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ed678-a433-41b2-85a5-075cb0ede2c2 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:52.350150 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f762c-7944-4f41-9cbc-a383bef461ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:52.350798 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f762c-7944-4f41-9cbc-a383bef461ea service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:52.351084 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f762c-7944-4f41-9cbc-a383bef461ea service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:52.351362 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f762c-7944-4f41-9cbc-a383bef461ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:52.353106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-0e3f762c-7944-4f41-9cbc-a383bef461ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:04:52.412973 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f762c-7944-4f41-9cbc-a383bef461ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:52.414415 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3f762c-7944-4f41-9cbc-a383bef461ea service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:52.423834 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1406/2811] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:04:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:04:55.604676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aca136-6bb7-4a7b-8e5d-a518753e0c21 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:55.604676 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-41aca136-6bb7-4a7b-8e5d-a518753e0c21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:04:55.616703 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aca136-6bb7-4a7b-8e5d-a518753e0c21 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:55.621370 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da21e81f-782e-42ad-884d-3f30c46d4851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:55.621972 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21e81f-782e-42ad-884d-3f30c46d4851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:55.622240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21e81f-782e-42ad-884d-3f30c46d4851 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:55.622627 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da21e81f-782e-42ad-884d-3f30c46d4851 admin admin] PATH_INFO: `/v3/users/7482d0ac5d5d4b659f5c00acccd7f647` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:55.623783 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21e81f-782e-42ad-884d-3f30c46d4851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7482d0ac5d5d4b659f5c00acccd7f647)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:55.625693 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da21e81f-782e-42ad-884d-3f30c46d4851 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:55.676178 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-da21e81f-782e-42ad-884d-3f30c46d4851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7482d0ac5d5d4b659f5c00acccd7f647'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:55.676840 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-da21e81f-782e-42ad-884d-3f30c46d4851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7482d0ac5d5d4b659f5c00acccd7f647'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:55.685398 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-da21e81f-782e-42ad-884d-3f30c46d4851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7482d0ac5d5d4b659f5c00acccd7f647'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:55.698593 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-da21e81f-782e-42ad-884d-3f30c46d4851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7482d0ac5d5d4b659f5c00acccd7f647'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:55.699333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-da21e81f-782e-42ad-884d-3f30c46d4851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7482d0ac5d5d4b659f5c00acccd7f647'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:55.712138 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1406/2812] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 23:04:55 2022] DELETE /identity/v3/users/7482d0ac5d5d4b659f5c00acccd7f647 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:04:55.892112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f762c-7944-4f41-9cbc-a383bef461ea service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:55.902531 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f762c-7944-4f41-9cbc-a383bef461ea service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:55.961155 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de9de7-88ff-45c1-9feb-1c764f645c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:55.961828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de9de7-88ff-45c1-9feb-1c764f645c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:55.962112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de9de7-88ff-45c1-9feb-1c764f645c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:55.962424 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de9de7-88ff-45c1-9feb-1c764f645c31 admin admin] PATH_INFO: `/v3/projects/c15cf3c604a34c268d7a9efe1151f9a4` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:55.963578 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de9de7-88ff-45c1-9feb-1c764f645c31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c15cf3c604a34c268d7a9efe1151f9a4)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:55.965462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de9de7-88ff-45c1-9feb-1c764f645c31 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:55.974022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=100 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:04:56.013350 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f8de9de7-88ff-45c1-9feb-1c764f645c31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c15cf3c604a34c268d7a9efe1151f9a4', 'request_id': 'req-f8de9de7-88ff-45c1-9feb-1c764f645c31'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:56.019224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f8de9de7-88ff-45c1-9feb-1c764f645c31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c15cf3c604a34c268d7a9efe1151f9a4', 'request_id': 'req-f8de9de7-88ff-45c1-9feb-1c764f645c31'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:56.026620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f8de9de7-88ff-45c1-9feb-1c764f645c31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c15cf3c604a34c268d7a9efe1151f9a4', 'request_id': 'req-f8de9de7-88ff-45c1-9feb-1c764f645c31'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:56.038075 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f8de9de7-88ff-45c1-9feb-1c764f645c31 admin admin] The token cache is being invalidate because project c15cf3c604a34c268d7a9efe1151f9a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86594) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 23:04:56.038382 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f8de9de7-88ff-45c1-9feb-1c764f645c31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:56.039022 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-f8de9de7-88ff-45c1-9feb-1c764f645c31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:56.041034 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1407/2813] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 23:04:55 2022] DELETE /identity/v3/projects/c15cf3c604a34c268d7a9efe1151f9a4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:04:56.045908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94d637-b5d7-4b0e-bcc7-629f07ae14b1 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:56.046204 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94d637-b5d7-4b0e-bcc7-629f07ae14b1 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:56.046518 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f94d637-b5d7-4b0e-bcc7-629f07ae14b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:56.067498 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-0f94d637-b5d7-4b0e-bcc7-629f07ae14b1 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:04:56.068788 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-0f94d637-b5d7-4b0e-bcc7-629f07ae14b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:04:56.131547 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1407/2814] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:04:56.139273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8e82b-e633-4cdf-a966-255c1a4b170f None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:56.139505 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8e82b-e633-4cdf-a966-255c1a4b170f None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:56.139786 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e8e82b-e633-4cdf-a966-255c1a4b170f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:56.158892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-17e8e82b-e633-4cdf-a966-255c1a4b170f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:04:56.160091 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-17e8e82b-e633-4cdf-a966-255c1a4b170f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:04:56.168508 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1408/2815] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:04:56.172565 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94d637-b5d7-4b0e-bcc7-629f07ae14b1 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:56.182847 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f94d637-b5d7-4b0e-bcc7-629f07ae14b1 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:56.187422 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c257a-cb25-4318-9094-1b8e7fa005aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:56.188058 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c257a-cb25-4318-9094-1b8e7fa005aa admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:56.188343 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c257a-cb25-4318-9094-1b8e7fa005aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:56.188624 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c257a-cb25-4318-9094-1b8e7fa005aa admin admin] PATH_INFO: `/v3/domains` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:56.189315 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c257a-cb25-4318-9094-1b8e7fa005aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86595) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 23:04:56.189622 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c257a-cb25-4318-9094-1b8e7fa005aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:56.191273 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c257a-cb25-4318-9094-1b8e7fa005aa admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:56.202545 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1408/2816] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 23:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 23:04:56.206620 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8e82b-e633-4cdf-a966-255c1a4b170f None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:56.215925 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e8e82b-e633-4cdf-a966-255c1a4b170f None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:56.220558 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54347d12-14ac-48a3-ab56-b9952408c1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:56.221172 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54347d12-14ac-48a3-ab56-b9952408c1ea admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:56.221457 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54347d12-14ac-48a3-ab56-b9952408c1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:56.221736 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54347d12-14ac-48a3-ab56-b9952408c1ea admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:56.222438 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54347d12-14ac-48a3-ab56-b9952408c1ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:56.224351 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54347d12-14ac-48a3-ab56-b9952408c1ea admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:56.260537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1409/2817] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 23:04:56 2022] POST /identity/v3/projects => generated 405 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 23:04:56.264707 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c257a-cb25-4318-9094-1b8e7fa005aa admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:56.274646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c257a-cb25-4318-9094-1b8e7fa005aa admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:56.329417 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973e8a4-940b-4b77-b812-e2801429d4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:56.330024 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e8a4-940b-4b77-b812-e2801429d4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:56.330310 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e8a4-940b-4b77-b812-e2801429d4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:56.330667 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e973e8a4-940b-4b77-b812-e2801429d4d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:56.331431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973e8a4-940b-4b77-b812-e2801429d4d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:56.333376 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e973e8a4-940b-4b77-b812-e2801429d4d9 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:56.341480 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:04:56.356351 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1409/2818] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 23:04:56 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 23:04:56.360406 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54347d12-14ac-48a3-ab56-b9952408c1ea admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:56.371145 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54347d12-14ac-48a3-ab56-b9952408c1ea admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:56.375826 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab598da2-32d2-4b2c-bdf2-7ab77d3a2790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:56.376433 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab598da2-32d2-4b2c-bdf2-7ab77d3a2790 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:56.376722 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab598da2-32d2-4b2c-bdf2-7ab77d3a2790 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:56.377036 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab598da2-32d2-4b2c-bdf2-7ab77d3a2790 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:56.377763 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab598da2-32d2-4b2c-bdf2-7ab77d3a2790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:56.379417 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab598da2-32d2-4b2c-bdf2-7ab77d3a2790 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:56.389232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1410/2819] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 23:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 23:04:56.392996 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973e8a4-940b-4b77-b812-e2801429d4d9 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:56.402745 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e973e8a4-940b-4b77-b812-e2801429d4d9 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:56.407306 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e6dff5-20bf-41b3-b3ef-35bad8c6f42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:56.407906 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6dff5-20bf-41b3-b3ef-35bad8c6f42e admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:56.408190 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6dff5-20bf-41b3-b3ef-35bad8c6f42e admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:56.408467 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e6dff5-20bf-41b3-b3ef-35bad8c6f42e admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:56.409152 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6dff5-20bf-41b3-b3ef-35bad8c6f42e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:56.410799 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e6dff5-20bf-41b3-b3ef-35bad8c6f42e admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:56.421517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1410/2820] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 23:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 23:04:56.425370 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab598da2-32d2-4b2c-bdf2-7ab77d3a2790 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:56.435599 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab598da2-32d2-4b2c-bdf2-7ab77d3a2790 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:56.440175 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ef5fc-c770-40d7-9ef7-cab08c499827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:56.440826 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ef5fc-c770-40d7-9ef7-cab08c499827 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:56.441111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ef5fc-c770-40d7-9ef7-cab08c499827 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:56.441389 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ef5fc-c770-40d7-9ef7-cab08c499827 admin admin] PATH_INFO: `/v3/projects/e4b26326933743c6a0dc3a04cec8ce06/users/8d79ad627821406d9a103e8bf9da45ba/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:56.457137 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ef5fc-c770-40d7-9ef7-cab08c499827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b26326933743c6a0dc3a04cec8ce06, user_id=8d79ad627821406d9a103e8bf9da45ba, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:56.459798 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ef5fc-c770-40d7-9ef7-cab08c499827 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:56.474004 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1411/2821] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 23:04:56 2022] PUT /identity/v3/projects/e4b26326933743c6a0dc3a04cec8ce06/users/8d79ad627821406d9a103e8bf9da45ba/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 23:04:56.485737 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf18753-df75-4a00-9b60-b9f32c71f947 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:56.486021 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf18753-df75-4a00-9b60-b9f32c71f947 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:56.486297 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf18753-df75-4a00-9b60-b9f32c71f947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:56.513772 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-5bf18753-df75-4a00-9b60-b9f32c71f947 None None] MFA Rules not processed for user `8d79ad627821406d9a103e8bf9da45ba`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:04:56.515003 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5bf18753-df75-4a00-9b60-b9f32c71f947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:04:56.576982 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1411/2822] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:04:56 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:04:56.581476 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ef5fc-c770-40d7-9ef7-cab08c499827 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:56.642428 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ef5fc-c770-40d7-9ef7-cab08c499827 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:56.647128 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a2ceb-1580-41ea-ac32-a45b30d382a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:56.647680 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a2ceb-1580-41ea-ac32-a45b30d382a0 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:56.647968 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a2ceb-1580-41ea-ac32-a45b30d382a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:56.648247 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a2ceb-1580-41ea-ac32-a45b30d382a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:56.648916 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a2ceb-1580-41ea-ac32-a45b30d382a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:56.651324 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2a2ceb-1580-41ea-ac32-a45b30d382a0 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:56.677278 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1412/2823] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 23:04:56 2022] POST /identity/v3/projects => generated 403 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 23:04:56.681352 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf18753-df75-4a00-9b60-b9f32c71f947 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:56.691816 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf18753-df75-4a00-9b60-b9f32c71f947 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:56.747171 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8fe2d-3f8b-4581-b1ad-60fdd079338a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:56.747792 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8fe2d-3f8b-4581-b1ad-60fdd079338a admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:56.748078 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8fe2d-3f8b-4581-b1ad-60fdd079338a admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:56.748358 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d8fe2d-3f8b-4581-b1ad-60fdd079338a admin admin] PATH_INFO: `/v3/users` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:56.749028 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8fe2d-3f8b-4581-b1ad-60fdd079338a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:56.750967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d8fe2d-3f8b-4581-b1ad-60fdd079338a admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:56.771256 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1412/2824] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 23:04:56 2022] POST /identity/v3/users => generated 308 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 23:04:56.775754 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a2ceb-1580-41ea-ac32-a45b30d382a0 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:56.785846 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a2ceb-1580-41ea-ac32-a45b30d382a0 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:56.791051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74d04c-24ed-48b1-93b3-2f33c0020830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:56.791654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d04c-24ed-48b1-93b3-2f33c0020830 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:56.791937 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d04c-24ed-48b1-93b3-2f33c0020830 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:56.792210 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a74d04c-24ed-48b1-93b3-2f33c0020830 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:56.792906 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74d04c-24ed-48b1-93b3-2f33c0020830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:56.794512 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a74d04c-24ed-48b1-93b3-2f33c0020830 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:56.796515 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:04:56.806532 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1413/2825] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 23:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 23:04:56.810233 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8fe2d-3f8b-4581-b1ad-60fdd079338a admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:56.820089 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d8fe2d-3f8b-4581-b1ad-60fdd079338a admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:56.825299 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6b340-0cfe-402d-a771-096ff1dfc473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:56.825968 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6b340-0cfe-402d-a771-096ff1dfc473 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:56.826254 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6b340-0cfe-402d-a771-096ff1dfc473 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:56.826560 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f6b340-0cfe-402d-a771-096ff1dfc473 admin admin] PATH_INFO: `/v3/projects/47aeaf591fcd4f73b2ebc32466bba46f/users/9aff1eb6bbab45678e7bed0bd154a5a8/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:56.841994 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6b340-0cfe-402d-a771-096ff1dfc473 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47aeaf591fcd4f73b2ebc32466bba46f, user_id=9aff1eb6bbab45678e7bed0bd154a5a8, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:56.844681 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f6b340-0cfe-402d-a771-096ff1dfc473 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:56.857163 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1413/2826] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 23:04:56 2022] PUT /identity/v3/projects/47aeaf591fcd4f73b2ebc32466bba46f/users/9aff1eb6bbab45678e7bed0bd154a5a8/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 23:04:56.860972 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74d04c-24ed-48b1-93b3-2f33c0020830 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:56.870726 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a74d04c-24ed-48b1-93b3-2f33c0020830 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:56.926282 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7345af18-8b82-424b-aeaa-e76279bf2f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:56.926938 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345af18-8b82-424b-aeaa-e76279bf2f66 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:56.927129 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345af18-8b82-424b-aeaa-e76279bf2f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:56.927407 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7345af18-8b82-424b-aeaa-e76279bf2f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:56.928102 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345af18-8b82-424b-aeaa-e76279bf2f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:56.929687 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7345af18-8b82-424b-aeaa-e76279bf2f66 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:56.939176 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1414/2827] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 23:04:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 23:04:56.943250 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6b340-0cfe-402d-a771-096ff1dfc473 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:56.953764 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f6b340-0cfe-402d-a771-096ff1dfc473 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:56.958309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bae03-b83e-4f62-b5d8-e2a1cb4187c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:56.958994 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bae03-b83e-4f62-b5d8-e2a1cb4187c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:56.959261 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bae03-b83e-4f62-b5d8-e2a1cb4187c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:56.959537 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0bae03-b83e-4f62-b5d8-e2a1cb4187c4 admin admin] PATH_INFO: `/v3/projects/47aeaf591fcd4f73b2ebc32466bba46f/users/9aff1eb6bbab45678e7bed0bd154a5a8/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:56.962385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bae03-b83e-4f62-b5d8-e2a1cb4187c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47aeaf591fcd4f73b2ebc32466bba46f, user_id=9aff1eb6bbab45678e7bed0bd154a5a8, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:56.964983 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0bae03-b83e-4f62-b5d8-e2a1cb4187c4 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:56.974987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1414/2828] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 23:04:56 2022] PUT /identity/v3/projects/47aeaf591fcd4f73b2ebc32466bba46f/users/9aff1eb6bbab45678e7bed0bd154a5a8/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:04:56.986297 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61f434-e6ee-4cb3-a065-1a5685a1741e None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:56.986615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61f434-e6ee-4cb3-a065-1a5685a1741e None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:56.986898 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b61f434-e6ee-4cb3-a065-1a5685a1741e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:57.014375 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-3b61f434-e6ee-4cb3-a065-1a5685a1741e None None] MFA Rules not processed for user `9aff1eb6bbab45678e7bed0bd154a5a8`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:04:57.015586 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-3b61f434-e6ee-4cb3-a065-1a5685a1741e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:04:57.081805 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1415/2829] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:04:56 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:04:57.093576 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bae03-b83e-4f62-b5d8-e2a1cb4187c4 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:57.095382 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-bf0bae03-b83e-4f62-b5d8-e2a1cb4187c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:04:57.117418 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:04:57.154333 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0bae03-b83e-4f62-b5d8-e2a1cb4187c4 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:57.157969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b030d-73ac-4fe3-b411-3e45a30a9756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:57.158616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b030d-73ac-4fe3-b411-3e45a30a9756 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:57.158901 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b030d-73ac-4fe3-b411-3e45a30a9756 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:57.159180 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b030d-73ac-4fe3-b411-3e45a30a9756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:57.168037 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b030d-73ac-4fe3-b411-3e45a30a9756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:57.169453 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b030d-73ac-4fe3-b411-3e45a30a9756 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:57.178879 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1415/2830] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:04:57 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:04:57.328719 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61f434-e6ee-4cb3-a065-1a5685a1741e None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:57.391352 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b61f434-e6ee-4cb3-a065-1a5685a1741e None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:57.395961 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf6250-6ab0-494c-b8cc-0246c1e26527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:57.396618 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf6250-6ab0-494c-b8cc-0246c1e26527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:57.396889 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf6250-6ab0-494c-b8cc-0246c1e26527 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:57.397171 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf6250-6ab0-494c-b8cc-0246c1e26527 admin admin] PATH_INFO: `/v3/users/8d79ad627821406d9a103e8bf9da45ba` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:57.398325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf6250-6ab0-494c-b8cc-0246c1e26527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d79ad627821406d9a103e8bf9da45ba)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:57.400292 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf6250-6ab0-494c-b8cc-0246c1e26527 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:57.421255 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:04:57.446905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1abf6250-6ab0-494c-b8cc-0246c1e26527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d79ad627821406d9a103e8bf9da45ba'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:57.447490 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1abf6250-6ab0-494c-b8cc-0246c1e26527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d79ad627821406d9a103e8bf9da45ba'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:57.459237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1abf6250-6ab0-494c-b8cc-0246c1e26527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d79ad627821406d9a103e8bf9da45ba'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:57.466236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1abf6250-6ab0-494c-b8cc-0246c1e26527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d79ad627821406d9a103e8bf9da45ba'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:57.473426 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-1abf6250-6ab0-494c-b8cc-0246c1e26527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d79ad627821406d9a103e8bf9da45ba'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:57.479298 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1416/2831] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 23:04:57 2022] DELETE /identity/v3/users/8d79ad627821406d9a103e8bf9da45ba => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:04:57.484363 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd93b4-9c43-4c93-8bcb-e001dfead0c4 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:57.484675 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd93b4-9c43-4c93-8bcb-e001dfead0c4 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:57.484949 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd93b4-9c43-4c93-8bcb-e001dfead0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:57.503539 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-61cd93b4-9c43-4c93-8bcb-e001dfead0c4 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:04:57.504722 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-61cd93b4-9c43-4c93-8bcb-e001dfead0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:04:57.561619 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1416/2832] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 23:04:57.571330 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf6250-6ab0-494c-b8cc-0246c1e26527 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:57.572729 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-1abf6250-6ab0-494c-b8cc-0246c1e26527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:04:57.630208 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf6250-6ab0-494c-b8cc-0246c1e26527 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:57.633946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f2aa9-639c-4121-a9f4-e1512427d846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:57.634596 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f2aa9-639c-4121-a9f4-e1512427d846 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:57.634884 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f2aa9-639c-4121-a9f4-e1512427d846 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:57.635163 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f2aa9-639c-4121-a9f4-e1512427d846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:57.644084 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f2aa9-639c-4121-a9f4-e1512427d846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:57.645507 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f2aa9-639c-4121-a9f4-e1512427d846 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:57.655110 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1417/2833] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:04:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:04:57.919274 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd93b4-9c43-4c93-8bcb-e001dfead0c4 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:57.920735 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-61cd93b4-9c43-4c93-8bcb-e001dfead0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:04:57.933364 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd93b4-9c43-4c93-8bcb-e001dfead0c4 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:57.938063 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22b522-8715-4f5f-be04-01fa6afe4b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:57.938739 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22b522-8715-4f5f-be04-01fa6afe4b83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:57.939021 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22b522-8715-4f5f-be04-01fa6afe4b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:57.939298 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22b522-8715-4f5f-be04-01fa6afe4b83 admin admin] PATH_INFO: `/v3/projects/e4b26326933743c6a0dc3a04cec8ce06` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:57.940760 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22b522-8715-4f5f-be04-01fa6afe4b83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b26326933743c6a0dc3a04cec8ce06)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:57.942636 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22b522-8715-4f5f-be04-01fa6afe4b83 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:57.989504 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-dc22b522-8715-4f5f-be04-01fa6afe4b83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b26326933743c6a0dc3a04cec8ce06', 'request_id': 'req-dc22b522-8715-4f5f-be04-01fa6afe4b83'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:57.995843 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-dc22b522-8715-4f5f-be04-01fa6afe4b83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b26326933743c6a0dc3a04cec8ce06', 'request_id': 'req-dc22b522-8715-4f5f-be04-01fa6afe4b83'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:58.001323 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-dc22b522-8715-4f5f-be04-01fa6afe4b83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b26326933743c6a0dc3a04cec8ce06', 'request_id': 'req-dc22b522-8715-4f5f-be04-01fa6afe4b83'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:58.013133 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-dc22b522-8715-4f5f-be04-01fa6afe4b83 admin admin] The token cache is being invalidate because project e4b26326933743c6a0dc3a04cec8ce06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 23:04:58.013447 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-dc22b522-8715-4f5f-be04-01fa6afe4b83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:58.014059 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-dc22b522-8715-4f5f-be04-01fa6afe4b83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:58.015596 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1417/2834] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 23:04:57 2022] DELETE /identity/v3/projects/e4b26326933743c6a0dc3a04cec8ce06 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:04:58.019556 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f2aa9-639c-4121-a9f4-e1512427d846 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:58.029639 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f2aa9-639c-4121-a9f4-e1512427d846 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:58.084273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2155efeb-899e-4674-920b-10ed7b49b256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:58.084912 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155efeb-899e-4674-920b-10ed7b49b256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:58.085199 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155efeb-899e-4674-920b-10ed7b49b256 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:58.085506 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2155efeb-899e-4674-920b-10ed7b49b256 admin admin] PATH_INFO: `/v3/users/9aff1eb6bbab45678e7bed0bd154a5a8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:58.087433 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155efeb-899e-4674-920b-10ed7b49b256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9aff1eb6bbab45678e7bed0bd154a5a8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:58.089342 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2155efeb-899e-4674-920b-10ed7b49b256 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:58.130933 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:04:58.133710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-2155efeb-899e-4674-920b-10ed7b49b256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9aff1eb6bbab45678e7bed0bd154a5a8'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:58.134837 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-2155efeb-899e-4674-920b-10ed7b49b256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9aff1eb6bbab45678e7bed0bd154a5a8'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:58.147412 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-2155efeb-899e-4674-920b-10ed7b49b256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9aff1eb6bbab45678e7bed0bd154a5a8'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:58.154629 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-2155efeb-899e-4674-920b-10ed7b49b256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9aff1eb6bbab45678e7bed0bd154a5a8'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:58.161507 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-2155efeb-899e-4674-920b-10ed7b49b256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9aff1eb6bbab45678e7bed0bd154a5a8'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:58.168082 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1418/2835] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 23:04:58 2022] DELETE /identity/v3/users/9aff1eb6bbab45678e7bed0bd154a5a8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:04:58.429464 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22b522-8715-4f5f-be04-01fa6afe4b83 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:58.430954 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-dc22b522-8715-4f5f-be04-01fa6afe4b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:04:58.451971 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22b522-8715-4f5f-be04-01fa6afe4b83 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:58.497682 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:04:58.513600 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbea4f5-11ba-406f-843b-a5ed36b72715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:58.514187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbea4f5-11ba-406f-843b-a5ed36b72715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:58.514529 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbea4f5-11ba-406f-843b-a5ed36b72715 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:58.514793 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbea4f5-11ba-406f-843b-a5ed36b72715 admin admin] PATH_INFO: `/v3/projects/47aeaf591fcd4f73b2ebc32466bba46f` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:58.515958 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbea4f5-11ba-406f-843b-a5ed36b72715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47aeaf591fcd4f73b2ebc32466bba46f)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:58.517852 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbea4f5-11ba-406f-843b-a5ed36b72715 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:58.562302 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-2cbea4f5-11ba-406f-843b-a5ed36b72715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47aeaf591fcd4f73b2ebc32466bba46f', 'request_id': 'req-2cbea4f5-11ba-406f-843b-a5ed36b72715'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:58.568446 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-2cbea4f5-11ba-406f-843b-a5ed36b72715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47aeaf591fcd4f73b2ebc32466bba46f', 'request_id': 'req-2cbea4f5-11ba-406f-843b-a5ed36b72715'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:58.574573 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-2cbea4f5-11ba-406f-843b-a5ed36b72715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47aeaf591fcd4f73b2ebc32466bba46f', 'request_id': 'req-2cbea4f5-11ba-406f-843b-a5ed36b72715'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:58.588293 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-2cbea4f5-11ba-406f-843b-a5ed36b72715 admin admin] The token cache is being invalidate because project 47aeaf591fcd4f73b2ebc32466bba46f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 23:04:58.588587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-2cbea4f5-11ba-406f-843b-a5ed36b72715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:58.589224 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-2cbea4f5-11ba-406f-843b-a5ed36b72715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:04:58.590794 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1418/2836] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 23:04:58 2022] DELETE /identity/v3/projects/47aeaf591fcd4f73b2ebc32466bba46f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:04:58.595550 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b7ca4-ef4f-49ae-86c2-842e0487c941 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:58.595840 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b7ca4-ef4f-49ae-86c2-842e0487c941 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:58.596121 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b7ca4-ef4f-49ae-86c2-842e0487c941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:58.615789 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-762b7ca4-ef4f-49ae-86c2-842e0487c941 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:04:58.616987 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-762b7ca4-ef4f-49ae-86c2-842e0487c941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:04:58.675636 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1419/2837] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:04:58.683821 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9eed6-31d8-47a7-868f-950af7aced28 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:58.684107 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9eed6-31d8-47a7-868f-950af7aced28 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:58.684385 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9eed6-31d8-47a7-868f-950af7aced28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:58.703969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-c2b9eed6-31d8-47a7-868f-950af7aced28 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:04:58.705159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-c2b9eed6-31d8-47a7-868f-950af7aced28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:04:58.713259 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1419/2838] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:04:58.717345 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b7ca4-ef4f-49ae-86c2-842e0487c941 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:58.726976 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b7ca4-ef4f-49ae-86c2-842e0487c941 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:58.731511 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5563fa-159a-4682-a78f-21ccba332c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:58.732118 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5563fa-159a-4682-a78f-21ccba332c41 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:58.732401 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5563fa-159a-4682-a78f-21ccba332c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:58.732673 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5563fa-159a-4682-a78f-21ccba332c41 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:58.733363 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5563fa-159a-4682-a78f-21ccba332c41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 23:04:58.733667 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5563fa-159a-4682-a78f-21ccba332c41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:58.735281 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5563fa-159a-4682-a78f-21ccba332c41 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:58.747120 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1420/2839] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 23:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 23:04:58.751230 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9eed6-31d8-47a7-868f-950af7aced28 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:58.760805 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9eed6-31d8-47a7-868f-950af7aced28 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:58.765442 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f83867-1125-424d-9015-0cfe698ae2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:58.765986 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f83867-1125-424d-9015-0cfe698ae2b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:58.766267 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f83867-1125-424d-9015-0cfe698ae2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:58.766577 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f83867-1125-424d-9015-0cfe698ae2b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:58.767247 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f83867-1125-424d-9015-0cfe698ae2b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:58.769165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f83867-1125-424d-9015-0cfe698ae2b3 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:58.794606 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1420/2840] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 23:04:58 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 23:04:58.798669 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5563fa-159a-4682-a78f-21ccba332c41 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:58.808796 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5563fa-159a-4682-a78f-21ccba332c41 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:58.862843 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f62c8-5e5c-4ddd-8be0-e28e87b6ba9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:58.863449 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f62c8-5e5c-4ddd-8be0-e28e87b6ba9a admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:58.863731 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f62c8-5e5c-4ddd-8be0-e28e87b6ba9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:58.864004 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f62c8-5e5c-4ddd-8be0-e28e87b6ba9a admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:58.864660 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f62c8-5e5c-4ddd-8be0-e28e87b6ba9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:58.866558 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f62c8-5e5c-4ddd-8be0-e28e87b6ba9a admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:58.888257 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1421/2841] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 23:04:58 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 23:04:58.892548 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f83867-1125-424d-9015-0cfe698ae2b3 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:58.902915 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f83867-1125-424d-9015-0cfe698ae2b3 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:58.907560 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d186bff-b26f-4288-97e0-3fdce05f7639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:58.908168 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d186bff-b26f-4288-97e0-3fdce05f7639 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:58.908453 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d186bff-b26f-4288-97e0-3fdce05f7639 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:58.908729 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d186bff-b26f-4288-97e0-3fdce05f7639 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:58.909425 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d186bff-b26f-4288-97e0-3fdce05f7639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:58.911039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d186bff-b26f-4288-97e0-3fdce05f7639 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:58.920659 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1421/2842] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 23:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 23:04:58.924384 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f62c8-5e5c-4ddd-8be0-e28e87b6ba9a admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:58.935134 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f62c8-5e5c-4ddd-8be0-e28e87b6ba9a admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:58.939756 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e6997-eb74-42c5-9036-13e98c5762ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:58.940361 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e6997-eb74-42c5-9036-13e98c5762ac admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:58.940648 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e6997-eb74-42c5-9036-13e98c5762ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:58.940942 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e6997-eb74-42c5-9036-13e98c5762ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:58.941618 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e6997-eb74-42c5-9036-13e98c5762ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:58.943261 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e6997-eb74-42c5-9036-13e98c5762ac admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:58.954373 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1422/2843] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 23:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 23:04:58.958071 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d186bff-b26f-4288-97e0-3fdce05f7639 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:58.968272 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d186bff-b26f-4288-97e0-3fdce05f7639 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:58.972827 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf939ff-9ffa-4b12-a3d7-55634a17f2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:58.973481 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf939ff-9ffa-4b12-a3d7-55634a17f2a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:58.973765 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf939ff-9ffa-4b12-a3d7-55634a17f2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:58.974041 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf939ff-9ffa-4b12-a3d7-55634a17f2a3 admin admin] PATH_INFO: `/v3/projects/d18869363df34b0b920cee3437982197/users/e66ff4663d7b4b95a4fb884f80937fba/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:58.988082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf939ff-9ffa-4b12-a3d7-55634a17f2a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18869363df34b0b920cee3437982197, user_id=e66ff4663d7b4b95a4fb884f80937fba, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:58.990721 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf939ff-9ffa-4b12-a3d7-55634a17f2a3 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:59.003585 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1422/2844] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 23:04:58 2022] PUT /identity/v3/projects/d18869363df34b0b920cee3437982197/users/e66ff4663d7b4b95a4fb884f80937fba/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 23:04:59.014236 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d300c00-135e-4f6f-9907-d4f07e6cf86d None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:59.014608 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d300c00-135e-4f6f-9907-d4f07e6cf86d None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:59.014895 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d300c00-135e-4f6f-9907-d4f07e6cf86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:59.042386 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-6d300c00-135e-4f6f-9907-d4f07e6cf86d None None] MFA Rules not processed for user `e66ff4663d7b4b95a4fb884f80937fba`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:04:59.043548 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-6d300c00-135e-4f6f-9907-d4f07e6cf86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:04:59.056223 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:04:59.106967 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1423/2845] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:04:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:04:59.111496 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf939ff-9ffa-4b12-a3d7-55634a17f2a3 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:59.172076 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf939ff-9ffa-4b12-a3d7-55634a17f2a3 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:59.176824 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3349e-d229-4289-a44f-3b50f569b33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:59.177441 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3349e-d229-4289-a44f-3b50f569b33b admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:59.177726 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3349e-d229-4289-a44f-3b50f569b33b admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:59.177994 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3349e-d229-4289-a44f-3b50f569b33b admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:59.178705 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3349e-d229-4289-a44f-3b50f569b33b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:59.181187 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a3349e-d229-4289-a44f-3b50f569b33b admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:59.199981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:04:59.207577 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1423/2846] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 23:04:59 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 23:04:59.211597 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d300c00-135e-4f6f-9907-d4f07e6cf86d None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:59.221995 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d300c00-135e-4f6f-9907-d4f07e6cf86d None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:59.276128 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fc366-4a92-4f7f-b81b-f165453967c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:59.276742 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fc366-4a92-4f7f-b81b-f165453967c2 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:59.277023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fc366-4a92-4f7f-b81b-f165453967c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:59.277294 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fc366-4a92-4f7f-b81b-f165453967c2 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:59.277945 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fc366-4a92-4f7f-b81b-f165453967c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:59.279866 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5fc366-4a92-4f7f-b81b-f165453967c2 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:59.300513 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1424/2847] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 23:04:59 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 23:04:59.304484 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3349e-d229-4289-a44f-3b50f569b33b admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:59.315347 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3349e-d229-4289-a44f-3b50f569b33b admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:59.319926 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db77be-f9bc-47d7-9ee0-a8753b095433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:59.320531 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db77be-f9bc-47d7-9ee0-a8753b095433 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:59.320816 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db77be-f9bc-47d7-9ee0-a8753b095433 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:59.321096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40db77be-f9bc-47d7-9ee0-a8753b095433 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:59.321792 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db77be-f9bc-47d7-9ee0-a8753b095433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:59.323417 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40db77be-f9bc-47d7-9ee0-a8753b095433 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:59.333650 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1424/2848] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 23:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 23:04:59.337960 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fc366-4a92-4f7f-b81b-f165453967c2 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:59.348334 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fc366-4a92-4f7f-b81b-f165453967c2 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:59.353483 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b9f1e-2082-4fef-91ce-faa05246744c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:59.354144 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b9f1e-2082-4fef-91ce-faa05246744c admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:59.354462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b9f1e-2082-4fef-91ce-faa05246744c admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:59.354745 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b9f1e-2082-4fef-91ce-faa05246744c admin admin] PATH_INFO: `/v3/projects/9b8dffba50244dcba3bb8879b2757dae/users/455dd6a7af9c41b79fb3d974cc498095/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:59.369677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b9f1e-2082-4fef-91ce-faa05246744c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b8dffba50244dcba3bb8879b2757dae, user_id=455dd6a7af9c41b79fb3d974cc498095, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:59.372330 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b9f1e-2082-4fef-91ce-faa05246744c admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:59.385252 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1425/2849] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 23:04:59 2022] PUT /identity/v3/projects/9b8dffba50244dcba3bb8879b2757dae/users/455dd6a7af9c41b79fb3d974cc498095/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:04:59.389160 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db77be-f9bc-47d7-9ee0-a8753b095433 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:59.400854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40db77be-f9bc-47d7-9ee0-a8753b095433 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:59.456679 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b9e7e-6d44-493b-a6c6-6617cd4a1b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:59.457294 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b9e7e-6d44-493b-a6c6-6617cd4a1b57 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:59.457580 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b9e7e-6d44-493b-a6c6-6617cd4a1b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:59.457861 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b9e7e-6d44-493b-a6c6-6617cd4a1b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:59.458582 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b9e7e-6d44-493b-a6c6-6617cd4a1b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:59.460177 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b9e7e-6d44-493b-a6c6-6617cd4a1b57 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:59.470420 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1425/2850] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 23:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 23:04:59.474589 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b9f1e-2082-4fef-91ce-faa05246744c admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:59.486476 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b9f1e-2082-4fef-91ce-faa05246744c admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:59.491147 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a37bf-32f2-41c3-bacd-6daf48415cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:59.491811 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a37bf-32f2-41c3-bacd-6daf48415cc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:59.492099 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a37bf-32f2-41c3-bacd-6daf48415cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:59.492387 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a37bf-32f2-41c3-bacd-6daf48415cc6 admin admin] PATH_INFO: `/v3/projects/9b8dffba50244dcba3bb8879b2757dae/users/455dd6a7af9c41b79fb3d974cc498095/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:59.494385 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a37bf-32f2-41c3-bacd-6daf48415cc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b8dffba50244dcba3bb8879b2757dae, user_id=455dd6a7af9c41b79fb3d974cc498095, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:59.497023 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a37bf-32f2-41c3-bacd-6daf48415cc6 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:59.507040 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1426/2851] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 23:04:59 2022] PUT /identity/v3/projects/9b8dffba50244dcba3bb8879b2757dae/users/455dd6a7af9c41b79fb3d974cc498095/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:04:59.572734 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664625a9-4919-4b86-8b54-92beee1cf7ee None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:59.573028 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664625a9-4919-4b86-8b54-92beee1cf7ee None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:59.573324 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664625a9-4919-4b86-8b54-92beee1cf7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:59.602114 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-664625a9-4919-4b86-8b54-92beee1cf7ee None None] MFA Rules not processed for user `455dd6a7af9c41b79fb3d974cc498095`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:04:59.604436 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-664625a9-4919-4b86-8b54-92beee1cf7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:04:59.671415 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1426/2852] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:04:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:04:59.682557 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a37bf-32f2-41c3-bacd-6daf48415cc6 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:59.684263 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-cc3a37bf-32f2-41c3-bacd-6daf48415cc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:04:59.741539 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a37bf-32f2-41c3-bacd-6daf48415cc6 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:59.745288 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbc48d-2cf1-4718-a664-d9607266e0ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:59.745924 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbc48d-2cf1-4718-a664-d9607266e0ac service cinder] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:59.746205 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbc48d-2cf1-4718-a664-d9607266e0ac service cinder] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:59.746533 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbc48d-2cf1-4718-a664-d9607266e0ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:59.755538 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbc48d-2cf1-4718-a664-d9607266e0ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:59.756944 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbc48d-2cf1-4718-a664-d9607266e0ac service cinder] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:59.766133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1427/2853] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:04:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:04:59.843119 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664625a9-4919-4b86-8b54-92beee1cf7ee None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:04:59.852834 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664625a9-4919-4b86-8b54-92beee1cf7ee None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:04:59.856517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2402a556-324d-4f57-96c5-1f8635288949 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:04:59.857132 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402a556-324d-4f57-96c5-1f8635288949 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:04:59.857414 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402a556-324d-4f57-96c5-1f8635288949 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:04:59.857692 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2402a556-324d-4f57-96c5-1f8635288949 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:04:59.912639 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402a556-324d-4f57-96c5-1f8635288949 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:04:59.914073 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2402a556-324d-4f57-96c5-1f8635288949 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:04:59.922878 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1427/2854] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:04:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:05:09.762059 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=90,keystone:INSERT=5 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:05:09.918916 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=97 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:05:28.885952 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbc48d-2cf1-4718-a664-d9607266e0ac service cinder] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:28.946774 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbc48d-2cf1-4718-a664-d9607266e0ac service cinder] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:28.951281 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c344dc4-5340-4c11-902e-e54410549b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:28.951912 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c344dc4-5340-4c11-902e-e54410549b54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:28.952197 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c344dc4-5340-4c11-902e-e54410549b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:28.952476 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c344dc4-5340-4c11-902e-e54410549b54 admin admin] PATH_INFO: `/v3/users/e66ff4663d7b4b95a4fb884f80937fba` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:28.953616 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c344dc4-5340-4c11-902e-e54410549b54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e66ff4663d7b4b95a4fb884f80937fba)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:28.955549 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c344dc4-5340-4c11-902e-e54410549b54 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:29.001435 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-5c344dc4-5340-4c11-902e-e54410549b54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e66ff4663d7b4b95a4fb884f80937fba'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:29.002085 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-5c344dc4-5340-4c11-902e-e54410549b54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e66ff4663d7b4b95a4fb884f80937fba'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:29.013861 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-5c344dc4-5340-4c11-902e-e54410549b54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e66ff4663d7b4b95a4fb884f80937fba'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:29.020695 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-5c344dc4-5340-4c11-902e-e54410549b54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e66ff4663d7b4b95a4fb884f80937fba'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:29.028216 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-5c344dc4-5340-4c11-902e-e54410549b54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e66ff4663d7b4b95a4fb884f80937fba'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:29.034188 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1428/2855] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 23:05:28 2022] DELETE /identity/v3/users/e66ff4663d7b4b95a4fb884f80937fba => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:05:29.038902 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d86d1e-11c4-46e5-a1c6-3e70c3b05f3f None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:29.039391 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d86d1e-11c4-46e5-a1c6-3e70c3b05f3f None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:29.039541 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d86d1e-11c4-46e5-a1c6-3e70c3b05f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:29.058522 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-26d86d1e-11c4-46e5-a1c6-3e70c3b05f3f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:05:29.060342 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-26d86d1e-11c4-46e5-a1c6-3e70c3b05f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:29.118505 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1428/2856] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:05:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:05:29.128677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c344dc4-5340-4c11-902e-e54410549b54 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:29.130057 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-5c344dc4-5340-4c11-902e-e54410549b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:29.187257 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c344dc4-5340-4c11-902e-e54410549b54 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:29.190989 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e752aa4-2bd4-4237-a4bf-a914b8c055a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:29.191627 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e752aa4-2bd4-4237-a4bf-a914b8c055a3 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:29.191921 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e752aa4-2bd4-4237-a4bf-a914b8c055a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:29.192309 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e752aa4-2bd4-4237-a4bf-a914b8c055a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:29.201413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e752aa4-2bd4-4237-a4bf-a914b8c055a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:29.202910 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e752aa4-2bd4-4237-a4bf-a914b8c055a3 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:29.212688 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1429/2857] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:05:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 23:05:29.474756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d86d1e-11c4-46e5-a1c6-3e70c3b05f3f None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:29.476265 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-26d86d1e-11c4-46e5-a1c6-3e70c3b05f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:29.490127 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d86d1e-11c4-46e5-a1c6-3e70c3b05f3f None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:29.494788 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631a138-5370-4280-a2a3-f35633e3bda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:29.495440 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631a138-5370-4280-a2a3-f35633e3bda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:29.495726 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631a138-5370-4280-a2a3-f35633e3bda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:29.496005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631a138-5370-4280-a2a3-f35633e3bda1 admin admin] PATH_INFO: `/v3/projects/d18869363df34b0b920cee3437982197` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:29.497174 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631a138-5370-4280-a2a3-f35633e3bda1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18869363df34b0b920cee3437982197)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:29.499135 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631a138-5370-4280-a2a3-f35633e3bda1 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:29.545253 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1631a138-5370-4280-a2a3-f35633e3bda1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18869363df34b0b920cee3437982197', 'request_id': 'req-1631a138-5370-4280-a2a3-f35633e3bda1'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:29.551245 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1631a138-5370-4280-a2a3-f35633e3bda1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18869363df34b0b920cee3437982197', 'request_id': 'req-1631a138-5370-4280-a2a3-f35633e3bda1'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:29.556887 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1631a138-5370-4280-a2a3-f35633e3bda1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18869363df34b0b920cee3437982197', 'request_id': 'req-1631a138-5370-4280-a2a3-f35633e3bda1'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:29.568969 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1631a138-5370-4280-a2a3-f35633e3bda1 admin admin] The token cache is being invalidate because project d18869363df34b0b920cee3437982197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 23:05:29.569336 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1631a138-5370-4280-a2a3-f35633e3bda1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:29.570052 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-1631a138-5370-4280-a2a3-f35633e3bda1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:29.571663 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1429/2858] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 23:05:29 2022] DELETE /identity/v3/projects/d18869363df34b0b920cee3437982197 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:05:29.579005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e752aa4-2bd4-4237-a4bf-a914b8c055a3 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:29.588936 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e752aa4-2bd4-4237-a4bf-a914b8c055a3 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:29.608528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:05:29.654181 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcdd0c-3878-4fe5-ad64-3eb5dcde1a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:29.655062 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcdd0c-3878-4fe5-ad64-3eb5dcde1a16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:29.655427 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcdd0c-3878-4fe5-ad64-3eb5dcde1a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:29.655708 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcdd0c-3878-4fe5-ad64-3eb5dcde1a16 admin admin] PATH_INFO: `/v3/users/455dd6a7af9c41b79fb3d974cc498095` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:29.657122 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcdd0c-3878-4fe5-ad64-3eb5dcde1a16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=455dd6a7af9c41b79fb3d974cc498095)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:29.659160 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcdd0c-3878-4fe5-ad64-3eb5dcde1a16 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:29.704130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-3cdcdd0c-3878-4fe5-ad64-3eb5dcde1a16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '455dd6a7af9c41b79fb3d974cc498095'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:29.704769 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-3cdcdd0c-3878-4fe5-ad64-3eb5dcde1a16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '455dd6a7af9c41b79fb3d974cc498095'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:29.717147 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-3cdcdd0c-3878-4fe5-ad64-3eb5dcde1a16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '455dd6a7af9c41b79fb3d974cc498095'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:29.723849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-3cdcdd0c-3878-4fe5-ad64-3eb5dcde1a16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '455dd6a7af9c41b79fb3d974cc498095'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:29.731811 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-3cdcdd0c-3878-4fe5-ad64-3eb5dcde1a16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '455dd6a7af9c41b79fb3d974cc498095'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:29.737849 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1430/2859] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 23:05:29 2022] DELETE /identity/v3/users/455dd6a7af9c41b79fb3d974cc498095 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:05:29.999322 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631a138-5370-4280-a2a3-f35633e3bda1 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:30.000743 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-1631a138-5370-4280-a2a3-f35633e3bda1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:30.015150 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631a138-5370-4280-a2a3-f35633e3bda1 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:30.074569 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f044a-f275-4173-920a-e14c55660755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:30.075266 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f044a-f275-4173-920a-e14c55660755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:30.076031 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f044a-f275-4173-920a-e14c55660755 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:30.076308 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f044a-f275-4173-920a-e14c55660755 admin admin] PATH_INFO: `/v3/projects/9b8dffba50244dcba3bb8879b2757dae` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:30.077466 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f044a-f275-4173-920a-e14c55660755 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b8dffba50244dcba3bb8879b2757dae)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:30.079397 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f044a-f275-4173-920a-e14c55660755 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:30.108974 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:05:30.126248 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-424f044a-f275-4173-920a-e14c55660755 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b8dffba50244dcba3bb8879b2757dae', 'request_id': 'req-424f044a-f275-4173-920a-e14c55660755'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:30.132241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-424f044a-f275-4173-920a-e14c55660755 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b8dffba50244dcba3bb8879b2757dae', 'request_id': 'req-424f044a-f275-4173-920a-e14c55660755'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:30.138554 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-424f044a-f275-4173-920a-e14c55660755 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b8dffba50244dcba3bb8879b2757dae', 'request_id': 'req-424f044a-f275-4173-920a-e14c55660755'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:30.150946 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-424f044a-f275-4173-920a-e14c55660755 admin admin] The token cache is being invalidate because project 9b8dffba50244dcba3bb8879b2757dae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 23:05:30.151235 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-424f044a-f275-4173-920a-e14c55660755 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:30.151874 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-424f044a-f275-4173-920a-e14c55660755 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:30.153364 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1430/2860] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 23:05:29 2022] DELETE /identity/v3/projects/9b8dffba50244dcba3bb8879b2757dae => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:05:30.158194 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617777f-6440-419c-a624-812a01ebb724 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:30.158699 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617777f-6440-419c-a624-812a01ebb724 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:30.158797 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617777f-6440-419c-a624-812a01ebb724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:30.177977 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-7617777f-6440-419c-a624-812a01ebb724 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:05:30.179217 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-7617777f-6440-419c-a624-812a01ebb724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:30.237057 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1431/2861] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 23:05:30.244813 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f1f6a-8f86-47cd-8d6c-c1198774fbba None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:30.245127 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f1f6a-8f86-47cd-8d6c-c1198774fbba None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:30.245401 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f1f6a-8f86-47cd-8d6c-c1198774fbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:30.265309 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-5f6f1f6a-8f86-47cd-8d6c-c1198774fbba None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:05:30.266518 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5f6f1f6a-8f86-47cd-8d6c-c1198774fbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:30.274196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1431/2862] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:05:30.278213 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617777f-6440-419c-a624-812a01ebb724 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:30.287776 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617777f-6440-419c-a624-812a01ebb724 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:30.292261 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734822f0-71b7-491c-bf17-32ef0137d849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:30.292865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734822f0-71b7-491c-bf17-32ef0137d849 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:30.293148 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734822f0-71b7-491c-bf17-32ef0137d849 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:30.293424 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734822f0-71b7-491c-bf17-32ef0137d849 admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:30.294111 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734822f0-71b7-491c-bf17-32ef0137d849 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 23:05:30.294462 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734822f0-71b7-491c-bf17-32ef0137d849 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:30.296036 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734822f0-71b7-491c-bf17-32ef0137d849 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:30.307482 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1432/2863] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 23:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 23:05:30.312037 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f1f6a-8f86-47cd-8d6c-c1198774fbba None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:30.321039 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f1f6a-8f86-47cd-8d6c-c1198774fbba None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:30.326167 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345af43-fdc8-4d1c-a31b-84e799c00bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:30.326798 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345af43-fdc8-4d1c-a31b-84e799c00bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:30.327078 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345af43-fdc8-4d1c-a31b-84e799c00bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:30.327349 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d345af43-fdc8-4d1c-a31b-84e799c00bf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:30.327997 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345af43-fdc8-4d1c-a31b-84e799c00bf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:30.329861 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d345af43-fdc8-4d1c-a31b-84e799c00bf5 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:30.355977 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1432/2864] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 23:05:30 2022] POST /identity/v3/projects => generated 359 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 23:05:30.360144 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734822f0-71b7-491c-bf17-32ef0137d849 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:30.370220 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734822f0-71b7-491c-bf17-32ef0137d849 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:30.396853 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:05:30.429051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc4b53-d89f-475e-a6a0-b6bde8c582b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:30.429694 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc4b53-d89f-475e-a6a0-b6bde8c582b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:30.429983 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc4b53-d89f-475e-a6a0-b6bde8c582b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:30.430266 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc4b53-d89f-475e-a6a0-b6bde8c582b8 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:30.430978 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc4b53-d89f-475e-a6a0-b6bde8c582b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:30.432881 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc4b53-d89f-475e-a6a0-b6bde8c582b8 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:30.453992 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1433/2865] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 23:05:30 2022] POST /identity/v3/users => generated 280 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 23:05:30.458182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345af43-fdc8-4d1c-a31b-84e799c00bf5 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:30.468553 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d345af43-fdc8-4d1c-a31b-84e799c00bf5 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:30.473326 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1ca77-5f5e-42f6-b891-c6cd641a0606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:30.473941 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1ca77-5f5e-42f6-b891-c6cd641a0606 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:30.474228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1ca77-5f5e-42f6-b891-c6cd641a0606 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:30.474538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1ca77-5f5e-42f6-b891-c6cd641a0606 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:30.475232 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1ca77-5f5e-42f6-b891-c6cd641a0606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:30.476819 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1ca77-5f5e-42f6-b891-c6cd641a0606 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:30.487494 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1433/2866] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 23:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 23:05:30.491324 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc4b53-d89f-475e-a6a0-b6bde8c582b8 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:30.501652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc4b53-d89f-475e-a6a0-b6bde8c582b8 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:30.506305 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f90d05-4ae7-4634-8405-e92e6f1e00bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:30.506942 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f90d05-4ae7-4634-8405-e92e6f1e00bc admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:30.507233 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f90d05-4ae7-4634-8405-e92e6f1e00bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:30.507518 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f90d05-4ae7-4634-8405-e92e6f1e00bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:30.508213 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f90d05-4ae7-4634-8405-e92e6f1e00bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:30.509797 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f90d05-4ae7-4634-8405-e92e6f1e00bc admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:30.520329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1434/2867] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 23:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 23:05:30.524416 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1ca77-5f5e-42f6-b891-c6cd641a0606 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:30.534223 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1ca77-5f5e-42f6-b891-c6cd641a0606 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:30.538867 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa491f6-4001-4710-b86b-c1d22a995805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:30.539538 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa491f6-4001-4710-b86b-c1d22a995805 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:30.539828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa491f6-4001-4710-b86b-c1d22a995805 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:30.540110 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa491f6-4001-4710-b86b-c1d22a995805 admin admin] PATH_INFO: `/v3/projects/bcf92be9ff04464a873e5a6c5c8f643a/users/0956a809a3644e44992d0708ef7e478d/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:30.555034 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa491f6-4001-4710-b86b-c1d22a995805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcf92be9ff04464a873e5a6c5c8f643a, user_id=0956a809a3644e44992d0708ef7e478d, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:30.557670 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa491f6-4001-4710-b86b-c1d22a995805 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:30.571540 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1434/2868] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 23:05:30 2022] PUT /identity/v3/projects/bcf92be9ff04464a873e5a6c5c8f643a/users/0956a809a3644e44992d0708ef7e478d/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:05:30.583197 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3419fd-7538-4c27-af8d-7b77ab27800d None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:30.583495 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3419fd-7538-4c27-af8d-7b77ab27800d None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:30.583780 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3419fd-7538-4c27-af8d-7b77ab27800d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:30.612219 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-cc3419fd-7538-4c27-af8d-7b77ab27800d None None] MFA Rules not processed for user `0956a809a3644e44992d0708ef7e478d`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:05:30.613402 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-cc3419fd-7538-4c27-af8d-7b77ab27800d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:30.676935 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1435/2869] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:05:30 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:05:30.709043 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa491f6-4001-4710-b86b-c1d22a995805 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:30.710766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-0aa491f6-4001-4710-b86b-c1d22a995805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:30.767214 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa491f6-4001-4710-b86b-c1d22a995805 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:30.770924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a9b97-d1c8-4e78-93ca-6c09acfe5678 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:30.772027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a9b97-d1c8-4e78-93ca-6c09acfe5678 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:30.772516 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a9b97-d1c8-4e78-93ca-6c09acfe5678 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:30.772967 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a9b97-d1c8-4e78-93ca-6c09acfe5678 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:30.784495 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a9b97-d1c8-4e78-93ca-6c09acfe5678 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:30.786099 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a9b97-d1c8-4e78-93ca-6c09acfe5678 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:30.795963 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1435/2870] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:05:30 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:05:30.812107 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3419fd-7538-4c27-af8d-7b77ab27800d None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:30.873161 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3419fd-7538-4c27-af8d-7b77ab27800d None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:30.877664 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dae8de-f084-4de1-ae32-033aad30af22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:30.878298 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dae8de-f084-4de1-ae32-033aad30af22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:30.878609 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dae8de-f084-4de1-ae32-033aad30af22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:30.878886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dae8de-f084-4de1-ae32-033aad30af22 admin admin] PATH_INFO: `/v3/users/0956a809a3644e44992d0708ef7e478d` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:30.880067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dae8de-f084-4de1-ae32-033aad30af22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0956a809a3644e44992d0708ef7e478d)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:30.881952 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dae8de-f084-4de1-ae32-033aad30af22 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:30.922546 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:05:30.929465 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-25dae8de-f084-4de1-ae32-033aad30af22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0956a809a3644e44992d0708ef7e478d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:30.930431 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-25dae8de-f084-4de1-ae32-033aad30af22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0956a809a3644e44992d0708ef7e478d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:30.943412 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-25dae8de-f084-4de1-ae32-033aad30af22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0956a809a3644e44992d0708ef7e478d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:30.950602 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-25dae8de-f084-4de1-ae32-033aad30af22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0956a809a3644e44992d0708ef7e478d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:30.958891 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-25dae8de-f084-4de1-ae32-033aad30af22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0956a809a3644e44992d0708ef7e478d'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:30.965530 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1436/2871] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 23:05:30 2022] DELETE /identity/v3/users/0956a809a3644e44992d0708ef7e478d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:05:30.971007 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1d037-627a-4fe8-85d0-96c8779bc6fc None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:30.971306 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1d037-627a-4fe8-85d0-96c8779bc6fc None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:30.971589 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1d037-627a-4fe8-85d0-96c8779bc6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:30.994775 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-58f1d037-627a-4fe8-85d0-96c8779bc6fc None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:05:30.995987 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-58f1d037-627a-4fe8-85d0-96c8779bc6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:31.049837 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:05:31.065999 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1436/2872] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 23:05:31.075653 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dae8de-f084-4de1-ae32-033aad30af22 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:31.077067 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-25dae8de-f084-4de1-ae32-033aad30af22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:31.136269 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dae8de-f084-4de1-ae32-033aad30af22 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:31.139931 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526fd4d-0466-4fbf-acb0-035d6fc0d0bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:31.140553 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526fd4d-0466-4fbf-acb0-035d6fc0d0bd service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:31.140841 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526fd4d-0466-4fbf-acb0-035d6fc0d0bd service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:31.141122 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526fd4d-0466-4fbf-acb0-035d6fc0d0bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:31.150273 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526fd4d-0466-4fbf-acb0-035d6fc0d0bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:31.151714 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526fd4d-0466-4fbf-acb0-035d6fc0d0bd service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:31.162783 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1437/2873] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:05:31.437869 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1d037-627a-4fe8-85d0-96c8779bc6fc None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:31.439904 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-58f1d037-627a-4fe8-85d0-96c8779bc6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:31.453798 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1d037-627a-4fe8-85d0-96c8779bc6fc None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:31.458723 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97cd0f4-f5d0-4029-a43e-dc77a116bf68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:31.459854 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cd0f4-f5d0-4029-a43e-dc77a116bf68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:31.460484 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cd0f4-f5d0-4029-a43e-dc77a116bf68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:31.460762 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97cd0f4-f5d0-4029-a43e-dc77a116bf68 admin admin] PATH_INFO: `/v3/projects/bcf92be9ff04464a873e5a6c5c8f643a` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:31.462196 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cd0f4-f5d0-4029-a43e-dc77a116bf68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcf92be9ff04464a873e5a6c5c8f643a)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:31.464105 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97cd0f4-f5d0-4029-a43e-dc77a116bf68 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:31.512182 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c97cd0f4-f5d0-4029-a43e-dc77a116bf68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcf92be9ff04464a873e5a6c5c8f643a', 'request_id': 'req-c97cd0f4-f5d0-4029-a43e-dc77a116bf68'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:31.520000 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c97cd0f4-f5d0-4029-a43e-dc77a116bf68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcf92be9ff04464a873e5a6c5c8f643a', 'request_id': 'req-c97cd0f4-f5d0-4029-a43e-dc77a116bf68'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:31.526664 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c97cd0f4-f5d0-4029-a43e-dc77a116bf68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcf92be9ff04464a873e5a6c5c8f643a', 'request_id': 'req-c97cd0f4-f5d0-4029-a43e-dc77a116bf68'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:31.539550 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c97cd0f4-f5d0-4029-a43e-dc77a116bf68 admin admin] The token cache is being invalidate because project bcf92be9ff04464a873e5a6c5c8f643a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 23:05:31.539953 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c97cd0f4-f5d0-4029-a43e-dc77a116bf68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:31.540570 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-c97cd0f4-f5d0-4029-a43e-dc77a116bf68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:31.542091 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1437/2874] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 23:05:31 2022] DELETE /identity/v3/projects/bcf92be9ff04464a873e5a6c5c8f643a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:05:31.547757 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a091e-999c-40b4-bd65-49b55772cb78 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:31.548049 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a091e-999c-40b4-bd65-49b55772cb78 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:31.548335 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73a091e-999c-40b4-bd65-49b55772cb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:31.568403 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-d73a091e-999c-40b4-bd65-49b55772cb78 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:05:31.569604 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-d73a091e-999c-40b4-bd65-49b55772cb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:31.630577 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1438/2875] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:05:31.638998 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f602ae5-032e-4645-ad72-18cd083de35e None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:31.639285 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f602ae5-032e-4645-ad72-18cd083de35e None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:31.639558 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f602ae5-032e-4645-ad72-18cd083de35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:31.658470 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-5f602ae5-032e-4645-ad72-18cd083de35e None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:05:31.659655 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-5f602ae5-032e-4645-ad72-18cd083de35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:31.667376 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1438/2876] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:05:31.671460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a091e-999c-40b4-bd65-49b55772cb78 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:31.681509 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73a091e-999c-40b4-bd65-49b55772cb78 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:31.686579 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89750a6d-1b1b-4ab7-855b-2b8d7039165b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:31.687193 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89750a6d-1b1b-4ab7-855b-2b8d7039165b admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:31.687476 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89750a6d-1b1b-4ab7-855b-2b8d7039165b admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:31.687752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89750a6d-1b1b-4ab7-855b-2b8d7039165b admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:31.688445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89750a6d-1b1b-4ab7-855b-2b8d7039165b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 23:05:31.688752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89750a6d-1b1b-4ab7-855b-2b8d7039165b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:31.690329 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89750a6d-1b1b-4ab7-855b-2b8d7039165b admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:31.702221 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1439/2877] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 23:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 23:05:31.706514 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f602ae5-032e-4645-ad72-18cd083de35e None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:31.715840 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f602ae5-032e-4645-ad72-18cd083de35e None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:31.721761 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a925fef-f9b7-4e14-abd3-99e2126b94d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:31.722523 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a925fef-f9b7-4e14-abd3-99e2126b94d7 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:31.722842 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a925fef-f9b7-4e14-abd3-99e2126b94d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:31.723122 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a925fef-f9b7-4e14-abd3-99e2126b94d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:31.723792 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a925fef-f9b7-4e14-abd3-99e2126b94d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:31.725766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a925fef-f9b7-4e14-abd3-99e2126b94d7 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:31.753732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1439/2878] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 23:05:31 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 23:05:31.757773 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89750a6d-1b1b-4ab7-855b-2b8d7039165b admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:31.768436 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89750a6d-1b1b-4ab7-855b-2b8d7039165b admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:31.811388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:05:31.826467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a12387-3e9d-459d-bb9f-f5b4174de1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:31.827082 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a12387-3e9d-459d-bb9f-f5b4174de1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:31.827369 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a12387-3e9d-459d-bb9f-f5b4174de1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:31.827647 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a12387-3e9d-459d-bb9f-f5b4174de1c6 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:31.828304 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a12387-3e9d-459d-bb9f-f5b4174de1c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:31.830241 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a12387-3e9d-459d-bb9f-f5b4174de1c6 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:31.851664 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1440/2879] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 23:05:31 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 23:05:31.855744 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a925fef-f9b7-4e14-abd3-99e2126b94d7 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:31.865835 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a925fef-f9b7-4e14-abd3-99e2126b94d7 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:31.870932 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba785d30-7ff1-4836-9fb3-71a930e230e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:31.871544 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba785d30-7ff1-4836-9fb3-71a930e230e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:31.871831 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba785d30-7ff1-4836-9fb3-71a930e230e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:31.872598 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba785d30-7ff1-4836-9fb3-71a930e230e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:31.873842 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba785d30-7ff1-4836-9fb3-71a930e230e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:31.876355 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba785d30-7ff1-4836-9fb3-71a930e230e5 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:31.887476 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1440/2880] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 23:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 23:05:31.891930 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a12387-3e9d-459d-bb9f-f5b4174de1c6 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:31.901767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a12387-3e9d-459d-bb9f-f5b4174de1c6 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:31.906467 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b9b06f-2fbc-44c4-a799-c0f713a24cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:31.907106 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9b06f-2fbc-44c4-a799-c0f713a24cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:31.907396 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9b06f-2fbc-44c4-a799-c0f713a24cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:31.907677 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b9b06f-2fbc-44c4-a799-c0f713a24cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:31.908377 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9b06f-2fbc-44c4-a799-c0f713a24cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:31.909957 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b9b06f-2fbc-44c4-a799-c0f713a24cd4 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:31.921005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1441/2881] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 23:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 23:05:31.924830 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba785d30-7ff1-4836-9fb3-71a930e230e5 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:31.935238 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba785d30-7ff1-4836-9fb3-71a930e230e5 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:31.939771 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99892465-8394-4639-b46c-c76526498def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:31.940425 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99892465-8394-4639-b46c-c76526498def admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:31.940709 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99892465-8394-4639-b46c-c76526498def admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:31.940986 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99892465-8394-4639-b46c-c76526498def admin admin] PATH_INFO: `/v3/projects/b5668669031448cdaa0794888c36a098/users/dd6afdb4b0f94fecae90c1c27995dc2e/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:31.956896 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99892465-8394-4639-b46c-c76526498def admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5668669031448cdaa0794888c36a098, user_id=dd6afdb4b0f94fecae90c1c27995dc2e, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:31.960111 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99892465-8394-4639-b46c-c76526498def admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:31.973096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1441/2882] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 23:05:31 2022] PUT /identity/v3/projects/b5668669031448cdaa0794888c36a098/users/dd6afdb4b0f94fecae90c1c27995dc2e/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:05:31.983835 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969302b6-8e60-4e12-91d6-3d16e47d7191 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:31.984120 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969302b6-8e60-4e12-91d6-3d16e47d7191 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:31.984399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969302b6-8e60-4e12-91d6-3d16e47d7191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:32.011470 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-969302b6-8e60-4e12-91d6-3d16e47d7191 None None] MFA Rules not processed for user `dd6afdb4b0f94fecae90c1c27995dc2e`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:05:32.012674 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-969302b6-8e60-4e12-91d6-3d16e47d7191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:32.074643 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1442/2883] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:05:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:05:32.085169 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99892465-8394-4639-b46c-c76526498def admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:32.087143 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-99892465-8394-4639-b46c-c76526498def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:32.142838 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99892465-8394-4639-b46c-c76526498def admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:32.146508 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886159f-6ea7-4217-8894-ddd29caef552 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ac8dcdbe57646f79593e7f39dc60900', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:32.147121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886159f-6ea7-4217-8894-ddd29caef552 service cinder] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:32.147408 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886159f-6ea7-4217-8894-ddd29caef552 service cinder] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:32.147687 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886159f-6ea7-4217-8894-ddd29caef552 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:32.155797 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886159f-6ea7-4217-8894-ddd29caef552 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:32.157227 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886159f-6ea7-4217-8894-ddd29caef552 service cinder] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:32.166005 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1442/2884] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:05:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:05:35.347312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969302b6-8e60-4e12-91d6-3d16e47d7191 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:35.407996 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969302b6-8e60-4e12-91d6-3d16e47d7191 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:35.412484 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b31484-749f-4b1d-8fa4-4e916095c3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:35.413150 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b31484-749f-4b1d-8fa4-4e916095c3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:35.413435 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b31484-749f-4b1d-8fa4-4e916095c3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:35.413714 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b31484-749f-4b1d-8fa4-4e916095c3d0 admin admin] PATH_INFO: `/v3/users/dd6afdb4b0f94fecae90c1c27995dc2e` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:35.414892 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b31484-749f-4b1d-8fa4-4e916095c3d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd6afdb4b0f94fecae90c1c27995dc2e)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:35.416788 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b31484-749f-4b1d-8fa4-4e916095c3d0 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:35.463243 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-77b31484-749f-4b1d-8fa4-4e916095c3d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd6afdb4b0f94fecae90c1c27995dc2e'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:35.463900 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-77b31484-749f-4b1d-8fa4-4e916095c3d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd6afdb4b0f94fecae90c1c27995dc2e'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:35.470805 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:05:35.477540 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-77b31484-749f-4b1d-8fa4-4e916095c3d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd6afdb4b0f94fecae90c1c27995dc2e'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:35.486354 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-77b31484-749f-4b1d-8fa4-4e916095c3d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd6afdb4b0f94fecae90c1c27995dc2e'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:35.493072 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-77b31484-749f-4b1d-8fa4-4e916095c3d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd6afdb4b0f94fecae90c1c27995dc2e'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:35.499372 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1443/2885] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 23:05:35 2022] DELETE /identity/v3/users/dd6afdb4b0f94fecae90c1c27995dc2e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:05:35.503846 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978cc87-1964-48a7-8a2e-250eabe4674a None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:35.504330 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978cc87-1964-48a7-8a2e-250eabe4674a None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:35.504437 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978cc87-1964-48a7-8a2e-250eabe4674a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:35.523615 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-2978cc87-1964-48a7-8a2e-250eabe4674a None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:05:35.524840 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-2978cc87-1964-48a7-8a2e-250eabe4674a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:35.534582 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:05:35.590691 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1443/2886] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:05:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 23:05:35.600295 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b31484-749f-4b1d-8fa4-4e916095c3d0 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:35.601710 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-77b31484-749f-4b1d-8fa4-4e916095c3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:35.658594 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b31484-749f-4b1d-8fa4-4e916095c3d0 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:35.662121 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8b99f-2961-45f6-80a9-e48abd0a852b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:35.662761 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8b99f-2961-45f6-80a9-e48abd0a852b service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:35.663047 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8b99f-2961-45f6-80a9-e48abd0a852b service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:35.663325 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8b99f-2961-45f6-80a9-e48abd0a852b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:35.672670 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8b99f-2961-45f6-80a9-e48abd0a852b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:35.674080 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8b99f-2961-45f6-80a9-e48abd0a852b service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:35.683361 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1444/2887] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:05:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:05:35.961799 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978cc87-1964-48a7-8a2e-250eabe4674a None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:35.963320 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-2978cc87-1964-48a7-8a2e-250eabe4674a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:35.976625 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978cc87-1964-48a7-8a2e-250eabe4674a None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:35.984828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3952d65e-0d4e-4ff1-af1f-0c003b673b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:35.985506 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952d65e-0d4e-4ff1-af1f-0c003b673b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:35.985795 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952d65e-0d4e-4ff1-af1f-0c003b673b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:35.986125 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952d65e-0d4e-4ff1-af1f-0c003b673b48 admin admin] PATH_INFO: `/v3/projects/b5668669031448cdaa0794888c36a098` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:35.987427 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952d65e-0d4e-4ff1-af1f-0c003b673b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5668669031448cdaa0794888c36a098)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:35.989344 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3952d65e-0d4e-4ff1-af1f-0c003b673b48 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:36.036206 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-3952d65e-0d4e-4ff1-af1f-0c003b673b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5668669031448cdaa0794888c36a098', 'request_id': 'req-3952d65e-0d4e-4ff1-af1f-0c003b673b48'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:36.042159 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-3952d65e-0d4e-4ff1-af1f-0c003b673b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5668669031448cdaa0794888c36a098', 'request_id': 'req-3952d65e-0d4e-4ff1-af1f-0c003b673b48'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:36.048441 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-3952d65e-0d4e-4ff1-af1f-0c003b673b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5668669031448cdaa0794888c36a098', 'request_id': 'req-3952d65e-0d4e-4ff1-af1f-0c003b673b48'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:36.061424 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-3952d65e-0d4e-4ff1-af1f-0c003b673b48 admin admin] The token cache is being invalidate because project b5668669031448cdaa0794888c36a098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 23:05:36.061713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-3952d65e-0d4e-4ff1-af1f-0c003b673b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:36.062326 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-3952d65e-0d4e-4ff1-af1f-0c003b673b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:05:36.063861 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1444/2888] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 23:05:35 2022] DELETE /identity/v3/projects/b5668669031448cdaa0794888c36a098 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:05:36.069499 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f8303-c328-40cc-bf08-07363d223451 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:36.069794 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f8303-c328-40cc-bf08-07363d223451 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:36.070074 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f8303-c328-40cc-bf08-07363d223451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:36.089646 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-af6f8303-c328-40cc-bf08-07363d223451 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:05:36.090886 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-af6f8303-c328-40cc-bf08-07363d223451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:36.148914 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1445/2889] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:05:36.157234 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27194b-6d9c-459d-b386-588d8e137547 None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:36.157525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27194b-6d9c-459d-b386-588d8e137547 None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:36.157806 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27194b-6d9c-459d-b386-588d8e137547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:36.177515 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-2c27194b-6d9c-459d-b386-588d8e137547 None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:05:36.178766 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-2c27194b-6d9c-459d-b386-588d8e137547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:36.187478 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1445/2890] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:05:36.191749 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f8303-c328-40cc-bf08-07363d223451 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:36.201466 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f8303-c328-40cc-bf08-07363d223451 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:36.206005 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f44501-302e-4365-a62d-8fe690c8795e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:36.206583 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f44501-302e-4365-a62d-8fe690c8795e admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:36.206868 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f44501-302e-4365-a62d-8fe690c8795e admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:36.207144 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f44501-302e-4365-a62d-8fe690c8795e admin admin] PATH_INFO: `/v3/domains` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:36.207828 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f44501-302e-4365-a62d-8fe690c8795e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86594) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 23:05:36.208130 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f44501-302e-4365-a62d-8fe690c8795e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:36.209706 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f44501-302e-4365-a62d-8fe690c8795e admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:36.221527 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1446/2891] 10.222.0.48 () {58 vars in 1153 bytes} [Wed Jul 27 23:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 23:05:36.225860 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27194b-6d9c-459d-b386-588d8e137547 None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:36.235626 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27194b-6d9c-459d-b386-588d8e137547 None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:36.240197 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18300034-efd7-4823-a162-ba419ffd83b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:36.240800 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18300034-efd7-4823-a162-ba419ffd83b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:36.241082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18300034-efd7-4823-a162-ba419ffd83b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:36.241356 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18300034-efd7-4823-a162-ba419ffd83b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:36.242027 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18300034-efd7-4823-a162-ba419ffd83b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:36.243946 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18300034-efd7-4823-a162-ba419ffd83b0 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:36.270683 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1446/2892] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 23:05:36 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 23:05:36.274815 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f44501-302e-4365-a62d-8fe690c8795e admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:36.285006 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f44501-302e-4365-a62d-8fe690c8795e admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:36.338982 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871aee03-9de5-4cf6-b6d8-e283e9266375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:36.339588 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871aee03-9de5-4cf6-b6d8-e283e9266375 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:36.339868 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871aee03-9de5-4cf6-b6d8-e283e9266375 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:36.340142 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871aee03-9de5-4cf6-b6d8-e283e9266375 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:36.340790 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871aee03-9de5-4cf6-b6d8-e283e9266375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:36.343208 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871aee03-9de5-4cf6-b6d8-e283e9266375 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:36.352663 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:05:36.365911 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1447/2893] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 23:05:36 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 23:05:36.370011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18300034-efd7-4823-a162-ba419ffd83b0 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:36.380534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18300034-efd7-4823-a162-ba419ffd83b0 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:36.385217 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bba6a-1429-4f87-a168-4699e00a4969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:36.385820 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bba6a-1429-4f87-a168-4699e00a4969 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:36.386099 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bba6a-1429-4f87-a168-4699e00a4969 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:36.386395 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bba6a-1429-4f87-a168-4699e00a4969 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:36.387088 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bba6a-1429-4f87-a168-4699e00a4969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:36.389194 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bba6a-1429-4f87-a168-4699e00a4969 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:36.398849 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1447/2894] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 23:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 23:05:36.402490 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871aee03-9de5-4cf6-b6d8-e283e9266375 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:36.412695 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871aee03-9de5-4cf6-b6d8-e283e9266375 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:36.417155 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41069e-8797-4a3a-924a-50290360140c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:36.417754 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41069e-8797-4a3a-924a-50290360140c admin admin] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:36.418034 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41069e-8797-4a3a-924a-50290360140c admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:36.418312 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41069e-8797-4a3a-924a-50290360140c admin admin] PATH_INFO: `/v3/roles` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:36.419016 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41069e-8797-4a3a-924a-50290360140c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:36.420581 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41069e-8797-4a3a-924a-50290360140c admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:36.430739 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1448/2895] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 23:05:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 23:05:36.434542 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bba6a-1429-4f87-a168-4699e00a4969 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:36.444228 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bba6a-1429-4f87-a168-4699e00a4969 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:36.448818 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df698d0-5c1a-4942-baf4-315b6127f417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:36.449470 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df698d0-5c1a-4942-baf4-315b6127f417 admin admin] REQUEST_METHOD: `PUT` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:36.449753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df698d0-5c1a-4942-baf4-315b6127f417 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:36.450030 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df698d0-5c1a-4942-baf4-315b6127f417 admin admin] PATH_INFO: `/v3/projects/c93422f894ac4cee8301a60de150bce2/users/0fae21419d9a4d59b1fa4918829b6b81/roles/267b3ef4524c42bb90a7002ee1639b74` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:36.464908 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df698d0-5c1a-4942-baf4-315b6127f417 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c93422f894ac4cee8301a60de150bce2, user_id=0fae21419d9a4d59b1fa4918829b6b81, role_id=267b3ef4524c42bb90a7002ee1639b74)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:36.468111 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df698d0-5c1a-4942-baf4-315b6127f417 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:36.480739 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1448/2896] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 23:05:36 2022] PUT /identity/v3/projects/c93422f894ac4cee8301a60de150bce2/users/0fae21419d9a4d59b1fa4918829b6b81/roles/267b3ef4524c42bb90a7002ee1639b74 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:05:36.486237 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb600e5-773d-44bf-a7c3-7da14460104f None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:36.486575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb600e5-773d-44bf-a7c3-7da14460104f None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:36.486905 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb600e5-773d-44bf-a7c3-7da14460104f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:36.506575 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-1bb600e5-773d-44bf-a7c3-7da14460104f None None] MFA Rules not processed for user `823fd54d00af495593a275a61c2223da`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:05:36.507777 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-1bb600e5-773d-44bf-a7c3-7da14460104f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:36.565460 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1449/2897] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:05:36.575046 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df698d0-5c1a-4942-baf4-315b6127f417 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:36.577273 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-1df698d0-5c1a-4942-baf4-315b6127f417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:36.617241 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:05:36.635739 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df698d0-5c1a-4942-baf4-315b6127f417 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:36.639981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a489a-fbee-4700-9d03-2c11ecd90603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:36.640602 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a489a-fbee-4700-9d03-2c11ecd90603 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:36.640886 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a489a-fbee-4700-9d03-2c11ecd90603 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:36.641165 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818a489a-fbee-4700-9d03-2c11ecd90603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:36.650016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a489a-fbee-4700-9d03-2c11ecd90603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:36.651486 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818a489a-fbee-4700-9d03-2c11ecd90603 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:36.661313 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1449/2898] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:05:40.614630 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf489cef-3966-493b-9be3-fe6346445b2e None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:40.615546 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf489cef-3966-493b-9be3-fe6346445b2e None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:40.616037 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf489cef-3966-493b-9be3-fe6346445b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:40.647166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-bf489cef-3966-493b-9be3-fe6346445b2e None None] MFA Rules not processed for user `0fae21419d9a4d59b1fa4918829b6b81`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:05:40.648388 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-bf489cef-3966-493b-9be3-fe6346445b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:40.719461 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1450/2899] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:05:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:05:40.720634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a489a-fbee-4700-9d03-2c11ecd90603 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:40.730732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818a489a-fbee-4700-9d03-2c11ecd90603 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:40.735497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd4004-8652-45cd-8d42-a782b284450e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:40.736116 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd4004-8652-45cd-8d42-a782b284450e admin admin] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:40.736400 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd4004-8652-45cd-8d42-a782b284450e admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:40.736669 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bd4004-8652-45cd-8d42-a782b284450e admin admin] PATH_INFO: `/v3/projects` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:40.737348 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd4004-8652-45cd-8d42-a782b284450e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:40.739259 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bd4004-8652-45cd-8d42-a782b284450e admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:40.772546 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1450/2900] 10.222.0.48 () {60 vars in 1153 bytes} [Wed Jul 27 23:05:40 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 23:05:40.773492 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf489cef-3966-493b-9be3-fe6346445b2e None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:40.785423 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf489cef-3966-493b-9be3-fe6346445b2e None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:40.846117 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9998037-38c5-4e81-b14c-406c900dc4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:40.846802 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9998037-38c5-4e81-b14c-406c900dc4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:40.847083 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9998037-38c5-4e81-b14c-406c900dc4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:40.847356 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9998037-38c5-4e81-b14c-406c900dc4b1 admin admin] PATH_INFO: `/v3/users` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:40.848015 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9998037-38c5-4e81-b14c-406c900dc4b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:40.849950 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9998037-38c5-4e81-b14c-406c900dc4b1 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:40.873534 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1451/2901] 10.222.0.48 () {60 vars in 1144 bytes} [Wed Jul 27 23:05:40 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 23:05:40.877634 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd4004-8652-45cd-8d42-a782b284450e admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:40.888900 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bd4004-8652-45cd-8d42-a782b284450e admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:40.893525 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99839a41-6825-4d3c-bc5b-32835c95d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:40.894139 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99839a41-6825-4d3c-bc5b-32835c95d317 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:40.894459 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99839a41-6825-4d3c-bc5b-32835c95d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:40.894741 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99839a41-6825-4d3c-bc5b-32835c95d317 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:40.895438 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99839a41-6825-4d3c-bc5b-32835c95d317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:40.897031 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99839a41-6825-4d3c-bc5b-32835c95d317 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:40.907570 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1451/2902] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 23:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 23:05:40.911771 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9998037-38c5-4e81-b14c-406c900dc4b1 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:40.916857 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:05:40.923566 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9998037-38c5-4e81-b14c-406c900dc4b1 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:40.928470 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae5ef7-7d02-4957-adbe-a43bebd74915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:40.929131 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae5ef7-7d02-4957-adbe-a43bebd74915 admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:40.929413 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae5ef7-7d02-4957-adbe-a43bebd74915 admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:40.929689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ae5ef7-7d02-4957-adbe-a43bebd74915 admin admin] PATH_INFO: `/v3/projects/9853e4faae9d4f08b926260aba4d84ec/users/c10697b743ee44f986011a38905a600c/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:40.944663 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae5ef7-7d02-4957-adbe-a43bebd74915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9853e4faae9d4f08b926260aba4d84ec, user_id=c10697b743ee44f986011a38905a600c, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:40.947319 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ae5ef7-7d02-4957-adbe-a43bebd74915 admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:40.959989 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1452/2903] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 23:05:40 2022] PUT /identity/v3/projects/9853e4faae9d4f08b926260aba4d84ec/users/c10697b743ee44f986011a38905a600c/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 23:05:40.964258 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99839a41-6825-4d3c-bc5b-32835c95d317 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:40.974194 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99839a41-6825-4d3c-bc5b-32835c95d317 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:41.031292 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae7153-7358-46b5-bad1-76956b0abb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:41.031929 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae7153-7358-46b5-bad1-76956b0abb34 admin admin] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:41.032214 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae7153-7358-46b5-bad1-76956b0abb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:41.032487 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae7153-7358-46b5-bad1-76956b0abb34 admin admin] PATH_INFO: `/v3/roles` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:41.033185 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae7153-7358-46b5-bad1-76956b0abb34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:41.034848 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae7153-7358-46b5-bad1-76956b0abb34 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:41.044756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1452/2904] 10.222.0.48 () {58 vars in 1122 bytes} [Wed Jul 27 23:05:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 23:05:41.049112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae5ef7-7d02-4957-adbe-a43bebd74915 admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:41.059052 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ae5ef7-7d02-4957-adbe-a43bebd74915 admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:41.063592 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7beb030-731a-45e3-9d4e-42302e2d8a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:41.064245 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7beb030-731a-45e3-9d4e-42302e2d8a8f admin admin] REQUEST_METHOD: `PUT` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:41.064524 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7beb030-731a-45e3-9d4e-42302e2d8a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:41.064799 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7beb030-731a-45e3-9d4e-42302e2d8a8f admin admin] PATH_INFO: `/v3/projects/9853e4faae9d4f08b926260aba4d84ec/users/c10697b743ee44f986011a38905a600c/roles/49e0ba8d8c9f4824892b61f05d0036e8` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:41.066756 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7beb030-731a-45e3-9d4e-42302e2d8a8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9853e4faae9d4f08b926260aba4d84ec, user_id=c10697b743ee44f986011a38905a600c, role_id=49e0ba8d8c9f4824892b61f05d0036e8)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:41.069398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7beb030-731a-45e3-9d4e-42302e2d8a8f admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:41.079819 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1453/2905] 10.222.0.48 () {60 vars in 1483 bytes} [Wed Jul 27 23:05:41 2022] PUT /identity/v3/projects/9853e4faae9d4f08b926260aba4d84ec/users/c10697b743ee44f986011a38905a600c/roles/49e0ba8d8c9f4824892b61f05d0036e8 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:05:45.802482 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e146fe-0b89-4c3f-8fbc-8bed8ef70afb None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:45.802948 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e146fe-0b89-4c3f-8fbc-8bed8ef70afb None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:45.803048 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e146fe-0b89-4c3f-8fbc-8bed8ef70afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:45.837599 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-f5e146fe-0b89-4c3f-8fbc-8bed8ef70afb None None] MFA Rules not processed for user `c10697b743ee44f986011a38905a600c`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:05:45.838855 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-f5e146fe-0b89-4c3f-8fbc-8bed8ef70afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:45.911753 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1453/2906] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:05:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:05:45.929133 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7beb030-731a-45e3-9d4e-42302e2d8a8f admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:45.931590 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-b7beb030-731a-45e3-9d4e-42302e2d8a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:46.033079 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7beb030-731a-45e3-9d4e-42302e2d8a8f admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:46.036894 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e49733-21b5-4348-80f7-253b337b83eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b26c60d08b9f47aca8404e4173290908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:46.037520 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e49733-21b5-4348-80f7-253b337b83eb service glance] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:46.037808 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e49733-21b5-4348-80f7-253b337b83eb service glance] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:46.038082 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e49733-21b5-4348-80f7-253b337b83eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:46.096135 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e49733-21b5-4348-80f7-253b337b83eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:46.097573 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e49733-21b5-4348-80f7-253b337b83eb service glance] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:46.106914 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1454/2907] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:05:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:05:46.232462 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958b0c2-22cc-4847-9c29-9756abb83b9b None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:46.232756 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958b0c2-22cc-4847-9c29-9756abb83b9b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:46.233032 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958b0c2-22cc-4847-9c29-9756abb83b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:46.277184 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:05:46.287497 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-9958b0c2-22cc-4847-9c29-9756abb83b9b None None] MFA Rules not processed for user `db10ad54ec9948a3bb8b04c708fc4ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:05:46.288779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-9958b0c2-22cc-4847-9c29-9756abb83b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:46.358590 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1454/2908] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 23:05:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:05:46.404705 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e49733-21b5-4348-80f7-253b337b83eb service glance] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:46.406240 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-70e49733-21b5-4348-80f7-253b337b83eb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:46.469830 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:05:46.505087 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e49733-21b5-4348-80f7-253b337b83eb service glance] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:46.510322 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292a1a0-7556-48f0-ae4d-9857c1b4c09f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf405258b9d413fae1192e10250b6a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:46.510972 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292a1a0-7556-48f0-ae4d-9857c1b4c09f service swift] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:46.511259 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292a1a0-7556-48f0-ae4d-9857c1b4c09f service swift] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:46.511537 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292a1a0-7556-48f0-ae4d-9857c1b4c09f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:46.519903 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292a1a0-7556-48f0-ae4d-9857c1b4c09f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:46.521478 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e292a1a0-7556-48f0-ae4d-9857c1b4c09f service swift] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:46.530112 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1455/2909] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 23:05:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 23:05:56.082145 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf18fe7-f808-41d7-a508-167da2fc094b None None] REQUEST_METHOD: `POST` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:56.082661 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf18fe7-f808-41d7-a508-167da2fc094b None None] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:56.082764 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf18fe7-f808-41d7-a508-167da2fc094b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:56.101928 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.auth.core [None req-ecf18fe7-f808-41d7-a508-167da2fc094b None None] MFA Rules not processed for user `0fae21419d9a4d59b1fa4918829b6b81`. Rule list: `[]` (Enabled: `True`). {{(pid=86595) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:05:56.103243 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ecf18fe7-f808-41d7-a508-167da2fc094b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:56.111157 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1455/2910] 10.222.0.48 () {58 vars in 958 bytes} [Wed Jul 27 23:05:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:05:56.152753 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292a1a0-7556-48f0-ae4d-9857c1b4c09f service swift] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:56.162141 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e292a1a0-7556-48f0-ae4d-9857c1b4c09f service swift] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:56.166480 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66392699-0ef8-431c-bcd1-93865f2e5e6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b26c60d08b9f47aca8404e4173290908', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:56.167077 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66392699-0ef8-431c-bcd1-93865f2e5e6f service glance] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:56.167361 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66392699-0ef8-431c-bcd1-93865f2e5e6f service glance] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:56.167641 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66392699-0ef8-431c-bcd1-93865f2e5e6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:56.170028 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-66392699-0ef8-431c-bcd1-93865f2e5e6f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:56.240235 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66392699-0ef8-431c-bcd1-93865f2e5e6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:56.241608 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66392699-0ef8-431c-bcd1-93865f2e5e6f service glance] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:56.253101 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1456/2911] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:05:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:05:56.785151 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf18fe7-f808-41d7-a508-167da2fc094b None None] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:56.786678 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ecf18fe7-f808-41d7-a508-167da2fc094b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:56.788654 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66392699-0ef8-431c-bcd1-93865f2e5e6f service glance] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:56.845247 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66392699-0ef8-431c-bcd1-93865f2e5e6f service glance] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:56.848752 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dfd37-2c3d-467d-b49f-546d84942caa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:56.849399 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dfd37-2c3d-467d-b49f-546d84942caa service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:56.849715 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dfd37-2c3d-467d-b49f-546d84942caa service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:56.850019 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dfd37-2c3d-467d-b49f-546d84942caa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:56.851858 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-1b0dfd37-2c3d-467d-b49f-546d84942caa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:56.857082 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf18fe7-f808-41d7-a508-167da2fc094b None None] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:56.861924 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23ab71-1e77-489d-be7b-ae94829d8893 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a1384f3b34999a75572ee10a1e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:56.862569 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23ab71-1e77-489d-be7b-ae94829d8893 service placement] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:56.862857 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23ab71-1e77-489d-be7b-ae94829d8893 service placement] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:56.863130 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23ab71-1e77-489d-be7b-ae94829d8893 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:56.864852 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-4d23ab71-1e77-489d-be7b-ae94829d8893 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:56.865348 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dfd37-2c3d-467d-b49f-546d84942caa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:56.866819 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dfd37-2c3d-467d-b49f-546d84942caa service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:56.876074 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23ab71-1e77-489d-be7b-ae94829d8893 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:56.877631 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23ab71-1e77-489d-be7b-ae94829d8893 service placement] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:56.877939 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1457/2912] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:05:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:05:56.888001 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1456/2913] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:05:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 23:05:58.142532 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88350eb-9406-40dc-a82e-32efdeab51e3 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:58.143051 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88350eb-9406-40dc-a82e-32efdeab51e3 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:58.143154 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88350eb-9406-40dc-a82e-32efdeab51e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:58.164445 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-e88350eb-9406-40dc-a82e-32efdeab51e3 None None] MFA Rules not processed for user `db10ad54ec9948a3bb8b04c708fc4ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:05:58.165656 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e88350eb-9406-40dc-a82e-32efdeab51e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:05:58.173076 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1458/2914] 10.222.0.48 () {58 vars in 1009 bytes} [Wed Jul 27 23:05:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:05:58.184930 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23ab71-1e77-489d-be7b-ae94829d8893 service placement] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:05:58.196240 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23ab71-1e77-489d-be7b-ae94829d8893 service placement] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:05:58.201670 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79ec49-a42c-43a5-917a-3d8460986507 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf405258b9d413fae1192e10250b6a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:05:58.202470 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79ec49-a42c-43a5-917a-3d8460986507 service swift] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:05:58.202758 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79ec49-a42c-43a5-917a-3d8460986507 service swift] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:05:58.203036 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79ec49-a42c-43a5-917a-3d8460986507 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:05:58.211936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79ec49-a42c-43a5-917a-3d8460986507 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:05:58.213562 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79ec49-a42c-43a5-917a-3d8460986507 service swift] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:05:58.223929 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1457/2915] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 23:05:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 23:06:08.158071 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=77 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:06:08.220689 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=69 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:06:08.725776 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88350eb-9406-40dc-a82e-32efdeab51e3 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:06:08.727334 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-e88350eb-9406-40dc-a82e-32efdeab51e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:06:08.738585 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88350eb-9406-40dc-a82e-32efdeab51e3 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:06:08.742080 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62dca1-1357-437f-a85b-829ce8cf1140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:06:08.742721 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62dca1-1357-437f-a85b-829ce8cf1140 service neutron] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:06:08.743006 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62dca1-1357-437f-a85b-829ce8cf1140 service neutron] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:06:08.743281 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62dca1-1357-437f-a85b-829ce8cf1140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:06:08.744946 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-1d62dca1-1357-437f-a85b-829ce8cf1140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:06:08.754308 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62dca1-1357-437f-a85b-829ce8cf1140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:06:08.755689 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d62dca1-1357-437f-a85b-829ce8cf1140 service neutron] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:06:08.764135 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1459/2916] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:06:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:06:09.384673 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79ec49-a42c-43a5-917a-3d8460986507 service swift] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:06:09.386200 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-ab79ec49-a42c-43a5-917a-3d8460986507 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:06:09.405639 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79ec49-a42c-43a5-917a-3d8460986507 service swift] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:06:09.412983 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af2955-2e2a-4b10-8558-67e4c2ff8360 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:06:09.413646 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af2955-2e2a-4b10-8558-67e4c2ff8360 service nova] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:06:09.414006 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af2955-2e2a-4b10-8558-67e4c2ff8360 service nova] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:06:09.414507 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af2955-2e2a-4b10-8558-67e4c2ff8360 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:06:09.416947 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-b0af2955-2e2a-4b10-8558-67e4c2ff8360 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:06:09.431362 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af2955-2e2a-4b10-8558-67e4c2ff8360 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:06:09.433025 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0af2955-2e2a-4b10-8558-67e4c2ff8360 service nova] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:06:09.445096 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1458/2917] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:06:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:06:15.372894 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62dca1-1357-437f-a85b-829ce8cf1140 service neutron] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:06:15.386326 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62dca1-1357-437f-a85b-829ce8cf1140 service neutron] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:06:15.392443 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aec49d-bdc3-4b26-b110-f17ec4373186 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:06:15.393041 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aec49d-bdc3-4b26-b110-f17ec4373186 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:06:15.393322 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aec49d-bdc3-4b26-b110-f17ec4373186 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:06:15.393595 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aec49d-bdc3-4b26-b110-f17ec4373186 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:06:15.395398 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-37aec49d-bdc3-4b26-b110-f17ec4373186 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:06:15.407767 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aec49d-bdc3-4b26-b110-f17ec4373186 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:06:15.409441 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aec49d-bdc3-4b26-b110-f17ec4373186 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:06:15.420631 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1460/2918] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:06:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:06:19.440121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=6 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:06:22.896648 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af2955-2e2a-4b10-8558-67e4c2ff8360 service nova] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:06:22.906749 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af2955-2e2a-4b10-8558-67e4c2ff8360 service nova] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:06:22.911388 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a477a-fb0a-4168-8235-d18ea14d35d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266721767004428b9b54dd200f3cd6b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:06:22.912166 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a477a-fb0a-4168-8235-d18ea14d35d5 service neutron] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:06:22.912449 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a477a-fb0a-4168-8235-d18ea14d35d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:06:22.912726 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a477a-fb0a-4168-8235-d18ea14d35d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:06:22.923911 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a477a-fb0a-4168-8235-d18ea14d35d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:06:22.925337 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a477a-fb0a-4168-8235-d18ea14d35d5 service neutron] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:06:22.935426 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1459/2919] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:06:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:06:24.479878 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aec49d-bdc3-4b26-b110-f17ec4373186 service nova] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:06:24.482579 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-37aec49d-bdc3-4b26-b110-f17ec4373186 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:06:24.499283 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aec49d-bdc3-4b26-b110-f17ec4373186 service nova] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:06:24.505736 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c04ea-beb1-4e53-8b49-ff15e0a25172 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c621601261e44ca8a7938862d6578639', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:06:24.506370 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c04ea-beb1-4e53-8b49-ff15e0a25172 service nova] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:06:24.506679 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c04ea-beb1-4e53-8b49-ff15e0a25172 service nova] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:06:24.506958 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c04ea-beb1-4e53-8b49-ff15e0a25172 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:06:24.508703 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-124c04ea-beb1-4e53-8b49-ff15e0a25172 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:06:24.521579 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c04ea-beb1-4e53-8b49-ff15e0a25172 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:06:24.523212 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c04ea-beb1-4e53-8b49-ff15e0a25172 service nova] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:06:24.534737 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1461/2920] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:06:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:06:32.930671 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=6 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:06:34.529598 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=18 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:08:18.678712 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a477a-fb0a-4168-8235-d18ea14d35d5 service neutron] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:08:18.742415 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a477a-fb0a-4168-8235-d18ea14d35d5 service neutron] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:08:18.748026 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d5c22-b81f-4fbb-a7d2-e8adf078665d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a1384f3b34999a75572ee10a1e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:08:18.748641 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d5c22-b81f-4fbb-a7d2-e8adf078665d service placement] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:08:18.748925 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d5c22-b81f-4fbb-a7d2-e8adf078665d service placement] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:08:18.749201 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992d5c22-b81f-4fbb-a7d2-e8adf078665d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:08:18.750981 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-992d5c22-b81f-4fbb-a7d2-e8adf078665d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:08:18.784051 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d5c22-b81f-4fbb-a7d2-e8adf078665d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:08:18.785621 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992d5c22-b81f-4fbb-a7d2-e8adf078665d service placement] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:08:18.795517 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1460/2921] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:08:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:08:28.791270 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=36 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:08:55.567340 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4052121-1565-4e74-91cf-ea6897912cc0 None None] REQUEST_METHOD: `POST` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:08:55.567865 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4052121-1565-4e74-91cf-ea6897912cc0 None None] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:08:55.567970 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4052121-1565-4e74-91cf-ea6897912cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:08:55.597380 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.auth.core [None req-a4052121-1565-4e74-91cf-ea6897912cc0 None None] MFA Rules not processed for user `db10ad54ec9948a3bb8b04c708fc4ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=86594) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 23:08:55.598605 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-a4052121-1565-4e74-91cf-ea6897912cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:08:55.613028 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1462/2922] 10.222.0.48 () {58 vars in 967 bytes} [Wed Jul 27 23:08:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 23:08:55.653143 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d5c22-b81f-4fbb-a7d2-e8adf078665d service placement] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:08:55.664254 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992d5c22-b81f-4fbb-a7d2-e8adf078665d service placement] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:08:55.669728 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86297b-85df-47ba-8b4c-cfa12bce8fa3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'baf405258b9d413fae1192e10250b6a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:08:55.670375 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86297b-85df-47ba-8b4c-cfa12bce8fa3 service swift] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:08:55.670662 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86297b-85df-47ba-8b4c-cfa12bce8fa3 service swift] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:08:55.670936 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86297b-85df-47ba-8b4c-cfa12bce8fa3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:08:55.678726 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86297b-85df-47ba-8b4c-cfa12bce8fa3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:08:55.680296 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86297b-85df-47ba-8b4c-cfa12bce8fa3 service swift] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:08:55.688107 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1461/2923] 10.222.0.48 () {60 vars in 1384 bytes} [Wed Jul 27 23:08:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 23:08:59.090932 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4052121-1565-4e74-91cf-ea6897912cc0 None None] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:08:59.104210 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4052121-1565-4e74-91cf-ea6897912cc0 None None] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:08:59.109743 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bdc46-5a41-4975-84bd-7772da1909b0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a1384f3b34999a75572ee10a1e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:08:59.110479 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bdc46-5a41-4975-84bd-7772da1909b0 service placement] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:08:59.110802 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bdc46-5a41-4975-84bd-7772da1909b0 service placement] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:08:59.111188 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4bdc46-5a41-4975-84bd-7772da1909b0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:08:59.113000 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-fb4bdc46-5a41-4975-84bd-7772da1909b0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:08:59.124930 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4bdc46-5a41-4975-84bd-7772da1909b0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:08:59.126850 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4bdc46-5a41-4975-84bd-7772da1909b0 service placement] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:08:59.143448 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1463/2924] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:08:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:09:01.953547 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86297b-85df-47ba-8b4c-cfa12bce8fa3 service swift] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:09:01.966388 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86297b-85df-47ba-8b4c-cfa12bce8fa3 service swift] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:09:01.971513 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e8ddd-a99d-4b67-8492-b13905d76dc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a1384f3b34999a75572ee10a1e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:09:01.972143 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e8ddd-a99d-4b67-8492-b13905d76dc9 service placement] REQUEST_METHOD: `GET` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:09:01.972431 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e8ddd-a99d-4b67-8492-b13905d76dc9 service placement] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:09:01.972713 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e8ddd-a99d-4b67-8492-b13905d76dc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:09:01.974818 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-093e8ddd-a99d-4b67-8492-b13905d76dc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:09:01.989481 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e8ddd-a99d-4b67-8492-b13905d76dc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:09:01.991345 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e8ddd-a99d-4b67-8492-b13905d76dc9 service placement] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:09:02.004300 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1462/2925] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:09:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:09:02.019891 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bdc46-5a41-4975-84bd-7772da1909b0 service placement] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:09:02.108644 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4bdc46-5a41-4975-84bd-7772da1909b0 service placement] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:09:02.113166 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39840487-3a15-4576-a214-941e1952e51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:09:02.113801 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39840487-3a15-4576-a214-941e1952e51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:09:02.114086 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39840487-3a15-4576-a214-941e1952e51c admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:09:02.114392 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39840487-3a15-4576-a214-941e1952e51c admin admin] PATH_INFO: `/v3/users/0fae21419d9a4d59b1fa4918829b6b81` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:09:02.115566 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39840487-3a15-4576-a214-941e1952e51c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fae21419d9a4d59b1fa4918829b6b81)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:09:02.117528 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39840487-3a15-4576-a214-941e1952e51c admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:09:02.162254 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-39840487-3a15-4576-a214-941e1952e51c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fae21419d9a4d59b1fa4918829b6b81'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:09:02.164899 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-39840487-3a15-4576-a214-941e1952e51c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fae21419d9a4d59b1fa4918829b6b81'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:09:02.175180 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-39840487-3a15-4576-a214-941e1952e51c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fae21419d9a4d59b1fa4918829b6b81'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:09:02.182389 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-39840487-3a15-4576-a214-941e1952e51c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fae21419d9a4d59b1fa4918829b6b81'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:09:02.189405 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-39840487-3a15-4576-a214-941e1952e51c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fae21419d9a4d59b1fa4918829b6b81'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:09:02.195348 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1464/2926] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 23:09:02 2022] DELETE /identity/v3/users/0fae21419d9a4d59b1fa4918829b6b81 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:09:02.373640 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e8ddd-a99d-4b67-8492-b13905d76dc9 service placement] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:09:02.389678 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e8ddd-a99d-4b67-8492-b13905d76dc9 service placement] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:09:02.452695 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d78f8-ea91-468c-917f-c7e4c83b0837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:09:02.453312 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d78f8-ea91-468c-917f-c7e4c83b0837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:09:02.453596 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d78f8-ea91-468c-917f-c7e4c83b0837 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:09:02.453874 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d78f8-ea91-468c-917f-c7e4c83b0837 admin admin] PATH_INFO: `/v3/projects/c93422f894ac4cee8301a60de150bce2` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:09:02.455074 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d78f8-ea91-468c-917f-c7e4c83b0837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c93422f894ac4cee8301a60de150bce2)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:09:02.457796 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d78f8-ea91-468c-917f-c7e4c83b0837 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:09:02.504371 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-cb4d78f8-ea91-468c-917f-c7e4c83b0837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c93422f894ac4cee8301a60de150bce2', 'request_id': 'req-cb4d78f8-ea91-468c-917f-c7e4c83b0837'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:09:02.510294 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-cb4d78f8-ea91-468c-917f-c7e4c83b0837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c93422f894ac4cee8301a60de150bce2', 'request_id': 'req-cb4d78f8-ea91-468c-917f-c7e4c83b0837'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:09:02.516298 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-cb4d78f8-ea91-468c-917f-c7e4c83b0837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c93422f894ac4cee8301a60de150bce2', 'request_id': 'req-cb4d78f8-ea91-468c-917f-c7e4c83b0837'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:09:02.543684 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-cb4d78f8-ea91-468c-917f-c7e4c83b0837 admin admin] The token cache is being invalidate because project c93422f894ac4cee8301a60de150bce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 23:09:02.543903 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-cb4d78f8-ea91-468c-917f-c7e4c83b0837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:09:02.544534 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-cb4d78f8-ea91-468c-917f-c7e4c83b0837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:09:02.546016 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1463/2927] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 23:09:02 2022] DELETE /identity/v3/projects/c93422f894ac4cee8301a60de150bce2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:09:02.550040 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39840487-3a15-4576-a214-941e1952e51c admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:09:02.551464 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-39840487-3a15-4576-a214-941e1952e51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:09:02.565104 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39840487-3a15-4576-a214-941e1952e51c admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:09:02.589652 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:09:02.627819 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388298d-95b8-4558-a9d3-cb13e0ff29ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:09:02.628470 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388298d-95b8-4558-a9d3-cb13e0ff29ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:09:02.628754 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388298d-95b8-4558-a9d3-cb13e0ff29ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:09:02.629031 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388298d-95b8-4558-a9d3-cb13e0ff29ca admin admin] PATH_INFO: `/v3/users/c10697b743ee44f986011a38905a600c` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:09:02.630208 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388298d-95b8-4558-a9d3-cb13e0ff29ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=c10697b743ee44f986011a38905a600c)` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:09:02.632142 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9388298d-95b8-4558-a9d3-cb13e0ff29ca admin admin] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:09:02.677191 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-9388298d-95b8-4558-a9d3-cb13e0ff29ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c10697b743ee44f986011a38905a600c'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:09:02.677845 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-9388298d-95b8-4558-a9d3-cb13e0ff29ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c10697b743ee44f986011a38905a600c'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:09:02.690812 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-9388298d-95b8-4558-a9d3-cb13e0ff29ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c10697b743ee44f986011a38905a600c'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:09:02.697696 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-9388298d-95b8-4558-a9d3-cb13e0ff29ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c10697b743ee44f986011a38905a600c'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:09:02.710232 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.notifications [None req-9388298d-95b8-4558-a9d3-cb13e0ff29ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c10697b743ee44f986011a38905a600c'} {{(pid=86594) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:09:02.717224 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1465/2928] 10.222.0.48 () {58 vars in 1224 bytes} [Wed Jul 27 23:09:02 2022] DELETE /identity/v3/users/c10697b743ee44f986011a38905a600c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:09:02.894519 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d78f8-ea91-468c-917f-c7e4c83b0837 admin admin] Authenticating user token {{(pid=86595) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:09:02.896011 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.fernet_utils [None req-cb4d78f8-ea91-468c-917f-c7e4c83b0837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86595) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:09:02.909828 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d78f8-ea91-468c-917f-c7e4c83b0837 admin admin] Validating token access rules against request {{(pid=86595) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:09:02.960326 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:09:02.972616 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6591a-3484-45c0-a719-3539b8a60ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '823fd54d00af495593a275a61c2223da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a383910370a74720956232cbcc0a7762', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86595) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:09:02.973288 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6591a-3484-45c0-a719-3539b8a60ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:09:02.973791 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6591a-3484-45c0-a719-3539b8a60ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:09:02.974121 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6591a-3484-45c0-a719-3539b8a60ee2 admin admin] PATH_INFO: `/v3/projects/9853e4faae9d4f08b926260aba4d84ec` {{(pid=86595) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:09:02.975587 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6591a-3484-45c0-a719-3539b8a60ee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9853e4faae9d4f08b926260aba4d84ec)` {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:09:02.977485 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6591a-3484-45c0-a719-3539b8a60ee2 admin admin] RBAC: Authorization granted {{(pid=86595) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:09:03.023560 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-21c6591a-3484-45c0-a719-3539b8a60ee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9853e4faae9d4f08b926260aba4d84ec', 'request_id': 'req-21c6591a-3484-45c0-a719-3539b8a60ee2'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:09:03.030031 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-21c6591a-3484-45c0-a719-3539b8a60ee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9853e4faae9d4f08b926260aba4d84ec', 'request_id': 'req-21c6591a-3484-45c0-a719-3539b8a60ee2'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:09:03.035632 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-21c6591a-3484-45c0-a719-3539b8a60ee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9853e4faae9d4f08b926260aba4d84ec', 'request_id': 'req-21c6591a-3484-45c0-a719-3539b8a60ee2'} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:09:03.047732 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-21c6591a-3484-45c0-a719-3539b8a60ee2 admin admin] The token cache is being invalidate because project 9853e4faae9d4f08b926260aba4d84ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86595) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 23:09:03.048018 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-21c6591a-3484-45c0-a719-3539b8a60ee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:09:03.048628 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG keystone.notifications [None req-21c6591a-3484-45c0-a719-3539b8a60ee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86595) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 23:09:03.050154 dv-cinder-851249-4-smb devstack@keystone.service[86595]: [pid: 86595|app: 0|req: 1464/2929] 10.222.0.48 () {58 vars in 1233 bytes} [Wed Jul 27 23:09:02 2022] DELETE /identity/v3/projects/9853e4faae9d4f08b926260aba4d84ec => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 23:09:12.713785 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=41,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:09:13.044779 dv-cinder-851249-4-smb devstack@keystone.service[86595]: DEBUG dbcounter [-] [86595] Writing DB stats keystone:SELECT=27,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86595) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 23:13:23.741948 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388298d-95b8-4558-a9d3-cb13e0ff29ca admin admin] Authenticating user token {{(pid=86594) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 23:13:23.743375 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-9388298d-95b8-4558-a9d3-cb13e0ff29ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:13:23.814953 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388298d-95b8-4558-a9d3-cb13e0ff29ca admin admin] Validating token access rules against request {{(pid=86594) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 23:13:23.872675 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85436e80-a5f2-4bc4-b38f-9d88f8862016 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2e3a1384f3b34999a75572ee10a1e3fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd94f62f9c6ea4d7088ec264bf0ff3cf4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86594) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 23:13:23.873290 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436e80-a5f2-4bc4-b38f-9d88f8862016 service placement] REQUEST_METHOD: `GET` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 23:13:23.873578 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436e80-a5f2-4bc4-b38f-9d88f8862016 service placement] SCRIPT_NAME: `/identity` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 23:13:23.873860 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85436e80-a5f2-4bc4-b38f-9d88f8862016 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86594) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 23:13:23.875615 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.fernet_utils [None req-85436e80-a5f2-4bc4-b38f-9d88f8862016 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86594) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 23:13:23.886546 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85436e80-a5f2-4bc4-b38f-9d88f8862016 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 23:13:23.888646 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85436e80-a5f2-4bc4-b38f-9d88f8862016 service placement] RBAC: Authorization granted {{(pid=86594) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 23:13:23.898438 dv-cinder-851249-4-smb devstack@keystone.service[86594]: [pid: 86594|app: 0|req: 1466/2930] 10.222.0.48 () {60 vars in 1365 bytes} [Wed Jul 27 23:13:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 23:13:33.894203 dv-cinder-851249-4-smb devstack@keystone.service[86594]: DEBUG dbcounter [-] [86594] Writing DB stats keystone:SELECT=58 {{(pid=86594) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}